| 规格 | NVIDIA H100 NVL | NVIDIA H200 NVL |
|---|
| 架构 | NVIDIA Hopper | NVIDIA Hopper |
| 显存 | 94GB | 141GB |
| 显存类型 | HBM3 | HBM3e |
| 显存带宽 | 3.9TB/s | 4.8TB/s |
| FP64算力 | 30 teraFLOPs | 30 TFLOPS |
| FP64 Tensor Core | 60 teraFLOPs | 60 TFLOPS |
| FP32算力 | 60 teraFLOPs | 60 TFLOPS |
| FP8算力 | 3,341 teraFLOPS | 3,341 TFLOPS |
| FP16算力 | 1,671 teraFLOPS | 1,671 TFLOPS |
| INT8算力 | 3,341 TOPS | 3,341 TFLOPS |
| 功耗TDP | 350-400W (configurable) | Up to 600W (configurable) |
| 互联 | NVIDIA NVLink: 600GB/s | PCIe Gen5: 128GB/s | 2- or 4-way NVIDIA NVLink bridge: 900GB/s per GPU | PCIe Gen5: 128GB/s |
| 形态 | PCIe dual-slot air-cooled | PCIe Dual-slot air-cooled |
| MIG切片 | Up to 7 MIGS @ 12GB each | Up to 7 MIGs @16.5GB each |
| 编解码器 | 7 NVDEC | 7 JPEG | 7 NVDEC | 7 JPEG |
| 机密计算 | — | Supported |