| 规格 | NVIDIA A2 | NVIDIA H100 NVL |
|---|
| 架构 | NVIDIA Ampere | NVIDIA Hopper |
| 显存 | 16 GB GDDR6 | 94GB |
| 显存带宽 | 200 GB/s | 3.9TB/s |
| FP32算力 | 4.5 TF | 60 teraFLOPs |
| FP16算力 | 18 TF | 36 TF | 1,671 teraFLOPS |
| INT8算力 | 36 TOPS | 72 TOPS | 3,341 TOPS |
| 功耗TDP | 40–60W (configurable) | 350-400W (configurable) |
| 互联 | PCIe Gen4 x8 | NVIDIA NVLink: 600GB/s | PCIe Gen5: 128GB/s |
| 形态 | 1-slot, low-profile PCIe | PCIe dual-slot air-cooled |
| 视频引擎 | 1 video encoder / 2 video decoders (includes AV1 decode) | — |
| 显存类型 | — | HBM3 |
| FP64算力 | — | 30 teraFLOPs |
| FP64 Tensor Core | — | 60 teraFLOPs |
| FP8算力 | — | 3,341 teraFLOPS |
| MIG切片 | — | Up to 7 MIGS @ 12GB each |
| 编解码器 | — | 7 NVDEC | 7 JPEG |