| 规格 | NVIDIA H100 NVL | NVIDIA A2 |
|---|
| 架构 | NVIDIA Hopper | NVIDIA Ampere |
| 显存 | 94GB | 16 GB GDDR6 |
| 显存类型 | HBM3 | — |
| 显存带宽 | 3.9TB/s | 200 GB/s |
| FP64算力 | 30 teraFLOPs | — |
| FP64 Tensor Core | 60 teraFLOPs | — |
| FP32算力 | 60 teraFLOPs | 4.5 TF |
| FP8算力 | 3,341 teraFLOPS | — |
| FP16算力 | 1,671 teraFLOPS | 18 TF | 36 TF |
| INT8算力 | 3,341 TOPS | 36 TOPS | 72 TOPS |
| 功耗TDP | 350-400W (configurable) | 40–60W (configurable) |
| 互联 | NVIDIA NVLink: 600GB/s | PCIe Gen5: 128GB/s | PCIe Gen4 x8 |
| 形态 | PCIe dual-slot air-cooled | 1-slot, low-profile PCIe |
| MIG切片 | Up to 7 MIGS @ 12GB each | — |
| 编解码器 | 7 NVDEC | 7 JPEG | — |
| 视频引擎 | — | 1 video encoder / 2 video decoders (includes AV1 decode) |