| 规格 | NVIDIA H100 NVL | NVIDIA A16 |
|---|---|---|
| 架构 | NVIDIA Hopper | NVIDIA Ampere |
| 显存 | 94GB | 4x 16GB GDDR6 |
| 显存类型 | HBM3 | — |
| 显存带宽 | 3.9TB/s | 4x 200 GB/s |
| FP64算力 | 30 teraFLOPs | — |
| FP64 Tensor Core | 60 teraFLOPs | — |
| FP32算力 | 60 teraFLOPs | — |
| FP8算力 | 3,341 teraFLOPS | — |
| FP16算力 | 1,671 teraFLOPS | — |
| INT8算力 | 3,341 TOPS | — |
| 功耗TDP | 350-400W (configurable) | — |
| 互联 | NVIDIA NVLink: 600GB/s | PCIe Gen5: 128GB/s | PCI Express Gen 4 x16 |
| 形态 | PCIe dual-slot air-cooled | Full height, full length (FHFL) dual slot |
| MIG切片 | Up to 7 MIGS @ 12GB each | — |
| 编解码器 | 7 NVDEC | 7 JPEG | — |
| 功耗 | — | 250W |
| 散热 | — | Passive |
| NVENC|NVDEC | — | 4x | 8x (includes AV1 decode) |
| 电源接口 | — | 8-pin CPU |
| NEBS | — | Level 3 |