| 规格 | NVIDIA H200 NVL | NVIDIA A30 |
|---|
| 架构 | NVIDIA Hopper | NVIDIA Ampere |
| 显存 | 141GB | 24 GB HBM2 |
| 显存类型 | HBM3e | — |
| 显存带宽 | 4.8TB/s | 933 GB/s |
| FP64算力 | 30 TFLOPS | 5.2 teraFLOPS |
| FP64 Tensor Core | 60 TFLOPS | — |
| FP32算力 | 60 TFLOPS | 10.3 teraFLOPS |
| FP8算力 | 3,341 TFLOPS | — |
| FP16算力 | 1,671 TFLOPS | 165 teraFLOPS | 330 teraFLOPS |
| INT8算力 | 3,341 TFLOPS | 330 TOPS | 661 TOPS |
| 功耗TDP | Up to 600W (configurable) | 165 W |
| 互联 | 2- or 4-way NVIDIA NVLink bridge: 900GB/s per GPU | PCIe Gen5: 128GB/s | PCIe Gen4: 64GB/s / Third-gen NVLINK: 200GB/s |
| 形态 | PCIe Dual-slot air-cooled | Dual-slot, full-height, full-length (FHFL) |
| MIG切片 | Up to 7 MIGs @16.5GB each | — |
| 编解码器 | 7 NVDEC | 7 JPEG | — |
| 机密计算 | Supported | — |
| TF32算力 | — | 82 teraFLOPS | 165 teraFLOPS |
| MIG | — | 4 GPU instances @ 6GB each |