| 规格 | NVIDIA L40S | NVIDIA H100 NVL |
|---|
| 架构 | NVIDIA Ada Lovelace architecture | NVIDIA Hopper |
| 显存 | 48 GB GDDR6 with ECC | 94GB |
| 显存带宽 | 864 GB/s | 3.9TB/s |
| FP32算力 | 91.6 teraFLOPS | 60 teraFLOPs |
| FP16算力 | 733 teraFLOPS* | 1,671 teraFLOPS |
| FP8算力 | 1,466 teraFLOPS* | 3,341 teraFLOPS |
| 功耗TDP | 350 W | 350-400W (configurable) |
| 互联 | PCIe Gen4 x16 | NVIDIA NVLink: 600GB/s | PCIe Gen5: 128GB/s |
| 形态 | 4.4" (H) x 10.5" (L), dual slot | PCIe dual-slot air-cooled |
| 编解码器 | 3x (includes AV1 encode and decode) | 7 NVDEC | 7 JPEG |
| 显存类型 | — | HBM3 |
| FP64算力 | — | 30 teraFLOPs |
| FP64 Tensor Core | — | 60 teraFLOPs |
| INT8算力 | — | 3,341 TOPS |
| MIG切片 | — | Up to 7 MIGS @ 12GB each |