| 规格 | NVIDIA L40 | NVIDIA H200 NVL |
|---|
| 架构 | NVIDIA Ada Lovelace Architecture | NVIDIA Hopper |
| 显存 | 48 GB GDDR6 with ECC | 141GB |
| 显存带宽 | 864GB/s | 4.8TB/s |
| 显存位宽 | 384 Bit | — |
| FP32算力 | 90.52 TFLOPS | 60 TFLOPS |
| CUDA核心 | 18176 | — |
| 互联 | PCI Express Gen 4 | 2- or 4-way NVIDIA NVLink bridge: 900GB/s per GPU | PCIe Gen5: 128GB/s |
| 显示输出 | 4 x DP 1.4a | — |
| 编解码器 | 3x | 3x (Includes AV1 Encode & Decode) | 7 NVDEC | 7 JPEG |
| 形态 | 4.4" (H) x 10.5" (L) Dual Slot | PCIe Dual-slot air-cooled |
| 功耗TDP | 300W | Up to 600W (configurable) |
| 散热 | Passive | — |
| 供电接口 | 1x PCIe CEM5 16-pin | — |
| NEBS Ready | Yes / Level 3 | — |
| 发布年 | 2022 | — |
| 显存类型 | — | HBM3e |
| FP64算力 | — | 30 TFLOPS |
| FP64 Tensor Core | — | 60 TFLOPS |
| FP8算力 | — | 3,341 TFLOPS |
| FP16算力 | — | 1,671 TFLOPS |
| INT8算力 | — | 3,341 TFLOPS |
| MIG切片 | — | Up to 7 MIGs @16.5GB each |
| 机密计算 | — | Supported |