| 规格 | NVIDIA T4 | NVIDIA H800 |
|---|
| 架构 | Turing (TU104-895) | NVIDIA Hopper |
| 显存 | 16GB GDDR6 with ECC (默认开启) | 80 GB HBM2e |
| 显存带宽 | 320GB/s (早期一页版datasheet口径300GB/s) | 2 TB/sec |
| 显存位宽 | 256bit | — |
| 算力 | FP32 8.1 TFLOPS / FP16·FP32混合精度 65 TFLOPS / INT8 130 TOPS / INT4 260 TOPS | — |
| CUDA核心 | 2,560 (40 SM) / Tensor Core 320 / RT Core 40 (白皮书口径) | 14592 FP32 CUDA Cores per GPU |
| 功耗 | 70W (Total board power, 默认) | — |
| 互联 | PCIe Gen3 x16 (支持x8运行, Interconnect BW 32GB/s) | NVLink: 400 GB/s |
| 发布年 | 2018 (Product Brief v01 2018-10-24初版, Dec18版datasheet © 2018 NVIDIA) | 2023 |
| 形态 | 单槽半高半长 Low-Profile 6.6英寸(长169.53mm), 被动散热, 板重301g | PCIe full height/length, dual slot |
| 时钟 | Base 585MHz / Boost 1590MHz (Base为70W功耗墙下调校) | — |
| 媒体引擎 | 1080p30解码 H.264 32路 / HEVC 44路 / VP9 32路 (白皮书Table 2, 官方页称38路full-HD) | — |
| SR-IOV | Supported; 16 VF(支持) | — |
| 工艺 | 12nm FFN, 136亿晶体管, 545mm2 (白皮书TU104口径) | — |
| Compute APIs | CUDA, NVIDIA TensorRT, ONNX | — |
| 显存(94GB版) | — | 94 GB HBM3 |
| 显存带宽(94GB版) | — | 3.9 TB/sec |
| FP32算力 | — | 51 TFLOPS |
| Tensor核心 | — | 456 fourth-generation Tensor Cores per GPU |
| 系统接口 | — | PCIe Gen 5, x16 lanes |
| MIG切片 | — | Up to 7 GPU instances |
| 功耗TDP | — | 350 W |
| ECC | — | Yes |