Skip to content
HardwareLadder
AI GPU ladder

NVIDIAAI GPU · SXM5

H20

NVIDIA H20 is a Hopper data-center accelerator with 96 GB HBM3 and 4 TB/s of memory bandwidth.

Ladder rank
#15
AI index (H100 SXM = 100)
42.3
Series
Hopper

Specifications

Dense throughput, no sparsity
Architecture Hopper
Form factor SXM5
Process TSMC 4N
FP16 / BF16 tensor (dense) 148 TFLOPS
FP8 tensor (dense) —
FP4 tensor (dense) —
Memory 96 GB HBM3
Memory bandwidth 4 TB/s
Power 400 W
Launch Nov 2023

AI index

Tensor × bandwidth

100 × √((148 ÷ 989.4) × (4 ÷ 3.35)) = 42.3

The AI index is the geometric mean of dense 16-bit tensor throughput and memory bandwidth, each relative to the H100 SXM. It is a spec-sheet comparison, not a measured benchmark.

Sources

1 references