Skip to content
AI GPU ladder

IntelAI GPU · OAM (HL-325L)

Gaudi 3

Intel Gaudi 3 is a Gaudi 3 data-center accelerator with 128 GB HBM2e and 3.7 TB/s of memory bandwidth.

Ladder rank
#5
AI index (H100 SXM = 100)
143.1
Series
Gaudi

Specifications

Dense throughput, no sparsity
Architecture Gaudi 3
Form factor OAM (HL-325L)
Process TSMC 5 nm
FP16 / BF16 tensor (dense) 1,835 TFLOPS
FP8 tensor (dense) 1,835 TFLOPS
FP4 tensor (dense) —
Memory 128 GB HBM2e
Memory bandwidth 3.7 TB/s
Power 900 W
Launch Sep 2024

AI index

Tensor × bandwidth

100 × √((1,835 ÷ 989.4) × (3.7 ÷ 3.35)) = 143.1

The AI index is the geometric mean of dense 16-bit tensor throughput and memory bandwidth, each relative to the H100 SXM. It is a spec-sheet comparison, not a measured benchmark.

Sources

2 references