IntelAI GPU · OAM (HL-225)
Gaudi 2
Intel Gaudi 2 is a Gaudi 2 data-center accelerator with 96 GB HBM2e and 2.45 TB/s of memory bandwidth.
Specifications
Dense throughput, no sparsity| Architecture | Gaudi 2 |
|---|---|
| Form factor | OAM (HL-225) |
| Process | TSMC 7 nm |
| FP16 / BF16 tensor (dense) | 432 TFLOPS |
| FP8 tensor (dense) | 865 TFLOPS |
| FP4 tensor (dense) | — |
| Memory | 96 GB HBM2e |
| Memory bandwidth | 2.45 TB/s |
| Power | 600 W |
| Launch | May 2022 |
AI index
Tensor × bandwidth100 × √((432 ÷ 989.4) × (2.45 ÷ 3.35)) = 56.5
The AI index is the geometric mean of dense 16-bit tensor throughput and memory bandwidth, each relative to the H100 SXM. It is a spec-sheet comparison, not a measured benchmark.