Skip to content
HardwareLadder
AI GPU ladder

NVIDIAAI GPU · PCIe

L40S

NVIDIA L40S is a Ada Lovelace data-center accelerator with 48 GB GDDR6 and 0.864 TB/s of memory bandwidth.

Ladder rank
#17
AI index (H100 SXM = 100)
30.7
Series
Ada Lovelace

Specifications

Dense throughput, no sparsity
Architecture Ada Lovelace
Form factor PCIe
Process TSMC 4N
FP16 / BF16 tensor (dense) 362.1 TFLOPS
FP8 tensor (dense) 733 TFLOPS
FP4 tensor (dense) —
Memory 48 GB GDDR6
Memory bandwidth 0.864 TB/s
Power 350 W
Launch Aug 2023

AI index

Tensor × bandwidth

100 × √((362.1 ÷ 989.4) × (0.864 ÷ 3.35)) = 30.7

The AI index is the geometric mean of dense 16-bit tensor throughput and memory bandwidth, each relative to the H100 SXM. It is a spec-sheet comparison, not a measured benchmark.

Sources

1 references