Intel Gaudi 3
Intel Gaudi 3 is Intel’s fifth-generation Gaudi AI accelerator, with 128 GB of HBM2e at 3.7 TB/s.
- Vendor
- Intel
- Architecture
- Gaudi (5th-gen TPC), 5nm
- Memory
- 128 GB HBM2e
- Memory bandwidth (TB/s)
- 3.7 TB/s
- FP8 (TFLOPS)
- 1,678 TFLOPS
- Power (W)
- 900 W
- Form factor
- OAM mezzanine card (HL-325L); PCIe card (HL-338)
- Status
- Shipping
Gaudi 3 has two compute dies holding 8 matrix engines and 64 tensor processor cores, 128 GB of HBM2e at 3.7 TB/s and 24 integrated 200 Gbps RDMA Ethernet ports. It comes as the HL-325L OAM mezzanine card and the HL-338 PCIe card (600 W). Intel’s white paper rates the OAM version at 900 W and 1,678 TFLOPS of FP8 and BF16 matrix compute.
Intel’s Gaudi 3 e-book lists 1,835 TFLOPS FP8 for the matrix engines.
- Memory (GB)
- 128 GB
- Precision note (sparse or dense)
- 1,678 TFLOPS FP8 MME (matrix engine) from Intel's white paper, no sparsity label; Intel's Gaudi 3 e-book lists 1,835 TFLOPS FP8 MME.
- Vendor source
- cdrdv2-public.intel.com
- Checked
Questions
How much memory does Intel Gaudi 3 have?
Gaudi 3 has 128 GB of HBM2e with 3.7 TB/s of bandwidth.
What is Gaudi 3’s FP8 performance?
Intel’s white paper rates the OAM version at 1,678 TFLOPS of FP8 and BF16 matrix compute; Intel’s Gaudi 3 e-book lists 1,835 TFLOPS FP8.
How much power does Gaudi 3 use?
Intel rates the HL-325L OAM card at 900 W and the HL-338 PCIe card at 600 W.
What networking does Gaudi 3 have?
Gaudi 3 integrates 24 RDMA Ethernet ports at 200 Gbps each.
Source
Every figure is taken from the vendor’s own datasheet, product page, technical documentation or announcement, linked on each chip with the date it was last checked. How we pick and check sources: editorial standards.