Quote:Intel Unveils Gaudi3: a challenger to NVIDIA’s Hopper and Blackwell

The company unveils its next-gen AI accelerator.



At Vision 2024, Intel lifted the curtain on the Gaudi3, its next-gen AI accelerator combining two 5nm TSMC dies. The chip boasts impressive specs, featuring 64 Tensor cores (5th Generation), 128GB of HBM2w memory, and 900W of power on air. The Gaudi3 succeeds Gaudi2, developed by Habana Labs, which Intel acquired five years ago.

The Tensor core count has increased from 24 on Gaudi2 to now combining two 32 Tensor cores across two chips. Each chip comes with 48MB of SRAM memory, totaling 96MB per full package. The SRAM memory itself has a bandwidth of 12.8 TB/s. This memory is supported by HBM memory, still relying on HBM2e technology, but with a faster total bandwidth of 3.7 TB/s compared to 2.45 TB/s on Gaudi2. Furthermore, the full capacity has increased from 96GB to 128GB.



Intel Gaudi3 (photograph), Source: Intel
...