AMD preparing Instinct MI300 refresh with HBM3E memory

[harlan4096]

AMD MI300 expected to get HBM3E update

Mark Pepermaster (Chief Technology Officer and Executive Vice President) confirms AMD MI300 were architectured to support HBM3E. 



Micron and Samsung have recently reported on important updates to High Bandwidth Memory (HBM), specifically the HBM3E variant, targeting next-gen and current-gen refreshed data-center accelerators. NVIDIA’s H200 are already confirmed to incorporate the advanced HBM3E. However, it seems AMD has plans to upgrade their Instinct series from HBM3 as well.

Many enterprise customers are exploring alternatives, considering factors like cost and availability. AMD has positioned its Instinct MI300 series as formidable contenders against NVIDIA’s Hopper and Ampere processors. The MI300 series has several advantages, such as larger memory capacity.

The MI300A from AMD is equipped with 228 CDNA3 Compute Units, accompanied by 24 Zen4 cores based on x86 architecture. This SKU is outfitted with 128 GB of HBM3 memory. For those with compute-intensive requirements, the MI300X steps up with 304 CDNA3 Compute Units and 192GB of HBM3 memory. However, this product lacks Zen4 cores. The MI300 lineup competes with NVIDIA H200 and H200 SuperChip, based on Hopper architecture and paired with ARM Neoverse V2 cores in the case of the Super Chip.
...

Continue Reading