NVIDIA unveils GB200 NVL4: four Blackwell GPUs, two Grace CPUs, 1.7TB combined memory

[harlan4096]

GB200 NVL4 is a platform with Blackwell GPU and Grace CPU

NVIDIA has several announcements at Supercomputing 2024



NVIDIA has announced that its H200 NVL processors are now available, which is a PCIe Express version of the Hopper accelerator. This is a slightly slower version than the SXM version, which might support a TDP of up to 700W. The PCIe version is limited to 600W. This, of course, means that the GPU will be slower in computing, but the important fact is that it retains the same memory bandwidth of 4.8 TB/s.

The quad-GPU solution is possible through a special NVLink bridge supporting an interconnect speed of 900 GB/s per GPU. Of course, such GPUs can only be used in several chassis because these cards have no active cooling system, and cooling down 600W of heat is not simple.


GB200 NVL4, Source: NVIDIA

NVIDIA is also introducing a new platform called GB200 NVL4, which is a single board equipped with four Blackwell GB200 accelerators and two Grace GPUs. Each processor is connected through NVLink, and all of them offer a combined 768GB of HBM3 memory and 32 TB/s of memory bandwidth. The Grace CPUs have their own system memory based on LPDDR5X technology, with a total capacity of 960 GB.

NVIDIA claims that their GB200 GPUs will be 2.2x faster and 1.8x quicker training compared to NVIDIA GH200 NVL4. 
Perhaps the most interesting metric is the power consumption, expected to be 5400W.

Continue Reading...