NVIDIA unveils GB200 NVL4: four Blackwell GPUs, two Grace CPUs, 1.7TB combined memory
#1
Information 
Quote:GB200 NVL4 is a platform with Blackwell GPU and Grace CPU

NVIDIA has several announcements at Supercomputing 2024

[Image: GB200NVL4-1200x624.jpg]

NVIDIA has announced that its H200 NVL processors are now available, which is a PCIe Express version of the Hopper accelerator. This is a slightly slower version than the SXM version, which might support a TDP of up to 700W. The PCIe version is limited to 600W. This, of course, means that the GPU will be slower in computing, but the important fact is that it retains the same memory bandwidth of 4.8 TB/s.

The quad-GPU solution is possible through a special NVLink bridge supporting an interconnect speed of 900 GB/s per GPU. Of course, such GPUs can only be used in several chassis because these cards have no active cooling system, and cooling down 600W of heat is not simple.

[Image: GB200-NVL42-768x431.jpg]
GB200 NVL4, Source: NVIDIA

NVIDIA is also introducing a new platform called GB200 NVL4, which is a single board equipped with four Blackwell GB200 accelerators and two Grace GPUs. Each processor is connected through NVLink, and all of them offer a combined 768GB of HBM3 memory and 32 TB/s of memory bandwidth. The Grace CPUs have their own system memory based on LPDDR5X technology, with a total capacity of 960 GB.

NVIDIA claims that their GB200 GPUs will be 2.2x faster and 1.8x quicker training compared to NVIDIA GH200 NVL4. 
Perhaps the most interesting metric is the power consumption, expected to be 5400W.

Continue Reading...
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)
[-]
Welcome
You have to register before you can post on our site.

Username/Email:


Password:





[-]
Recent Posts
Trojans in AI models
Hidden logic, data...harlan4096 — 08:03
Bitdefender 27.0.45.220
Bitdefender 27.0.4...harlan4096 — 08:01
AdGuard for Android v4.7
AdGuard for Androi...harlan4096 — 08:00
Google Chrome 131.0.6778.108/.109
Google Chrome 131....harlan4096 — 07:57
Adobe Acrobat Reader DC 24.005.20307
Adobe Acrobat Read...harlan4096 — 07:56

[-]
Birthdays
Today's Birthdays
No birthdays today.
Upcoming Birthdays
avatar (42)ivyhuv
avatar (40)Enlargedterrestrial20

[-]
Online Staff
There are no staff members currently online.

>