Posts: 13,295
Threads: 9,036
Thanks Received: 8,861 in 7,016 posts
Thanks Given: 9,809
Joined: 12 September 18
20 June 24, 09:03
Quote:AMD has officially launched its new ROCm 6.1.3 Open Compute software suite with added AI capabilities & support alongside the Radeon PRO W7900 Dual Slot GPU.
AMD's ROCm 6.1.3 Software Stack Adds Multi-GPU Support, TensorFlow AI Framework Support & WSL 2 Support, Radeon PRO W7900 Dual Slot GPU Hits Shelves For $3499
Announced at Computex 2024, AMD is formally launching its Radeon PRO W7900 Dual Slot GPU in the retail segment. Priced at $3499 US, the Radeon PRO W7900 is said to offer leadership performance-per-dollar and a vast 48 GB memory pool, enabling faster performance within AI-oriented workloads such as LLMs (Large Language Models).
Coming straight to the specifications, the AMD Radeon PRO W7900 graphics card comes in a dual-slot design, making it a perfect solution for workstation setups which can house up to four of these AI-ready behemoths. Internally, the graphics card features the Navi 31 XTX GPU core with 6144 cores packed within 96 compute units. The GPU is equipped with a 384-bit wide bus & comes loaded with 48 GB of GDDR6 memory, delivering up to 864 GB/s of bandwidth. The card also packs 96 MB of Infinity Cache to further take things up a notch, providing even more bandwidth to this high-end GPU.
Following are some of the main highlights of the graphics card:- Impressive Performance – Featuring 96 compute units, with192 AI and 96 ray accelerators it delivers up to an exceptional 61.32 TFLOPs at peak single precision (FP32) and 122.64 TFLOPS of peak half precision (FP16) performance.
- Leadership Performance-Per-Dollar – Delivers up to 38% better performance-per-dollar in Llama 3 70B Q4 than the competitive offering with the ability to fit the 70B parameter model on a single GPU framebuffer.
- Exceptional Memory – Enables seamless multitasking and the handling of complex projects effortlessly with 48GB of memory equipped with error-correcting code (ECC) technology to ensure data integrity.
- AI on the Desktop – A local PC or workstation equipped with up to four AMD Radeon PRO W7900 Dual Slot graphics cards adds powerful AI performance to any IT infrastructure, is ideal for mission-critical projects, and can help keep sensitive data in-house.
Besides the Radeon PRO W7900 Dual Slot GPU launch, AMD is also launching its ROCm 6.1.3 open compute software suite for public release. The new ROCm software brings enhanced accessibility & widened support for consumer-tier graphics cards under the Radeon and Radeon PRO series. The release highlights include:- Multi-GPU support to enable building scalable AI desktops for multi-serving, multi-user solutions.
- Beta-level support for Windows Subsystem for Linux, allowing these solutions to work with ROCm on a Windows OS-based system.
- TensorFlow Framework support offers more choices for AI development.
...
Continue Reading