Quote:AMD releases ROCm 7.0 for developers



AMD is continuing its push to offer a strong alternative to NVIDIA CUDA, one of the most widely used software platforms for GPU computing. ROCm (Radeon Open Compute) has gone through major changes in recent years, and version 7, launching today, is one of the largest updates so far.

AMD has announced ROCm 7.0, the latest version of its open software platform for GPU computing, with a strong focus on artificial intelligence. The update brings improved performance, new developer tools, and expanded support for large-scale model training and inference.

Key updates in ROCm 7.0 include:

• Full enablement of AMD Instinct MI350 series GPUs based on CDNA 4 architecture
  
• Optimized training and inference with FP4, FP6, and FP8 precision formats
  
• Support for distributed inference across multi-GPU clusters
  
• HIP 7.0 for easier code portability across different hardware
  
• Enterprise-focused tools: AMD Resource Manager and AMD AI Workbench
  
• Prebuilt Docker images for vLLM and SGLang with quantized models including Llama 3.3 70B, Llama 3.1-405B, and DeepSeek R1
  

Continue Reading...