Intel launches Xeon 6 “Granite Rapids”: 6980P with 128 cores and 500W TDP
#1
Information 
Quote:Intel Unveils Next-Generation AI Solutions with the Launch of Xeon 6 and Gaudi 3

Intel enables a new era of high-performance enterprise AI systems and solutions.


[Image: INTEL-XEON-6-HERO-1-1200x624.jpg]
  • Intel launches Xeon 6 with Performance-cores (P-cores), doubling the performance for AI and HPC workloads.
  • New Gaudi 3 AI accelerators offer up to 20 percent more throughput and 2x price/performance vs H100 for inference of LLaMa 2 70B[sup]1[/sup].
SANTA CLARA, Calif., September 24, 2024 – As AI continues to revolutionize industries, enterprises are increasingly in need of infrastructure that is both cost-effective and available for rapid development and deployment. To meet this demand head-on, Intel today launched Xeon 6 with Performance-cores (P-cores) and Gaudi 3 AI accelerators, bolstering the company’s commitment to deliver powerful AI systems with optimal performance per watt and lower total cost of ownership (TCO).

“Demand for AI is leading to a massive transformation in the data center, and the industry is asking for choice in hardware, software and developer tools,” said Justin Hotard, Intel executive vice president and general manager of the Data Center and Artificial Intelligence Group. “With our launch of Xeon 6 with P-cores and Gaudi 3 AI accelerators, Intel is enabling an open ecosystem that allows our customers to implement all of their workloads with greater performance, efficiency and security.”

Introducing Intel Xeon 6 with P-cores and Gaudi 3 AI accelerators

[Image: INTEL-XEON-6-2-768x432.jpg] [Image: INTEL-XEON-6-1-768x432.jpg]
I
ntel’s latest advancements in AI infrastructure include two major updates to its data center portfolio:
  • Intel[sup]®[/sup] Xeon[sup]®[/sup] 6 with P-cores: Designed to handle compute-intensive workloads with exceptional efficiency, Xeon 6 delivers twice the performance of its predecessor[sup]2[/sup]. It features increased core count, double the memory bandwidth and AI acceleration capabilities embedded in every core. This processor is engineered to meet the performance demands of AI from edge to data center and cloud environments.
  • Intel[sup]®[/sup] Gaudi[sup]®[/sup] 3 AI Accelerator: Specifically optimized for large-scale generative AI, Gaudi 3 boasts 64 Tensor processor cores (TPCs) and eight matrix multiplication engines (MMEs) to accelerate deep neural network computations. It includes 128 gigabytes (GB) of HBM2e memory for training and inference, and 24 200 Gigabit (Gb) Ethernet ports for scalable networking. Gaudi 3 also offers seamless compatibility with the PyTorch framework and advanced Hugging Face transformer and diffuser models. Intel recently announced a collaboration with IBM to deploy Intel Gaudi 3 AI accelerators as a service on IBM Cloud. Through this collaboration, Intel and IBM aim to lower the total cost of ownership to leverage and scale AI, while enhancing performance.
...
Continue Reading
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)
[-]
Welcome
You have to register before you can post on our site.

Username/Email:


Password:





[-]
Recent Posts
Intel to release another microcode upda...
Intel confirms 13th/...harlan4096 — 09:12
Adobe will disable Adobe Elements 2025 t...
Adobe announced ne...harlan4096 — 09:11
iOS 18.0.1 fixes iPhone touch screen pro...
Apple has released...harlan4096 — 09:09
K-Lite Codec Pack 18.5.5 / 18.5.7 Update
Changes in 18.5.7:...harlan4096 — 09:32
AdGuard Browser Extension 5.0.128
AdGuard Browser Ex...harlan4096 — 09:31

[-]
Birthdays
Today's Birthdays
avatar (47)Konradsuiz
avatar (37)haupeadvoge
avatar (41)RobertBrura
Upcoming Birthdays
avatar (46)Michaelaceve
avatar (36)QuadirLigh
avatar (37)Mblippek
avatar (40)guerigGep
avatar (43)viecontAceve
avatar (48)wohnkwagVib
avatar (43)Michaelsen
avatar (36)armaMIZ
avatar (47)lambrnag
avatar (48)AlbertDig
avatar (48)beipHit
avatar (44)Wendigortup
avatar (37)Timothynet
avatar (40)MichaelHig
avatar (36)icebywiwy
avatar (44)Cameronreoxy
avatar (40)BrendaRusia
avatar (46)maggiebz16
avatar (37)MarthaWes
avatar (46)vikgoMam
avatar (39)Michaelcrini
avatar (37)DonaldSoM

[-]
Online Staff
There are no staff members currently online.

>