Microsoft Enables Nvidia GPU Support for Windows 11 Local Language Model APIs

[harlan4096]

Microsoft has updated the Windows 11 local AI documentation to confirm that language model APIs can now run on PCs that are not equipped with Copilot+ but have supported GPUs. Previously, these APIs were only available on Copilot+ PCs that had dedicated NPU hardware.

The change is currently aimed at developers and is not yet available to end users. Supported hardware includes Nvidia GeForce RTX 30 series GPUs and newer models with at least 6GB of VRAM.

What Changed and What This Enables on Non?Copilot+ PCs

Microsoft's updated developer documentation and a GitHub post describe a recent change. They state that language model APIs now run on GPU-equipped PCs that are not Copilot+ models, expanding local language model capabilities to more Windows 11 devices.

This represents a shift from Microsoft's original focus on Copilot+ PCs launched on June 18, 2024, which emphasized NPUs as necessary for local AI features in Windows.

While NPUs are not the only chips capable of AI workloads, Microsoft previously limited most built-in AI features to devices with NPUs.

Continue Reading...