Based on Intel’s announcement to Tom’s Hardware, Microsoft‘s Copilot AI service would operate locally on PCs. Beyond the capability of any consumer CPU on the market, the company stated that next-generation AI PCs would need built-in neural processing units (NPUs) with over 40 TOPS (trillion operations per second) of power.
“More elements of Copilot” would be able to run locally on the AI PCs, according to Intel. Nowadays, even simple requests are handled by Copilot almost entirely in the cloud. That produces some lag, which is acceptable for bigger operations but not optimal for smaller ones. Improved performance and privacy could be achieved by reducing lag with the addition of local computation capabilities.
Microsoft was previously rumored to require 40 TOPS on next-gen AI PCs (along with a modest 16GB of RAM). Right now, Windows doesn’t make much use of NPUs, apart from running video effects like background blurring for Surface Studio webcams. ChromeOS and macOS both use NPU power for more video and audio processing features, though, along with OCR, translation, live transcription and more, Ars Technica noted.
So far, the processor with the fastest NPU speed is Apple M3, which offers 18 TOPS across the lineup (M3, M3 Pro and M3 Ultra). AMD’s Ryzen 8040 and 7040 laptop chips are next with 16 and 10 TOPS respectively, while Intel’s Meteor Lake laptop hits 10 TOPS as well. Qualcomm may offer the first processor with enough power for Copilot via the Snapdragon X Elite, which will offer 45 TOPS of AI compute speed.
Intel’s Lunar Lake chips, set to arrive in 2025, will ship with triple its current NPU speeds. Yesterday, the company introduced 300 new AI features optimized specifically for its own OpenVino platform. The chip giant also announced an AI PC development kit based on the the ASUS NUC Pro that uses its current Meteor Lake silicon.
“From a desktop standpoint, we have plans on the desktop side, what we would say [is an] AI PC. And then there’s also the next-gen AI PC, the 40 TOPS requirements; we have all of our different steps in our roadmap on how we cover all the different segments,” the company told Tom’s Hardware.
