Why Microsoft's Copilot will only kinda run locally on AI PCs for now

Microsoft's definition of what does and doesn't constitute an AI PC is taking shape. With the latest version of Windows, a dedicated Copilot key, and an NPU capable of at least 40 trillion operations per second, you'll soon be able to run Microsoft Copilot locally, ish, on your machine.

While the idea of untethering Copilot from Azure's umbilical might be attractive to some, not everyone seems to be a fan ofIntel executives have said as much: Faster hardware will enable more"elements" of Copilot to run locally. In other words, you're still going to be reliant on a network connection for at least some of the functionality, and the rest the AI PC will handle itself.

And that's for a general purpose model. Conceivably, you could get by with even smaller models tuned for source code generation that are only loaded into memory when the application, say Visual Studio Code, is launched and an active Github Copilot subscription is detected. Remember, Copilot is more than just a chatbot; it's a suite of AI features that are getting baked into Microsoft's OS and software library.

As such, we can see a couple scenarios how Microsoft may use local AI. The first is to offload work from Microsoft servers and improve response times. As hardware improves, more Copilot features could be pushed out of the cloud and onto user devices. That lineup received a clock bump in December during the House of Zen's Advancing AI event. AMD also brought its NPUs to the desktop with the launch of itsmicroprocessor parts in late December. These Core Ultra chips feature an NPU derived from Intel's Movidius vision processing unit , which IntelUnfortunately, chips are only capable of 10 to 16 trillion operations per second, far below that of Microsoft's 40 TOPS spec.

Technology Technology Latest News, Technology Technology Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

Microsoft's first AI PCs Surface with Intel cores and a Copilot keyUpgraded fondleslab and laptops limited to business buyers only, for now
Source: TheRegister - 🏆 67. / 61 Read more »

Microsoft Introduces Copilot for Security, a Generative AI ServiceMicrosoft has launched Copilot for Security, a generative AI service that offers document summarization, flagging suspicious interactions, and generating security recommendations. It can be used as a standalone portal or integrated with third-party products. The service is based on GPT-4 and a Microsoft security-specific model and is available through a pay-as-you-go licensing model tied to Microsoft Azure.
Source: TheRegister - 🏆 67. / 61 Read more »

Copilot can't stop emitting violent, sexual images, says Microsoft whistleblowerAI tech loves picturing women in underwear, Windows giant won't do anything about it, watchdog told
Source: TheRegister - 🏆 67. / 61 Read more »

Intel throws chips on the table, Microsoft plays the Copilot card in wild bet on AI PCsDoes anyone actually want one?
Source: TheRegister - 🏆 67. / 61 Read more »