Microsoft is integrating new generative AI features into its Windows 11 operating system, making them available to all users, not just those with new, specialized hardware. The company states its goal is to fundamentally change how people interact with computers.
The updates introduce three core capabilities:
- “Hey Copilot” Voice Control: Users can now activate the Copilot AI assistant with the voice command “Hey Copilot” from anywhere in the operating system. Yusuf Mehdi, Microsoft’s Consumer Chief Marketing Officer, described voice as the third fundamental input method for PCs, following the mouse and keyboard.
- Copilot Vision: This feature, now rolling out worldwide, allows the AI to “see” and analyze a user’s screen content. It can provide contextual assistance, such as guiding a user through application settings or answering questions about an open document.
- Copilot Actions: An experimental feature for testers that allows an AI agent to take control of the PC to autonomously perform tasks like organizing files. Microsoft states this feature is disabled by default and runs in a separate, sandboxed environment to ensure security and user control.
The company emphasizes that while it is promoting a voice-first approach, all features remain accessible through traditional text input. Microsoft is also implementing a new security framework for the AI agents, which includes user control, transparency, and limited system privileges.
Sources: VentureBeat, The Verge
