Microsoft is rolling out its Copilot Vision feature to Windows and mobile platforms, extending the AI assistant’s capabilities beyond web browsers. Previously limited to Edge webpages, Copilot Vision can now analyze real-time video from mobile cameras and interact with content across Windows applications.
The expanded vision capabilities allow Copilot to provide practical assistance such as plant care tips or home decoration advice through the camera on iOS and Android devices. On Windows, the AI can guide users through software features or analyze photos and webpages they’re viewing.
This update is part of a broader enhancement to Microsoft’s AI assistant, which now includes several new features:
- Memory and personalization: Copilot can remember user preferences and details to provide tailored responses
- Web-based actions: Similar to OpenAI’s Operator, Copilot can now complete tasks like booking tickets or making purchases
- Research capabilities: The AI can analyze multiple documents for complex projects and organize information across a single canvas
Microsoft clarifies that Copilot Vision differs from the Recall feature on Copilot Plus PCs. While Recall automatically captures snapshots when enabled, Vision functions more like screen sharing in a Microsoft Teams call.
The mobile version is available immediately, while Windows users will see the feature first in the Windows Insider program next week before a broader rollout.