Microsoft’s Copilot Vision, the AI assistant that understands your screen, has launched in the U.S.,transforming how users interact with their Windows devices. This innovative feature analyzes screen content and offers instant assistance and suggestions, acting as a powerful digital companion.Copilot Vision, accessed via the Copilot app, navigates multiple windows and uses a Highlights feature for tasks like gaming, photo viewing, and display settings adjustments. While Microsoft emphasizes user control and data privacy,potential security risks remain a key consideration. Stay informed with News Directory 3 on emerging privacy concerns. As the company plans expansion beyond Europe, users shoudl stay aware. Discover what’s next as Microsoft refines AI capabilities.
Microsoft’s Copilot vision: AI Assistant now Watching Your Screen
Microsoft has rolled out Copilot Vision in the U.S., with plans for further expansion beyond Europe.This feature enhances Copilot’s role as a digital companion, offering assistance with everyday computer tasks by analyzing screen content.
According to Microsoft, Copilot Vision, accessible through the Copilot app, can navigate multiple submission windows.Users can ask the AI for help or suggestions, and it will respond accordingly. The system also includes a “Highlights” feature, providing step-by-step guidance for tasks such as gaming, photo viewing, and adjusting display settings.
Copilot Vision can also converse with users in real-time using a synthetic voice.
Microsoft maintains that Copilot improves the user experience by embedding large language models into windows. The company began testing Copilot Vision earlier this year. It is now available on Windows 10 and 11 through the Copilot Labs program, without requiring a Copilot Pro subscription.
Microsoft says users retain control over the app-sharing option and can prevent the AI from accessing personal data.
While Copilot Vision does not capture screenshots like the Recall feature, any tool that monitors screen activity and processes sensitive data raises security concerns. Given Microsoft’s recent history of addressing security vulnerabilities, users are advised to exercise caution.
What’s next
Microsoft plans to expand Copilot vision to more countries outside of Europe. The company will likely continue to refine the AI’s capabilities and address any emerging security or privacy issues.
