Microsoft is releasing an update to its Copilot Vision tool, allowing Windows Insiders to access their entire desktop screen. The feature, previously limited to two apps at a time, can now scan the whole desktop or specific browser or app windows.
Unlike other screen-scanning tools like Recall, which takes automatic snapshots of the screen, Copilot Vision uses a screen-sharing approach. Users activate the feature by clicking on the glasses icon in the Copilot app and select the desktop to view.
Copilot Vision aims to provide insights, answer questions, and coach users through tasks aloud. It can help with creative projects, resume improvement, or navigating new games. The tool was initially tested last year as a web-browsing feature in Edge and also answers questions about what’s seen through mobile phone cameras.
Source: https://www.theverge.com/news/707995/microsoft-copilot-vision-ai-windows-scan-screen-desktop