Microsoft has introduced Copilot Vision, a new AI feature in its Edge browser that allows it to see what users see. This function, initially available for select websites including Wikipedia and Amazon, enables users to interact with the AI about their visual content without extensive explanations or copy-pasting.
The feature is not enabled by default but can be turned on with user consent. Microsoft’s head of AI, Mustafa Suleyman, views this development as “pretty exciting,” noting its potential for improved user experience.
Interestingly, Copilot Vision is not a first for other AI providers like Google, OpenAI, and Meta, which offer similar visual search capabilities. However, Microsoft has already made this feature available to Windows Insiders in the US, with plans to expand it globally.
While users can access Copilot Vision through the Edge browser’s glasses icon, its availability is limited to specific partners and regions, including Wikipedia and Amazon. As the technology continues to evolve, it remains to be seen how Microsoft will refine and deploy this feature further.
Source: https://www.heise.de/en/news/Microsoft-s-Copilot-now-sees-what-you-see-in-the-Edge-browser-10355101.html