Microsoft has introduced Copilot Vision, a feature that enables its AI-powered assistant to view and understand the context of your online activities in real-time. This update aims to provide users with enhanced verbal assistance, similar to an on-call assistant, while browsing the web.
Copilot Vision is now available in preview for Pro subscribers through Copilot Labs and can be accessed via the Microsoft Edge browser at the bottom of the page. The feature offers various benefits, including reading along with you, discussing issues you encounter while browsing, analyzing websites, and providing insights based on what it sees.
During a recent demo at a NYC Microsoft event, Copilot Vision demonstrated its assistance value by suggesting outfit inspiration from Pinterest and assisting users with holiday shopping by pointing out relevant products. The new experience is designed to collect feedback and will expand access to more users in the future.
For users concerned about privacy, Microsoft assures that Copilot Vision is entirely opt-in, giving users control over whether they want the assistant to view their browsing activity. Even if users choose to participate, all data shared with Copilot during the session is deleted.
Copilot Vision builds upon the existing Copilot Pro subscription, which costs $20 per month and includes additional perks such as priority access to the latest models and more access to Copilot Voice in select Microsoft 365 apps.
Source: https://www.zdnet.com/article/microsofts-copilot-can-now-see-what-you-see-in-real-time-and-speak-to-you-about-it