Microsoft has made a significant move in the AI sector by introducing its “computer use” feature in Copilot Studio, allowing AI agents to automate tasks without built-in integrations or APIs. This new tool aims to make AI agents appear more like real users, enabling them to click, choose, and type information just like humans do.
The company’s senior leader, Charles Lamanna, explained that this feature allows agents to handle tasks even when there is no direct connection to the system API. With Copilot Studio, businesses can create AI agents capable of filling reports, logging into websites, and handling customer service tasks.
This update enhances Microsoft’s efforts to make AI agents smarter and more reliable in automating real-world tasks. The feature allows AI agents to adapt to changing interfaces, leading to more dependable automation. This is particularly useful for tasks such as processing invoices, performing market research, or entering data across websites.
The “computer use” feature builds upon a similar tool introduced by Microsoft earlier called Actions. While Action is geared towards personal use, Copilot Studio’s computer use feature seems to be designed for business-level automation.
Source: https://wccftech.com/microsofts-new-computer-use-feature-empowers-ai-agents-to-seamlessly-navigate-and-interact-with-websites-and-apps