Microsoft has added a new tool to its Copilot Studio platform, enabling AI agents to interact with websites and desktop apps like humans do. The Computer Use feature allows agents to click buttons, choose menu items, and type into fields on the screen.
The tool’s developer, Charles Lamanna, stated, “If a person can use the app, the agent can too.” This innovation enables businesses to automate various tasks, such as data entry, market research, and invoice processing. The AI-powered tool can also detect changes in apps and websites, ensuring continuous workflow without interruptions.
This feature is distinct from Microsoft’s consumer Copilot Actions tool, which is limited to certain partners. The new Computer Use tool will work with more websites and apps, allowing businesses to automate repetitive tasks across both modern and legacy applications.
All operations are conducted on Microsoft-hosted infrastructure, maintaining enterprise data within the company’s Cloud boundaries. The feature is currently available as an early access research preview for select Copilot Studio users.
Source: https://www.extremetech.com/computing/microsofts-copilot-studio-now-lets-ai-handle-tasks-on-any-app-or-website