Google Brings Computer Use Agent Capabilities to Gemini on macOS
Google introduces computer use capabilities to the Gemini desktop app on macOS, allowing the AI to navigate native apps and handle multi-step workflows.
Google has announced that it is bringing computer use capabilities to its Gemini desktop application on macOS, according to TechCrunch. The feature allows the artificial intelligence to complete tasks on behalf of users, navigating native Mac applications and browsing websites in the background.
As TechCrunch reports, Google is entering this space after competitors like OpenAI, Anthropic, and Meta have already offered similar agentic features in desktop applications. The rollout follows Google's broader release of in-app features like Tasks, which allows the AI to help users sign into websites, make online purchases, or book appointments. Additionally, the company recently began admitting early testers to try its revamped “CC” AI agent, which is designed to help families stay organized across email, calendars, chats, and tasks.
According to both TechCrunch and The Verge, computer use enables the AI to handle multi-step workflows involving local files, desktop apps, and the web. Google suggests the functionality can assist with repetitive tasks, filling out forms, creating presentations, organizing files, and listing items for sale. The company also notes the tool can help with tasks like organizing files into folders based on specific criteria or creating slideshows from files or information in online dashboards.
The Verge notes that users will be able to decide which applications Gemini can access. Furthermore, users can monitor the agent's progress through a live preview displayed directly inside the chat interface while keeping their own screen and cursor free to perform other work, as reported by TechCrunch.
Safety controls allow users to pause, stop, and approve actions before the AI executes them. According to TechCrunch, the feature is initially available in English for users in the United States and requires the Gemini app for Mac alongside a Google AI Plus, Pro, or Ultra subscription.
The Verge points out that this launch coincides with upcoming changes from Apple, which is introducing new restrictions for applications requesting full disk access on Mac due to potential security risks posed by AI agents. A preview of these settings recently appeared in the macOS 27.3 beta.
Sources
- 01 Google gives Gemini the ability to use your Mac for you — TechCrunch — AI
- 02 Gemini on Mac can now use your computer — The Verge — AI