“This saves you time on the repetitive work that normally takes dozens of clicks,” Michael Friedman, group product manager, Gemini App, said in the post. “Just describe what you need, and Gemini handles the clicking, typing, menus and forms for you.”
The Gemini artificial intelligence app works in an isolated background window, leaving the main screen and cursor free so the user can continue working on the computer, according to the post.
The user chooses which apps Gemini can access, can watch every step live and pause Gemini at any time, and approves key actions before they happen, the post said.
Potential applications of the Gemini app’s new capabilities on Mac include speeding up creative workflows, filling out forms, turning live data into a presentation in Google Slides and preparing listings for resale sites, per the post.
This computer use in the Gemini app for Mac is rolling out in English in the United States. It requires an Apple Silicon Mac running macOS Sequoia 15.0 or later, an 18-plus personal Google account and a Google AI Plus, Pro or Ultra subscription, according to the post.
The PYMNTS Intelligence report “The New AI Handshake: Data Shows When Consumers Want Help and When They Want Control,” published in May, found that consumers using the Apple desktop operating system, macOS, are active AI users.
Sixty percent of macOS users are either power users or mainstream users of AI, compared to 52% of iOS users, 46% of Windows users and 40% of Android users, according to the report.
“For Google and Apple, the data creates a split strategic picture,” the report said. “Google has a stronger built-in surface for proactive AI through Android, but Android also contains a larger pocket of non-users to convert. Apple has a more AI-engaged user base, but its natively proactive AI experience has not matched Google’s reach.”
That gap explains why the users of Apple’s mobile operating system, iOS, lean toward a dedicated AI brand, ChatGPT, rather than the iPhone’s native assistant, per the report.