Gemini's New Frontier: Google's AI Assistant to Make Calls for You

Google has introduced a new AI-powered feature called “Call for Me,” allowing its Gemini AI agent to make calls on behalf of users. This development places Google in line with other AI agents such as Meta’s Muse and Instinct, which also offer similar capabilities. Initially, “Call for Me” will be an experimental feature, rolling out exclusively to Pixel 11 owners in the U.S. who subscribe to Gemini and utilize the beta version of Google’s Phone app for Android.

While Google has a history of offering AI-guided calling features, “Call for Me” represents a significant advancement. Unlike prior versions with limited functionalities, this update enables Gemini to share personal information, with user approval, during calls, thereby allowing it to undertake a broader range of actions. Users will also have the ability to monitor the call in real-time via a live transcript and intervene at any point. The AI will make calls using the user’s personal phone number, dialed directly from their device.

The AI is designed to handle intricate tasks for users. For instance, it can contact a store to verify product availability, secure a restaurant reservation, reschedule appointments, or place items on hold. During these calls, Gemini can introduce itself to the business, navigate complex automated phone menus, endure waiting times on hold, and manage the entire conversation with the party on the other end. The live transcript ensures that users remain informed about the call's progression.

This launch is the culmination of several years of Google’s extensive experimentation with AI-assisted and automated calling technology. Notably, Google first captivated audiences at its I/O developer conference years ago with a demonstration of Google Assistant making a salon reservation, even incorporating natural-sounding conversational fillers like “umm’s” and “ahh’s.” More recently, the company rolled out “Ask for Me” last year, which allowed Gemini to call businesses for inquiries about pricing or services. Pixel smartphone users have also benefited from features like “Hold for Me” and “Talk to a Live Rep” to navigate phone trees and wait on hold, as well as “Direct My Call” for displaying numbers in IVR systems.

Google has stated its intention to commence this experiment on a small scale. This cautious approach is attributed to the inherent nuances of real-world conversations, underscoring the company’s need for sufficient time to refine the feature before a broader deployment.