Driven by AI: Intelligent Assistants Revolutionizing the In-Car Experience

For three decades, in-car voice recognition systems have aimed to simplify vehicle interaction, starting with Mercedes-Benz's Linguatronic in the 1996 S-Class, which offered a limited set of commands for its built-in cell phone. Despite this long history, the experience of interacting with cars through voice has largely remained frustrating and confusing, with systems often failing to respond as desired. Now, artificial intelligence (AI) is being heralded as the solution to these long-standing issues.

Andrew Hart, CEO at SBD Automotive, notes that "old-fashioned voice recognition in cars you pressed a button, you heard a beep, and it almost never worked." This led to a shift from rudimentary onboard voice recognition to cloud-based voice assistants such as Amazon Alexa, Apple's Siri, and Google Assistant. However, this transition introduced a "battle of the voice assistants," creating a different type of complexity for consumers, as observed by Hart.

The current generation of AI is intended to enhance vehicle understanding and improve user experience. Yet, initial testing of these AI voice assistants revealed significant limitations; for example, they often struggled to provide specific information even about the cars in which they were embedded. This underperformance led to their exclusion from recent MotorTrend Best Tech awards programs.

Automakers are discovering that integrating AI is far more complex than simply adding popular chatbots to infotainment systems. Hart explains that enabling AI voice recognition for deeper vehicle functions like opening windows or adjusting seat settings requires car companies to "unlock a lot of data access." Legacy automakers, known for their cautious approach to new technologies, are often reluctant to grant full access to their vehicle data and systems. Additional hurdles include managing a wide array of proprietary vehicle software platforms, navigating complex safety regulations, and facing uncertain returns on investment.

The next evolution of AI voice assistants promises to transform in-car dialogues, making them less frustrating and more effective. These advanced systems aim to allow for more conversational commands, control a broader range of vehicle functions, understand user routines to provide context-based assistance, and serve as a seamless link to the driver’s life outside the car. Brian Rhodes, director of Mobility Global's connected car and vehicle experience research team, highlights how a car could prioritize charger speed in an EV navigation command, even without explicit prompting, showcasing a significant leap in utility driven by "core vehicle context."

This technological shift forces automakers into a strategic decision: either develop their own AI voice assistants or, more likely, leverage third-party solutions. As Hart points out, "OEMs are not always capable of developing these types of experiences and pushing boundaries like tech companies." A prime example of such a third-party solution is Cerence's xUI technology, unveiled at CES 2026. This hybrid platform combines embedded and cloud-based large language models (LLMs), running on Nvidia AI Enterprise within Microsoft’s Azure cloud platform. Rhodes identifies Cerence as a "strongest agnostic incumbent," providing its next-gen xUI to multiple OEMs while allowing them to retain control over branding and data.