Sarvam AI's Bold Bet: Open-Source Models Powering Everything from Phones to Cars

Indian AI lab Sarvam has unveiled a new generation of large language models (LLMs), signaling its strategy to capture market share from larger U.S. and Chinese rivals by developing smaller, efficient, open-source AI models. The announcement, made at the India AI Impact Summit in New Delhi, aligns with the Indian government's initiative to decrease reliance on foreign AI platforms and to develop models tailored for local languages and specific use cases.
The new lineup from Sarvam includes 30-billion and 105-billion parameter models, along with a text-to-speech model, a speech-to-text model, and a vision model for document parsing. These represent a significant enhancement compared to the company's previous 2-billion-parameter Sarvam 1 model, which was released in October 2024. The 30-billion and 105-billion parameter models leverage a mixture-of-experts (MoE) architecture. This design activates only a fraction of their total parameters at any given time, which substantially reduces computing costs. The 30B model supports a 32,000-token context window, ideal for real-time conversational applications, while the more substantial 105B model offers a 128,000-token window, enabling more complex, multi-step reasoning tasks.
Sarvam states that its new AI models were trained from scratch, rather than being fine-tuned on existing open-source systems. The 30B model underwent pre-training on approximately 16 trillion tokens of text, while the 105B model was trained on trillions of tokens encompassing multiple Indian languages. These models are engineered to support real-time applications, such as voice-based assistants and chat systems in various Indian languages. Sarvam's 30B model is positioned to compete with models like Google’s Gemma 27B and OpenAI’s GPT-OSS-20B, while its 105B model aims to contend with OpenAI’s GPT-OSS-120B and Alibaba’s Qwen-3-Next-80B.
The startup disclosed that the models were trained using computing resources provided under India’s government-backed IndiaAI Mission, with infrastructure support from data center operator Yotta and technical assistance from Nvidia. Sarvam executives expressed a commitment to a measured approach to scaling their models, prioritizing real-world applications over mere size. Sarvam plans to open-source both the 30B and 105B models, though details regarding the public release of training data or full training code were not specified. The company also intends to develop specialized AI systems, including coding-focused models and enterprise tools under
You may also like...
Manchester United Appoints Michael Carrick As Permanent Head Coach!
Michael Carrick has been appointed Manchester United's permanent head coach on a two-year contract, following a successf...
Breaking: Pep Guardiola Shocks Football World With Manchester City Departure!
After 10 seasons and 17 major trophies, including six Premier League titles, Pep Guardiola is set to depart Manchester C...
Bone-Crunching First Look: 'The Boys' Prequel 'Vought Rising' Trailer Reveals Bloody Origins!

The Vought Cinematic Universe expands with "Vought Rising," a new prequel series set in the 1950s that explores the orig...
Tom Hardy's Shocking Exit: Star Fired From Paramount+'s Guy Ritchie Thriller!

Tom Hardy is confirmed to be exiting the hit Paramount+ crime drama "Mobland" after its second season, reportedly due to...
Britney Spears' Shocking DUI Arrest: Details Emerge from Chaotic Scene

New details have emerged regarding Britney Spears' March arrest for suspected driving under the influence, revealing a c...
Jessie J's Emotional Victory: Singer Declared Cancer-Free After Year-Long Battle

Jessie J has announced she is cancer-free following a recent checkup, marking a triumphant end to her battle with breast...
Ebola Crisis Grips Congo-Kinshasa: Uganda Halts Flights Amid Hospital Violence

Uganda has implemented strict emergency measures, including flight and border transport suspensions, after confirming tw...
China's AI Grid Mapping: A Global Wake-Up Call for Energy Dominance!

As AI's electricity demands strain global grids, China has achieved a breakthrough with an AI-generated national invento...


