August 2026
|
7 min read

Akshara: State-of-the-Art Speech Recognition for Indic Languages

A speech-to-text model that sets a new state of the art across Indian languages — engineered from the ground up for the acoustic realities of real-world telephony, not adapted from generic multilingual models.

Pavan Taddi
Speech-To-Text ASR Indic Languages

General-purpose ASR models have reached impressive milestones on clean, long-form dictation. But when deployed in live, cascaded voice AI systems — where users speak over compressed, lossy cellular networks from noisy environments — these generic models fail. They suffer from semantic hallucination, high latency, and catastrophic degradation on the short, contextless utterances that define real B2C calls.

Akshara fundamentally rethinks the acoustic and linguistic modeling pipeline for Indian languages. It is not a fine-tuned Whisper derivative or a multilingual wrapper. It is a ground-up architecture engineered for the hostile realities of enterprise telephony — and it delivers state-of-the-art accuracy across nine Indic languages, as the benchmarks below show.

Automatic Language Detection

Akshara identifies the spoken language on its own — no configuration required. Pass no hint and it auto-detects the language directly from the audio. Pass a single code like hi and it transcribes purely in that language. Pass several like hi en and it transcribes the code-mixed speech natively, keeping every word in its own script.

The same code-mixed utterance is fed to Akshara three times below — only the language hint changes.

Keyword Boosting for Domain Vocabulary

Every industry speaks its own language. Drug names, product SKUs, legal clauses, and internal jargon rarely appear in general training data, so even strong models stumble on them. With Akshara you can pass a list of keywords at inference time — the model biases decoding toward those terms and locks onto them, adapting to a new domain in seconds with no retraining or fine-tuning.

A hospital deploys Akshara to transcribe clinical notes. Complex drug names and conditions trip up any general model — so the care team supplies them as domain vocabulary.
Keyword Boosting · Live Demo
Model: Akshara
Domain vocabulary — keywords passed at inference
Transcription
Ready

Misrecognized Boosted keyword

The same mechanism generalizes to any vertical — banking, insurance, logistics, or e-commerce. By simply supplying the terms that matter, teams tailor Akshara to their domain on the fly, making it a practical drop-in engine for specialized, real-world deployments.

Akshara Multilingual Benchmark Suite

Comprehensive WER, CER, intent, and entity evaluation against leading ASR systems across five public and proprietary datasets. Bold values indicate the best performance using the current VSI benchmark inputs.

Benchmark Description Metric Akshara Pro Saaras V3 Scribe V2 Deepgram Nova 3
IndicVoices A large multilingual Indian speech corpus
WER
(Lower is better)
10.76% 17.69% 18.07% 37.47%
CER
(Lower is better)
7.02% 12.87% 12.19% 29.48%
Intent Accuracy
(Higher is better)
95.62% 95.91% 91.82% 72.85%
Entity Mean
(Higher is better)
92.89% 93.38% 92.57% 71.36%
Kathbath An AI4Bharat human-labeled ASR benchmark dataset
WER
(Lower is better)
12.94% 11.65% 13.87% 34.72%
CER
(Lower is better)
8.19% 8.53% 10.40% 24.40%
Intent Accuracy
(Higher is better)
94.68% 97.47% 98.23% 81.01%
Entity Mean
(Higher is better)
91.83% 97.45% 97.43% 81.09%
NoBroker Internal Telephonic Dataset
WER
(Lower is better)
27.82% 32.83% 40.74% 79.77%
CER
(Lower is better)
17.64% 21.46% 24.86% 53.03%
Intent Accuracy
(Higher is better)
80.56% 83.00% 75.33% 35.56%
Entity Mean
(Higher is better)
80.65% 82.94% 75.65% 42.26%
Svarah An English ASR benchmark focused on Indian accents and dialectal diversity
WER
(Lower is better)
9.38% 7.35% 11.42% 7.52%
CER
(Lower is better)
5.58% 4.51% 6.74% 4.06%
Intent Accuracy
(Higher is better)
95.00% 98.00% 92.00% 93.00%
Entity Mean
(Higher is better)
90.32% 98.51% 91.04% 89.50%
VAANI A large-scale multilingual Indian speech dataset from IISc + ARTPARK
WER
(Lower is better)
13.44% 13.04% 23.03% 25.03%
CER
(Lower is better)
8.16% 7.84% 14.24% 16.83%
Intent Accuracy
(Higher is better)
93.72% 96.86% 96.07% 90.58%
Entity Mean
(Higher is better)
91.10% 95.85% 94.58% 86.67%

Language-Specific Breakdown

Overall Word Error Rate per language, macro-averaged across available rows from IndicVoices, Kathbath, NoBroker, and VAANI. English uses NoBroker and VAANI; Svarah is excluded from this cross-dataset view. Lower is better.

Language Akshara Pro Saaras V3 Scribe V2 Deepgram Nova 3
Bengali 16.06% 19.21% 25.37% 43.90%
English 17.61% 20.13% 21.34% 20.97%
Gujarati 17.37% 19.96% 29.73% 45.58%
Hindi 11.14% 14.67% 14.27% 15.95%
Kannada 20.38% 23.02% 32.87% 51.91%
Malayalam 21.19% 24.64% 28.40% 98.67%
Marathi 16.28% 17.60% 19.27% 39.03%
Tamil 16.57% 20.81% 22.50% 47.97%
Telugu 17.16% 20.23% 26.55% 47.70%
Model family

Two Akshara Variants, Tuned for Different Production Priorities

The Akshara family is available in two production variants. Akshara Pro prioritizes maximum transcription accuracy, while Akshara uses a lighter decoding configuration for latency-sensitive voice applications. The benchmark tables above report Akshara Pro; the comparison below shows the latency range for each variant.

Accuracy-first

Akshara Pro

Maximum accuracy

The accuracy-optimized decoding variant for workflows where transcription quality takes precedence over the lowest possible response time.

latency
70–80 ms

Best suited to accuracy-critical transcription, analytics, and post-call processing.

Latency-first

Akshara

Real-time

A lighter, faster variant designed for responsive voice agents and other real-time conversational systems where fast turn-taking is critical.

latency
40–60 ms

Best suited to live voice agents, streaming interactions, and latency-sensitive automation.

Akshara delivers 40–60 ms latency, compared with 70–80 ms for Akshara Pro—about 33% lower latency at the midpoint. This latency optimization comes with a 2.30 percentage-point increase in overall WER.

Midpoint comparison: 50 ms vs. 75 ms, equivalent to completing transcription in roughly two-thirds of the time. Exact latency varies with hardware, concurrency, and audio characteristics.

End-to-End Transcription Latency

In cascaded voice AI, every millisecond counts. Latency is measured as the time from the end of a user utterance to the first byte of transcription output returned over the wire — under real telephony network conditions. Lower is better.

Akshara operates at 40–60 ms, while Akshara Pro operates at 70–80 ms. They are the two lowest-latency models in this comparison, with Akshara reducing midpoint latency by approximately 33% relative to Akshara Pro.

ConvoZen · Akshara · Benchmark Report · 2026

WER and CER are lower-is-better metrics. Intent Accuracy and Entity Mean are higher-is-better, scored via LLM judge. LLM evaluation methodology adapted from Sarvam AI's open-source framework and informed by Google Research on meaning preservation in ASR.

© 2026 ConvoZen Research. All rights reserved.