Addaly is in open beta. Things will change, and AI answers can be wrong — check anything that matters.

Making Things With AI

Images, video, voice and music — how they work, where they break, who owns them.

Lesson 53 of 848 min

The languages it does badly, and who that is

The unevenness, stated plainly

English has thousands of hours of clean, transcribed, permissively available speech. So do a handful of others — Mandarin, Spanish, French, German, Japanese. Below that, availability falls off a cliff.

There are roughly seven thousand living languages. Fewer than a hundred have speech systems anyone would call good. Several hundred million people speak languages with no usable speech recognition at all.

Within a well-served language, the same unevenness repeats across accents. Recognition error rates for a language's prestige accent and for a regional or second-language accent of the same language routinely differ by a factor of two or three. Published audits have found large disparities in commercial systems between speakers of different varieties of English, in the same recording conditions, saying the same things.

Word error rate on the same passage, the same microphoneRead English, prestigeaccent5Read English, regionalaccent11Read English,second-language accent16Spontaneous conversation,telephone quality27A language with a fewhundred hours of audio48% of words transcribed wronglyThe figure a vendor quotes is the first bar. The material people actually have is the fourth. The gapis the training distribution rather than the speaker, and it falls on exactly the people least able toroute around it.
Word error rate on the same passage, thesame microphoneRead English, prestige accent5Read English, regional accent11Read English, second-language accent16Spontaneous conversation, telephone quality27A language with a few hundred hours of audio48% of words transcribed wronglyThe figure a vendor quotes is the first bar. Thematerial people actually have is the fourth. The gapis the training distribution rather than thespeaker, and it falls on exactly the people leastable to route around it.

This is not a design choice. It is the training distribution, exactly as the caption corpus was for images. But the consequence is not aesthetic here — it is a person being unable to use a voice interface, an automatic transcript of their evidence being wrong, or a subtitle system garbling their name.

What breaks specifically

Code-switching. Speakers of many languages mix in English or another language mid-sentence as a matter of ordinary speech. Most systems are built around one language per utterance and handle a switch by mangling both sides of it. Hinglish, Taglish, Spanglish and dozens of comparable everyday registers are, from the system's point of view, an error condition.

Names. Personal and place names outside the training distribution are transcribed phonetically and wrongly, which is a small daily indignity and occasionally a serious problem in medical or legal transcription.

Tone and length distinctions that English does not make are frequently flattened by both recognition and synthesis, changing meaning rather than merely accent.

Scripts with ambiguous vowel marking — Arabic, Hebrew, and abjads generally — require the system to infer pronunciation that the text does not carry. Diacritics resolve it and are usually absent in ordinary writing.

What is being done, and what you can do

The serious work here is community-driven and worth knowing about because you can join it.

Open, community-collected speech corpora exist that anyone can contribute to by reading sentences aloud, and anyone can use to train. Several languages have crossed the threshold from unusable to usable purely on this basis, contributed by their own speakers.

The practical routes if your language is poorly served:

  • Fine-tune an open recognition model on a few hours of your language or accent. This is genuinely achievable — free notebook time is enough — and the improvement on a specific accent from even a small, well-matched set is substantial.
  • Use a language-specific model rather than a multilingual one where it exists. The multilingual giants are convenient and frequently worse than a small model trained on one language.
  • Contribute recordings to an open corpus. This is slow, collective and the only thing that fixes it durably.
  • Check the numbers before you promise anything. Published error rates are usually reported on clean read speech in the best-served accent. Test on your own audio before building a product on it.

Why to be sceptical of "supports 100 languages"

That claim is now standard and it means very little. Support ranges from "trained on thousands of hours" to "trained on a few hundred, mostly religious texts read aloud". The word covers both.

The question that separates them: what is the measured error rate on this language, on spontaneous conversational speech, in ordinary recording conditions? Vendors that have the number will give it. Vendors that quote a single headline figure across all languages are quoting the best one.

The unresolved part, and it is worth naming as unresolved: nobody has a route to good coverage of the long tail that does not depend on the speakers of those languages doing the data collection themselves, largely unpaid. That is a real problem of fairness with no agreed answer, and the current arrangement — that the world's least-served speakers must volunteer to build their own tools — is defended by some as community ownership and criticised by others as free labour. Both readings are available and both are honest.

The one thing to keep

Speech systems inherit the distribution of their training audio, so quality varies by orders of magnitude across languages and accents, and the gap falls on exactly the people least able to route around it.

Before you move on

A vendor advertises support for 100 languages. Which question most usefully tests the claim?

Pick the one you would defend. Nobody sees your answer.

No ads. No data sale. No public scores on people. Ever.

© 2026 Addaly