Languages
Languages big models miss
Every language here has millions of speakers and too little of the right data. Tamil is live; tell us which one you need next.
- தமிழ்Live
Tamil · 86M+ speakers
Spoken Tamil differs sharply from written Tamil, and dialects from Jaffna to Chennai barely appear online.
Visit Tamil → - සිංහලNext
Sinhala · 20M+ speakers
Written and spoken Sinhala are almost two different registers, and models trained on formal text sound stiff in conversation.
Join the waitlist → - پنجابی·ਪੰਜਾਬੀPlanned
Punjabi · 156M+ speakers
About 89M Punjabi speakers in Pakistan (2023 census) write in Shahmukhi, a Perso-Arabic script, but much of the language lives in speech, not text. Many speakers write online in Urdu or English instead.
Join the waitlist → - KiswahiliPlanned
Swahili · 97M+ speakers
Most of its speakers use it as a second language, and everyday speech mixes in English (Sheng in Nairobi), which formal web text misses.
Join the waitlist → - Harshen HausaPlanned
Hausa · 94M+ speakers
One of Africa's most spoken languages, yet with little web text, written in both Latin and Arabic (Ajami) script.
Join the waitlist → - አማርኛPlanned
Amharic · 60M+ speakers
Its own script (Ge'ez) and rich word forms get split into many pieces by tokenizers built for English.
Join the waitlist → - Basa JawaPlanned
Javanese · 68M+ speakers
Speech levels such as ngoko and krama change the words depending on who you are talking to, and many speakers write online in Indonesian instead.
Join the waitlist → - FulfuldePlanned
Fula · 39M+ speakers
Spoken across West and Central Africa and written in Latin, Arabic (Ajami) and its own Adlam script. Common Crawl's language detector does not even recognize it.
Join the waitlist → - Èdè YorùbáPlanned
Yoruba · 50M+ speakers
A tonal language where meaning rides on diacritics that most web text leaves out.
Join the waitlist → - भोजपुरीPlanned
Bhojpuri · 52M+ speakers
Mostly spoken, often written in Devanagari mixed with Hindi, and not recognized as a separate language by Common Crawl's language detector.
Join the waitlist → - Afaan OromooPlanned
Oromo · 45M+ speakers
45M+ native speakers, yet fewer than 1 in every 100,000 web pages is in Oromo.
Join the waitlist → - پښتوPlanned
Pashto · 55M+ speakers
Strong regional dialects and very little high-quality digital text.
Join the waitlist → - Asụsụ IgboPlanned
Igbo · 34M+ speakers
Tonal, with many dialects, and the little text online is often missing its tone marks.
Join the waitlist → - ភាសាខ្មែរPlanned
Khmer · 21M+ speakers
Written without spaces between words, so standard tokenizers and search struggle from the first step.
Join the waitlist → - Kreyòl ayisyenPlanned
Haitian Creole · 13M+ speakers
Spoken by nearly everyone in Haiti, while French dominates formal writing, so little text reflects how people talk.
Join the waitlist → - Runa SimiPlanned
Quechua · 7M+ speakers
A family of mostly oral varieties with little standardized text to learn from.
Join the waitlist →
Speaker counts: Ethnologue 2026 and Wikipedia. Web share: Common Crawl CC-MAIN-2026-39.
Early access
Build with Language Brain.
We are opening Language Brain to a small group of teams building agents for these languages, and to speakers who want to help.