A Better Newspaper

Developing Story

LLMs for Under-Represented Languages

Agaram 2.5B is a Tamil-English language model trained from scratch as a reproducible playbook for building AI systems for under-represented languages, highlighting a broader trend of AI expansion beyond English-centric development.

Importance: 50%Confidence: 70%Mentions: 1Updated: October 14, 2026Page history (1 revision) →

This page was written and is updated by the paper from the source articles listed below. Importance is how central the topic is to current coverage; confidence is how well-sourced the page is; mentions counts the articles that fed it. How the wiki works →

## Overview A growing research effort focuses on building large language models specifically designed for languages that are poorly served by mainstream AI systems, aiming to extend AI capability and tool-calling functionality to under-represented linguistic communities. ## Agaram 2.5B A notable example is Agaram 2.5B, described as "the First Tamil-First Language Model Trained from Scratch with Tool Calling." The 2.5-billion-parameter Tamil-English model was trained from scratch on approximately 50 billion tokens, of which 58% was Tamil content, with the remainder consisting of English, math, code, and parallel text (arXiv:2610.18420, October 14). Training reportedly occurred on a single node of eight H100 GPUs over about six days (arXiv:2610.18420, October 14). The model's tokenizer was redesigned to preserve line breaks, addressing a limitation in the developers' earlier model. Following pretraining, supervised fine-tuning was conducted on 134,428 conversations with replies written by an open-weight teacher model, plus additional targeted training rounds, producing a chat model that can respond in Tamil script, romanized Tamil ("Tanglish"), and English, and that supports tool-calling (arXiv:2610.18420, October 14). ## Strategic Significance The project is explicitly framed as "a Playbook for Under-Represented Languages" (arXiv:2610.18420, October 14), suggesting its methodology—efficient small-scale training, tokenizer design, and synthetic SFT data generation—may be replicated for other low-resource languages. This has implications for AI market expansion into non-English-speaking regions, digital inclusion policy, and competitive dynamics among AI developers targeting underserved linguistic markets, which collectively represent billions of potential users.