News

NVIDIA and IIT Madras outline a 2.8 trillion-token Indic corpus

NVIDIA and IIT Madras describe a large Indic corpus, its language coverage, and the workflows used to generate and trace the data.
Oct 18, 2026路3 min read
NVIDIA and IIT Madras outline a 2.8 trillion-token Indic corpus

#

Key takeaways

  • NVIDIA and IIT Madras's AI4Bharat team described Nemotron-pretraining-Indic-v1 in an October 16 Hugging Face article.
  • The corpus is described as approximately 2.8 trillion tokens across 22 Indian languages.
  • It includes native-script material for all 22 languages and romanized material for twelve.
  • The source says the resource is releasing soon, so it should not be treated as already downloadable.
  • The article also describes traceability, translation workflows, and benchmark results from a later training stage.

What the article says

NVIDIA and IIT Madras's AI4Bharat team described Nemotron-pretraining-Indic-v1 in an October 16 article on Hugging Face. The source presents it as a large Indic corpus intended for release alongside an open, GPU-accelerated data generation pipeline. It says the corpus contains approximately 2.8 trillion tokens across 22 Indian languages.

The article also says the corpus includes native-script material for all 22 languages. In addition, it includes romanized material for twelve languages. That creates 34 language-script configurations in total. The source frames this as part of the corpus design, not as a separate product.

The material is generated from curated English documents. The source names mathematics, code, question-answer material, and other topics among those documents. It also says records retain source identifiers. That means outputs can be traced back to the input documents.

How the workflows are described

The article describes one workflow for twelve languages. In that workflow, whole documents are translated with Gemma-4-31B-it. The outputs are then assessed against the source. Low-scoring translations are repaired. The team retains outputs that score at least 75 on its rubric.

That 75 figure is a quality threshold. It is not presented as a measured accuracy rate. The distinction matters because the source does not claim that every retained output is 75% accurate. It only says the workflow uses that score as a cutoff.

A separate workflow handles ten languages with Indic Translate and separate script treatment. The source does not provide more detail on the exact division of labor between the two workflows. It does, however, make clear that the corpus uses more than one generation path.

What the training results show

The article reports that continued pretraining of Nemotron 3.5 Super VL used 10 billion Indic tokens within a 100 billion-token training stage. It also says scores increased on five reported Indic benchmarks. The source does not attribute those gains to the corpus alone.

That caution is important. The training stage mixed synthetic and naturally authored text. Because of that mix, the benchmark improvement cannot be linked only to Nemotron-pretraining-Indic-v1. The source also says naturally authored Indic material remains important for cultural context.

Governance and operational notes

The source highlights traceability through source identifiers. That is an operational control, because it helps connect generated outputs to their inputs. The article also shows a quality gate through the 75-point rubric threshold. Together, those details suggest a workflow that emphasizes review and provenance.

The source also uses careful language about release timing. It says the resource is releasing soon. So the corpus should not be described as already downloadable unless that is independently verified. That is a useful editorial and operational constraint for anyone summarizing the project.

Morocco relevance

The source reports no Morocco-specific fact. The global lesson is conditional: when a corpus spans many languages, traceability and clear quality thresholds help readers judge how the data was built.

Bottom line

This article describes a large Indic corpus, its language coverage, and the generation methods behind it. It also separates corpus description from downstream training results. That separation is useful, because it keeps the data resource, the workflow, and the benchmark outcomes distinct.

Follow us on Google

Add Intelligence Artificielle Maroc as a preferred source to see more of our relevant stories in Google Search.

Add us as a preferred source
AI platform development

What would you like to build?

We build custom AI platforms, SaaS products, intelligent business applications, and automation systems.

This form is for project inquiries, not general questions about artificial intelligence.

Name *
Work email *
Organization (optional)
Solution *
Short project description *

Related Articles

featured
J
Jawad
路Oct 18, 2026

Anthropic study links AI agent use to fewer junior technical hires

featured
J
Jawad
路Oct 18, 2026

AWS outlines a nine-stage evaluation framework for AI agents

featured
J
Jawad
路Oct 18, 2026

China proposes draft export controls on AI technologies

featured
J
Jawad
路Oct 18, 2026

Google adds three study tools to Gemini Notebook