NVIDIA and IIT Madras's AI4Bharat lab announced Nemotron-pretraining-Indic-v1, a pretraining corpus of approximately 2.8 trillion tokens spanning 22 Indian languages. The release includes an open, GPU-accelerated data generation pipeline built with NeMo Data Designer. The corpus contains 2,601.0 billion native-script tokens and 224.6 billion romanized tokens, with romanization covering twelve languages. Every record traces to a curated source document. Continued pretraining for Nemotron 3.5 Super VL used 10 billion Indic tokens from the corpus.
No score is assigned. Sources and their independence are shown in the citation chain below.