Nemotron-Personas-India: Synthesized Data for Sovereign AI

Summary

Most open artificial intelligence datasets reflect Western norms and English-only contexts, limiting model effectiveness across India's multilingual and multi-script landscape. To address this shortage of culturally grounded training data, NVIDIA released Nemotron-Personas-India under a CC BY 4.0 license. The synthetic dataset contains 21 million personas across 3 million records spanning 7.7 billion tokens in English, Devanagari Hindi, and Latin-script Hindi. The generation pipeline utilized NeMo Data Designer, an Apache-2.0 licensed Probabilistic Graphical Model for demographic grounding against 2011 Census distributions, and GPT-OSS-120B for narrative text. All records are entirely synthetic to eliminate re-identification risks while enabling fine-tuning for region-aware AI agents and domain-specific copilots.

Takeaways

1. 1

   Nemotron-Personas-India contains 21 million total synthetic personas across 3 million records and 7.7 billion tokens, licensed under CC BY 4.0.

2. 2

   The dataset covers English, Hindi in Devanagari script (4.7B tokens), and Hindi in Latin script (2B tokens) across all 36 Indian states and 640 districts.

3. 3

   The pipeline relies on a Probabilistic Graphical Model for demographic statistical alignment and GPT-OSS-120B for synthetic narrative generation without real personal data.