Param-1-5B is a bilingual (English–Hindi) large language model developed under the Param-1 family. With 5 billion parameters, this model extends the capabilities of Param-1-2.9B by incorporating enhanced mathematical reasoning and code understanding/generation. The model is pretrained from scratch and designed to serve as a strong foundation for downstream tasks such as mathematical problem solving, and code-related understanding / generation. The model is pretrained on a large-scale bilingual corpus with a strong focus on English and Hindi, along with dedicated Math and Code data. — English Natural Language: 3.6T — Hindi Natural Language: 2.77T — Math & Code: 238.4B — Math: 40% — Code: 60% Compared to Param-1-2.9B, Param-1-5B includes: — A larger overall training corpus — Explicit inclusion of Math and Code datasets — Improved performance in mathematical and code understanding/generation — Continued emphasis on English–Hindi bilingual capability This is a pretrained base model and may require fine-tuning for instruction-following or chat use cases. The model may reflect biases present in large-scale web and code data. * Performance on low-resource Hindi domains may vary…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: bharatgenai
Теги: parambharatgen, bharatgen, bilingual, hindi, english, causal-lm, conversational, custom_code
Лайков: 3 | Загрузок: 1,350
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
