> The final «Experimental» Inferno release: Inferno-Exp-1.7 marks the end of the experimental Inferno series of models. The next generation of models is coming soon. Stay tuned. Inferno-Exp-1.7 is AlgoDriveAI’s 393.6M-parameter, math-first decoder-only base language model. This release publishes the selected 32indx.pt snapshot at continuation step 275,000, with 4,096-token context and 85.70% ArithMark 3.0 normalized accuracy**. It continues the Deep400M training line represented by Inferno-Exp-1.6. It is a base text-completion model; it has no chat template or instruction tuning. Parameter accounting: 32,833,536 tied token-embedding parameters + 360,775,680 parameters across 32 transformer blocks + 1,024 final normalization parameters = 393,610,240. The LM head is not counted twice. The ArithMark result was verified during this export. The four language scores are the full-set training evaluations recorded at the same step, 275,000. They are not a new post-export harness run. The previous release reports language evaluation batch size 16; the training evaluations here use 8. Using these rounded scores and the training script’s Open SLM Intelligence Index formula gives 32.02. This…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: AlgoDriveAI
Теги: inferno, small-language-model, gqa, custom_code, arithmark, en, model-index
Лайков: 3 | Загрузок: 754
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
