This model has better IFEval scores than our previous model Notbad v1.0 Mistral 24B. Notbad v1.1 Mistral 24B is a reasoning model trained in math and Python coding. This model is built upon the Mistral-Small-24B-Instruct-2501. and has been further trained with reinforcement learning on math and coding. One of the key features of Notbad v1.0 is its ability to produce shorter and cleaner reasoning outputs. We used open datasets and employed reinforcement learning techniques developed continuing from our work on Quiet Star, and are similar to Dr. GRPO. The reasoning capabilities in this model are from self-improvement and not distilled from any other model. It is the result of a fine-tuning from data sampled from multiple of our RL models starting with the Mistral-Small-24B-Instruct-2501. Special thanks to Lambda and Deep Infra for providing help with compute resources for our research and training this model. — Benchmarks are from Mistral-Small-24B-Instruct-2501 Model Card
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: notbadai
Теги: mistral, conversational, text-generation-inference, endpoints_compatible
Лайков: 4 | Загрузок: 9
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.