The model «Good Robot» had one simple goal in mind: to be a good instruction-following model that doesn’t talk like ChatGPT. Built upon the Mistral 7b 0.2 base, this model aims to provide responses that are as human-like as possible, thanks to some DPO training using the (for now, private) minerva-ai/yes-robots-dpo dataset. HuggingFaceH4/no-robots was used as the base for generating a custom dataset to create DPO pairs. It should follow instructions and be generally as smart as a typical Mistral model — just not as soulless and full of GPT slop. Changes from the original good-robot model: — Mistral 7b-0.2 base (32k native context, no SWA) — ChatML prompt format — Trained using GaLore method — HuggingFaceH4/no_robots — MinervaAI/yes-robots-dpo — private datasets with common GPTisms While I did my best to minimize GPTisms, no model is perfect, and there may still be instances where the generated content has GPT’s common phrases — I have a suspicion that’s due to them being engrained into Mistral model itself.
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: kubernetes-bad
Теги: mistral, conversational, en, text-generation-inference, endpoints_compatible
Лайков: 3 | Загрузок: 23
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
