A supervised fine-tune of Moonfrost-777M, not a separate model. It starts from that base and trains for 0.42 epochs on instruction data. Architecture, tokenizer and parameter count are identical; only the weights differ. Two tunes of that base are published and both are usable; they differ in purpose rather than in kind. This one carries no identity data, so it claims no persona and holds no opinion about who built it, which makes it the neutral starting point for tuning your own behaviour on. Instruct-v2 is the one tuned for conversation: four times the exposure, plus the persona set. Read on before building from it. Half an epoch is not much instruction tuning and it shows, in two ways. It drifts between speakers: it had not seen enough complete conversations to learn reliably where an assistant turn ends, so it will sometimes write your next message for you, which is why both and have to be treated as stop tokens. And it has no identity, because the persona data was only added in v2. Asked who made it, this checkpoint answers that it is a retired professor of English named Jack Harris who has taught in the Midwest for about ten years, and then asks the question back. v2…
Модальности:
Генерация текста
Области применения:
Следование инструкциям Диалог / чат
Задача: Генерация текста
Автор: whoashish115
Теги: moonfrost, deepseek, mixture-of-experts, moe, multi-head-latent-attention, from-scratch, small-language-model, instruct
Лайков: 3 | Загрузок: 175
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
