An 8B reasoning model trained via a single CoT-preserving SFT pass directly on Qwen3-8B, distilling multi-domain reasoning capability from frontier teacher models while keeping the base model’s native thinking capability intact. Atem-8B is designed for general reasoning tasks where structured, step-by-step thinking adds value: — Multi-step mathematical reasoning — Code explanation, implementation, and debugging — Analytical reasoning and argument evaluation — Scientific explanation requiring technical depth — Commonsense reasoning and physical intuition — Logic, fallacy identification, and conditional reasoning — Concept explanation across diverse domains Non-English reasoning traces (primarily CJK) The 34.3% filter rate reflects the same 6,144-token ceiling that filtered 32.7% of the Atem-4B corpus — the longest, most complex reasoning traces from competitive programming and advanced mathematics exceed this limit. Validation loss tracked above training loss for most of the run, indicating no overfitting. At step 150, val loss was…
Модальности:
Генерация текста
Области применения:
Логика и рассуждение Диалог / чат
Задача: Генерация текста
Автор: EphAsad
Теги: gguf, qwen3, unsloth, lora, reasoning, distillation, chain-of-thought, conversational
Лайков: 3 | Загрузок: 189
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
