DripGhad1223/Qwen3-4B-Kimi2.5-Reasoning-Distilled-GGUF - Каталог нейросетей
Генерация текста

DripGhad1223/Qwen3-4B-Kimi2.5-Reasoning-Distilled-GGUF

Добавлено:
DripGhad1223/Qwen3-4B-Kimi2.5-Reasoning-Distilled-GGUF

Qwen3-4B-Kimi2.5-Reasoning-Distilled is a fine-tuned language model optimized for structured, long-form reasoning. It is derived from the Qwen3-4b-Thinking-2507 base model and fine-tuned using a specialized distillation dataset generated by Kimi-2.5-thinking. This model is designed to bridge the gap between small, efficient models (0.6B–4B range) and the complex reasoning capabilities typically found in much larger models. It excels at breaking down problems, self-correcting, and providing detailed analytical answers. Base Model: Qwen3-4b-Thinking-2507 Training Technique: Unsloth + QLoRa — qwen3-4b-thinking-2507.BF16.gguf — qwen3-4b-thinking-2507.Q80.gguf — qwen3-4b-thinking-2507.Q6K.gguf — qwen3-4b-thinking-2507.Q4KM.gguf (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better): And here are Artefact2’s thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 The model was fine-tuned on the khazarai/kimi-2.5-high-reasoning-250x Dataset Composition: — Total Samples: 250 — Total Tokens: 1,114,407 — Teacher…

Модальности:
Генерация текста

Области применения:
Логика и рассуждение Диалог / чат


Задача: Генерация текста
Автор: DripGhad1223
Теги: gguf, qwen3, llama.cpp, unsloth, reasoning, distillation, sft, en
Лайков: 4  |  Загрузок: 463

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.