This is Qwen-QwQ-32B with our bug fixes. See our collection for versions of QwQ-32B with our bug fixes including GGUF & 4-bit formats. Unsloth’s QwQ-32B Dynamic Quants is selectively quantized, greatly improving accuracy over standard 4-bit. Finetune your own Reasoning model like R1 with Unsloth! We have a free Google Colab notebook for turning Qwen2.5 (3B) into a reasoning model: https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen2.5_(3B)-GRPO.ipynb All notebooks are beginner friendly! Add your dataset, click «Run All», and you’ll get a 2x faster finetuned model which can be exported to GGUF, vLLM or uploaded to Hugging Face. — This Llama 3.2 conversational notebook-Conversational.ipynb) is useful for ShareGPT ChatML / Vicuna templates. — This text completion notebook-TextCompletion.ipynb) is for raw text. This DPO notebook replicates Zephyr. — Kaggle has 2x T4s, but we use 1. Due to overhead, 1x T4 is 5x faster. QwQ is the reasoning model of the Qwen series. Compared with conventional instruction-tuned models, QwQ, which is capable of thinking and reasoning, can achieve significantly enhanced performance in downstream tasks, especially…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: unsloth
Теги: qwen2, chat, qwen, conversational, en, 4-bit, bitsandbytes
Лайков: 4 | Загрузок: 1,508
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
