> This is the Arabic version of QwQ 32B Preview, specifically fine-tuned for Arabic reasoning tasks, with a primary focus on math. It is trained on a dataset featuring questions, step-by-step solutions, and detailed chains of thought, guiding users to arrive at the correct answers effectively. Arabic-QwQ-32B-Preview is fine-tuned for Arabic reasoning tasks using the Unsloth and the newly intorduced ArabicReasoningDataset. We fine-tuned a pre-trained language model to improve its reasoning capabilities on Arabic datasets. The model leverages advanced techniques like LoRA (Low-Rank Adaptation) for parameter-efficient fine-tuning. ⏺ 4-bit Quantization: Reduces memory usage and speeds up training. ⏺ Gradient Checkpointing: Saves VRAM and supports long contexts. ⏺ Evaluation Strategy: Regular checkpoints and validation to monitor performance. 🔹 Training Source: Omartificial-Intelligence-Space/ArabicReasoningDataset with 10,000 samples. 🔹 Description: Contains instruction-answer pairs for reasoning tasks in Arabic. 🔹 Validation Source: MohammedNasser/ArabicReasoningInstruct_QA 🔹 Description: Contains reasoning challenges to validate model performance. > [!IMPORTANT] > The Qwen/QwQ-32B…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: Omartificial-Intelligence-Space
Теги: peft, unsloth, chat, conversational, ar, en
Лайков: 4 | Загрузок: 7
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
