This version of Qwen3-4B-Instruct-2507 unsloth has been converted to run on the RK3588 NPU using [‘w8a8’, ‘w8a8g128’, ‘w8a8g256’, ‘w8a8_g512’] quantization. We introduce the updated version of the Qwen3-4B non-thinking mode, named Qwen3-4B-Instruct-2507, featuring the following key enhancements: — Significant improvements in general capabilities, including instruction following, logical reasoning, text comprehension, mathematics, science, coding and tool usage. — Substantial gains in long-tail knowledge coverage across multiple languages. — Markedly better alignment with user preferences in subjective and open-ended tasks, enabling more helpful responses and higher-quality text generation. — Enhanced capabilities in 256K long-context understanding. Qwen3-4B-Instruct-2507 has the following features: — Type: Causal Language Models — Training Stage: Pretraining & Post-training — Number of Parameters: 4.0B — Number of Paramaters (Non-Embedding): 3.6B — Number of Layers: 36 — Number of Attention Heads (GQA): 32 for Q and 8 for KV — Context Length: 262,144 natively. For more details, including benchmark evaluation, hardware requirements, and inference performance, please refer to our…
Модальности:
Генерация текста
Области применения:
Диалог / чат Следование инструкциям
Задача: Генерация текста
Автор: dulimov
Теги: qwen3, conversational, text-generation-inference, endpoints_compatible
Лайков: 3 | Загрузок: 18
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
