We introduce the updated version of the Qwen3-235B-A22B non-thinking mode, named Qwen3-235B-A22B-Instruct-2507, featuring the following key enhancements: — Significant improvements in general capabilities, including instruction following, logical reasoning, text comprehension, mathematics, science, coding and tool usage. — Substantial gains in long-tail knowledge coverage across multiple languages. — Markedly better alignment with user preferences in subjective and open-ended tasks, enabling more helpful responses and higher-quality text generation. — Enhanced capabilities in 256K long-context understanding. Qwen3-235B-A22B-Instruct-2507 has the following features: — Type: Causal Language Models — Training Stage: Pretraining & Post-training — Number of Parameters: 235B in total and 22B activated — Number of Paramaters (Non-Embedding): 234B — Number of Layers: 94 — Number of Attention Heads (GQA): 64 for Q and 4 for KV — Number of Experts: 128 — Number of Activated Experts: 8 — Context Length: 262,144 natively. For more details, including benchmark evaluation, hardware requirements, and inference performance, please refer to our blog, GitHub, and Documentation. *: For…
Модальности:
Генерация текста
Области применения:
Диалог / чат Следование инструкциям
Задача: Генерация текста
Автор: QuantTrio
Теги: qwen3_moe, Qwen3, GPTQ, Int4-Int8Mix, 量化修复, vLLM, conversational, endpoints_compatible
Лайков: 4 | Загрузок: 99
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
