> This is the initial unified version of the Qwen3-30B-A3B series models.As more fine-tuned models emerge and merging methods are applied, we will further improve it. Stay tuned! — Adopt the nuslerp method to improve model absorption rate. — Set a merging ratio of 9:1 to prevent capability degradation caused by an excessively high proportion of the code model. — Merge the two models into the base model using the della merging method to make the model more versatile and stable. — Since the merged model is more similar to the instruction model, we use the chat template of the Qwen3-30B-A3B-Instruct-2507. — By referring to the config1m.json of Qwen3-30B-A3B-Instruct-2507, we modified the config.json of the merged model and extended the maximum context length to 1M.*
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: YOYO-AI
Теги: qwen3_moe, merge, conversational, en, zh
Лайков: 4 | Загрузок: 21
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
