mxxm-t/Qwen3.8-Flash-Next-MTP-GGUF - Каталог нейросетей
Генерация текста

mxxm-t/Qwen3.8-Flash-Next-MTP-GGUF

Добавлено:
mxxm-t/Qwen3.8-Flash-Next-MTP-GGUF

The NextN / MTP draft head from Qwen/Qwen3.8-Flash-Next, extracted and packaged as a standalone GGUF so it can be used as the draft model for speculative decoding with the full Qwen3.8-Flash-Next as the target. > This is not a standalone language model. It is a single prediction block > (~2.6B parameters plus embeddings). It cannot generate text on its own and will > produce nonsense if loaded as a normal model. It only does something useful when > paired with the full Qwen3.8-Flash-Next as the target model. At temperature 0 both produce identical draft tokens on the prompts tested (181 drafted, 136 accepted, 75.1% acceptance for both), so the Q8_0 file costs nothing in draft quality and is the one to use. —spec-draft-n-max 2 is the measured optimum; deeper drafts accept less per position and lose more than the extra depth gains. INVALID LANGUAGE PAIR SPECIFIED. EXAMPLE: LANGPAIR=EN|IT USING 2 LETTER ISO OR RFC3066 LIKE ZH-CN. ALMOST ALL LANGUAGES SUPPORTED BUT SOME MAY HAVE NO CONTENT

Модальности:
Генерация текста

Области применения:
Диалог / чат


Задача: Генерация текста
Автор: mxxm-t
Теги: gguf, qwen, qwen3, mtp, nextn, speculative-decoding, draft-model, llama.cpp
Лайков: 3  |  Загрузок: 409

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.