INVALID LANGUAGE PAIR SPECIFIED. EXAMPLE: LANGPAIR=EN|IT USING 2 LETTER ISO OR RFC3066 LIKE ZH-CN. ALMOST ALL LANGUAGES SUPPORTED BUT SOME MAY HAVE NO CONTENT The agent / tool-call coherent 8-bit ROCmFPX routing of Qwen3.8-27B for AMD gfx1151 (Ryzen AI MAX+ 395 / Strix Halo). Quantized from the 51.3 GiB BF16 GGUF. AGENT keeps 12 more attention-output projections at full Q80** — that is what the extra 0.35 GiB buys. Ryzen AI MAX+ 395 (gfx1151, ROCm 7.2.4), median of 3, warm-up discarded, idle box, shipped flags (—spec-type draft-mtp, Q40 draft head, —spec-draft-n-max 4`): +6.2% over plain, ranges disjoint. The mechanism is visible in the acceptance rate: keeping more attention-output precision makes the MTP draft head’s guesses land more often, so more speculated tokens survive verification. Run standalone, the two builds are 7.92 vs 7.82 tok/s (this one marginally slower), and both score 7/7 tool calling in thinking and non-thinking — identical across…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: kingjones777
Теги: gguf, llama.cpp, rocm, gfx1151, strix-halo, amd, ryzen-ai-max-395, ai-max-395
Лайков: 4 | Загрузок: 7,638
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.