jcbtc/Qwable-27B-Chadrock-ROCmFPX-ULTRAQUALITY-7.61BPW - Каталог нейросетей
Генерация текста

jcbtc/Qwable-27B-Chadrock-ROCmFPX-ULTRAQUALITY-7.61BPW

Добавлено:
jcbtc/Qwable-27B-Chadrock-ROCmFPX-ULTRAQUALITY-7.61BPW

Qwable 27B Chadrock-ROCmFPX-ULTRAQUALITY-7.61BPW is the new quality-first ROCmFPX GGUF for the Unsloth Qwen3.6 27B MTP line. It replaces the older STRIX QUALITY naming and recipe as the default quality build. The headline is simple: this is the high-quality Strix Halo ROCmFPX build that keeps the speed path alive without accepting the quality drift seen in earlier small mixed-precision experiments. On the fresh card refresh, it landed at 82 on HermesAgent-20, 154/164 on HumanEval+, 25.92 served MTP decode tok/s on a 20KB prompt, and only 0.002420 mean KLD against the BF16 reference. This is a model/runtime pairing, not a stock upstream GGUF. The files use ROCmFPX tensor types and should be run with a ROCmFPX-aware llama.cpp runner. Refresh date: 2026-06-29. Hardware: AMD Ryzen AI Max+ 395 / Strix Halo. Served rows used ROCm, one MTP slot, q80/q80 target KV, f16/f16 draft KV, draft cap 6, b2048/u512, temperature=0, 512 generated tokens, and a deterministic 20KB prompt measuring 3,946 prompt tokens. UltraQuality is over 3.0x the served decode speed of the superseded old STRIX QUALITY row in this refresh, while also improving the distribution-quality metrics below. PPL was measured…

Модальности:
Генерация текста

Области применения:
Диалог / чат


Задача: Генерация текста
Автор: jcbtc
Теги: llama.cpp, gguf, qwen3.6, qwen35, 27b, dense, mtp, speculative-decoding
Лайков: 3  |  Загрузок: 67

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.