This experimental text-only build compresses Qwen3.8-Flash-Next from a 72.55 GB calibrated source GGUF to 39,721,239,200 bytes: — 36.993287 GiB — 39.721239 decimal GB — 1.80 BPW tensor payload — 125B total parameters / approximately 6B active parameters — 278,760,800 bytes below a strict 40,000,000,000-byte ceiling The release is not a blind whole-model requant. It uses a patched GGUF layout, streaming row repacking, mixed quantization by tensor role, boundary-layer protection, byte-for-byte preservation of sensitive paths, and structural removal of optional components not used by ordinary text generation. If you want more aggressively compressed models, weird inference experiments, and build notes, follow @procrastiness on X. This model uses a padded physical representation for perlayertokenembd.weight. It therefore requires the included patches/qwen4exp-under40.patch` applied to the pinned Qwen4Exp llama.cpp revision. Stock llama.cpp does not understand this custom physical/logical row layout yet. The patch is part of the release, and the exact build/runtime revision is pinned in build-manifest.txt. The source is Unsloth’s UD-IQ1S release at revision…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: 0xKitkat
Теги: gguf, qwen, qwen4exp, llama.cpp, moe, quantized, ultra-low-bit, endpoints_compatible
Лайков: 4 | Загрузок: 396
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
