ROCmFPX iMatrix quantizations of the full BF16 checkpoint published by Aeon / AEON-7. The source weights are Aeon’s Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-BF16, pinned at Hub revision 8f76e82ed7ef4de7735f5d4148fce7b643b00fae. Aeon deserves attribution for the BF16 model and its model work. This repository contains derived GGUF quantizations produced by vmlinux with the ROCmFPX toolchain; it is not a new training run or a claim of ownership of the source model. The source model declares Apache 2.0 licensing. Review the source model card and applicable terms before redistribution or deployment. All three use the same model-specific importance matrix: Qwen3.8-27B-AEON-ULTIMATE-iMatrix.imatrix.gguf. The matrix was generated from 339 chunks of 512 tokens using the shared calibration corpus, and each quantizer consumed 496 entries. These are experimental ROCmFPX tensor types and require a compatible ROCmFPX-enabled llama.cpp build. Stock upstream llama.cpp will not load them. The GGUFs retain the native one-layer MTP head. Thinking is enabled by the embedded Qwen template by default; pass the appropriate chat-template kwargs when an application needs thinking disabled. All three files…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: vmlinux
Теги: llama.cpp, gguf, rocm, rocmfpx, amd, strix-halo, qwen3.8, qwen35
Лайков: 3 | Загрузок: 163
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
