MXFP4 GGUF quantization of ornith-ai/Ornith-1.5-35B-A3B, a mixture-of-experts model with ~35B total and ~3B active parameters per token, with the MTP (multi-token prediction) layer kept for self-speculative decoding, plus an F16 vision projector. Made for WHIRL 0.2.0, now on AMD Ryzen AI Max+ 395 (Radeon 8060S) and Radeon AI PRO R9700. Rebuilt 2026-10-19: the language-model file was re-quantized with an imatrix-weighted MXFP4 quantizer and an importance matrix computed for this exact checkpoint (same tensor layout, same file name). Against the BF16 model its KL divergence is 19% lower than the first release (2026-10-03) and its perplexity is lower too; see Quality. The vision projector is unchanged. > Unofficial community quantization. This repository is not affiliated with, endorsed by, or supported by the Ornith team (ornith-ai). For the official model, official GGUF builds and evaluations, see ornith-ai/Ornith-1.5-35B-A3B and ornith-ai/Ornith-1.5-35B-A3B-GGUF. Ornith-1.5-35B-A3B is the Ornith team’s coding- and agent-oriented MoE model (architecture qwen35moe: Gated DeltaNet + gated attention hybrid, 40 layers, 256 experts with top-8 routing plus a shared expert). Please read…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: tsaipifong
Теги: gguf, mxfp4, moe, mtp, whirl, amd, rdna4, rdna3.5
Лайков: 3 | Загрузок: 1,244
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
