(DEPRECIATED — Part of MagicQuant v1.0 which had significant flaws. Please utilize v2.0 which is production ready) > MagicQuant is an automated quantization, benchmarking, and evolutionary hybrid-GGUF search system for LLMs. Each release includes models optimized to outperform standard baseline quants (Q8, Q6, Q5, Q4). If a baseline GGUF exists in this repo, the evolutionary engine couldn’t beat it. If a baseline is missing, it’s because a hybrid configuration outperformed it so completely that including the baseline would’ve been pointless. These hybrid GGUFs are built to be as small, fast, and low-drift as possible while preserving model capability. To dive deeper into how MagicQuant works, see the main repo: MagicQuant on GitHub (by MagicCodingMan) Notes: The HuggingFace hardware compatibility where it shows the bits is usually wrong. It doesn’t understand hybrid mixes, so don’t trust it. Naming scheme can be found on the MagicQuant Wiki. * (tips) Less precision loss means less brain damage. More TPS means faster! Smaller is always better right? 0–0.1% → God-tier, scientifically exact 0.1–1% → True near-lossless, agent-ready 1–3% → Minimal loss, great for personal use 3–5%…
Модальности:
Генерация текста
Области применения:
Диалог / чат Следование инструкциям
Задача: Генерация текста
Автор: magiccodingman
Теги: gguf, qwen3_moe, mxfp4_hybrid, quantized, cpu, gpu, mxfp4, mxfp4_moe
Лайков: 4 | Загрузок: 182
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.