Gemma3.5-48B-A4B-Q4KM is a community-built GGUF release that combines the instruction behavior of Gemma 3 27B with the Gemma 4 26B A4B MoE backbone through full-layer activation-distilled donor experts. The model keeps the original Gemma 4 expert bank intact, appends a second donor bank derived from Gemma 3 across all 30 language layers, and preserves a Gemma 4-compatible inference path for local deployment. — Formal name: Gemma3.5-48B-A4B-Q4KM — Architecture: gemma4 — Quantization: Q4KM — Total parameters: 48.1B — Estimated active parameters: ~3.8B — Context length: 262,144 — Total experts: 256 — Experts used per token: 8 — Expert layout: — slots 0..127: original Gemma 4 experts — slots 128..255: Gemma 3 activation-distilled donor experts This model uses Gemma 4 26B A4B as the base MoE runtime and appends a full 30-layer donor expert bank derived from Gemma 3 27B. The donor side was built through activation distillation rather than direct dense replacement. Non-expert backbone tensors remain aligned with the Gemma 4 runtime layout, while the appended donor experts extend the expert bank without overwriting the original Gemma 4 experts. On a fixed stratified MMLU-Pro subset with…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: XxACCOxX
Теги: gguf, gemma, mixture-of-experts, local-inference, en, zh, endpoints_compatible, imatrix
Лайков: 3 | Загрузок: 128
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
