Four Gemma 4 12B specialists. One expert active per token. Built for useful local agentic work. Caelum-G4-38B-A12.5B is an experimental, top-1 sparse Mixture-of-Experts model assembled from four architecture-compatible Gemma 4 Unified 12B checkpoints. It contains 38.01B total parameters while activating approximately 12.53B parameters per token. The model is intended for coding, structured tool use, agent planning, systems work, general reasoning, and careful scientific analysis. It preserves the official Gemma 4 Unified shared attention and multimodal trunk, but only text generation is currently release-tested. > This is an experimental community model, not an official Google model. Its positive result is from a small, frozen internal selection suite—not an established external leaderboard. — Four full-width routed MLP experts: general, agentic/coding, systems/DevOps, and science/medical. — Top-1 routing at every one of the 48 language layers. — Calibrated router rather than prompt initialization alone. — Stock llama.cpp-compatible Gemma 4 MoE tensor layout. — Q4KM beat every dense source checkpoint on the frozen AirGapBench v1 suite. — The complete BF16 Transformers checkpoint…
Модальности:
Генерация текста
Области применения:
Генерация кода Логика и рассуждение Диалог / чат Вызов функций (Tool use)
Задача: Генерация текста
Автор: EryriLabs
Теги: caelum_gemma4_unified_moe, image-text-to-text, gemma4, gemma4-unified, mixture-of-experts, moe, mergekit, agentic
Лайков: 4 | Загрузок: 229
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
