> Optimized GGUF quantizations of google/gemma-4-26B-A4B-it for on-device AI on Mac. > Built directly from official Google BF16 weights by BatiAI for BatiFlow — free, unlimited, on-device AI automation. Gemma 4 26B-A4B is a Mixture-of-Experts model (26B total parameters, ~3.8B active per token) with native multilingual + vision capabilities. Optimized for chat, code, tool calling, and now image understanding (via opt-in mmproj — see Two modes below). > Note for 16 GB Macs: 26B MoE loads but runs at ~0.3 t/s due to swap. For 16 GB Macs use batiai/gemma4-e4b (5 GB, ~57 t/s) instead. Upstream Gemma 4 26B-A4B-it is multimodal (text + image + video understanding — but no audio; for audio see the smaller E2B / E4B variants). In the GGUF ecosystem this is delivered as two files: a main model.gguf (text tower) and a separate mmproj.gguf (multi-modal projector — the vision tower). We ship both, separate, so you can pick: This is the same pattern unsloth / bartowski / mradermacher use for multimodal models — text-only on Ollama, full multimodal via llama.cpp + mmproj. (Q80 not available because some vision tensors have shapes incompatible with Q80’s column alignment requirement — applies to…
Модальности:
Генерация текста Компьютерное зрение Мультимодальность
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: batiai
Теги: llama.cpp, gguf, gemma, gemma4, moe, quantized, imatrix, apple-silicon
Лайков: 3 | Загрузок: 925
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
