A fine-tune of Gemma 4 31B (dense, instruct), trained on Fireworks AI and merged + quantized to Q4KM GGUF for local inference with llama.cpp. Built for app and UI generation — HTML, frontend components, and small self-contained web applications. You may use this model to build and ship applications, including commercial ones. You may not resell or redistribute the model weights themselves as a product, or present the model as your own. This model is a derivative of Google Gemma 4 and remains subject to the Gemma Terms of Use, which apply in addition to the terms below. See the LICENSE file for full text. — Base: google/gemma-4-31B-it (text-only export) — Quant: Q4KM (~4.87 bpw, ~17.4 GB) — Context: up to 262,144 tokens Total memory (VRAM + RAM) should exceed the file size (~17.4 GB). — ~24 GB+ VRAM (RTX 3090/4090): full GPU offload, fast — 16 GB VRAM: partial offload, usable — CPU-only: works, but very slow \ llama-server -m saturn-31b-Q4KM.gguf -ngl 99 -c 32768 —jinja \ Gemma 4 has a thinking mode; disable with —chat-template-kwargs ‘{«enablethinking»:false}’` for direct answers
Модальности:
Генерация текста
Области применения:
Генерация кода Диалог / чат
Языки программирования:
HTML/CSS
Задача: Генерация текста
Автор: UlukaDev
Теги: gguf, gemma4, q4_k_m, code, html, endpoints_compatible, conversational
Лайков: 4 | Загрузок: 19
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.