gemma-4-31b-it-Imatrix-IQ4_XS-GGUF
This is a highly optimized, extremely compressed 4-bit (IQ4XS) GGUF version of Google’s Gemma 4 31B Instruct. The...
This is a highly optimized, extremely compressed 4-bit (IQ4XS) GGUF version of Google’s Gemma 4 31B Instruct. The...
This is a my second attempt on this model, which I hope to use as a local coder...
🚨 CRITICAL COMPATIBILITY WARNING 🚨 These are iqk format quantizations and are EXCLUSIVE to the ikllama.cpp fork. They...
— Text backbone: NVFP4 — lmhead: higher precision — Vision tower and vision embeddings: higher precision — Audio...
This is the flat-key variant: expert weights are stored under …experts.. (no moe. namespace). Vanilla upstream vllm v0.20.1...
This is a 4-bit AWQ quantization of Google’s Gemma-4-31B-it instruction-tuned multimodal model, optimized for deployment with vLLM. >...
This is a 4-bit GPTQ quantization of Google’s Gemma-4-31B-it instruction-tuned multimodal model, optimized for deployment on NVIDIA GPUs...
GGUF 4-битное преобразование huihui-ai/Huihui-Qwen3.5-27B-Claude-4.6-Opus-аблитерированного. Модальности:Генерация текста Области применения:Диалог / чат Задача: Генерация текста Автор: arandompothead Теги: gguf, quantization,...
GGUF quantized version of LocoTrainer-4B model for local inference. — Base Model: Qwen3-4B-Instruct-2507 — Distilled from: Qwen3-Coder-Next —...
Abliterated version of Qwen/Qwen3.5-122B-A10B with refusal direction removed. — Method: Refusal direction projection removal (Arditi et al., 2024)...