Qwen3.6-27B-OBLITERATED-MLX-4bit
MLX conversion of OBLITERATUS/Qwen3.6-27B-OBLITERATED for Apple Silicon. The model uses an alternating linear/full attention pattern across 64 layers...
MLX conversion of OBLITERATUS/Qwen3.6-27B-OBLITERATED for Apple Silicon. The model uses an alternating linear/full attention pattern across 64 layers...
> Built with mlx-optiq, the MLX-native toolkit to quantize, fine-tune, and serve LLMs locally on Apple Silicon, no...
This repo contains a 4‑bit quantized version of Zyphra/ZAYA1‑8B using bitsandbytes (loadin4bit=True, nf4 quantization type). It reduces VRAM...
> Built with mlx-optiq, the MLX-native toolkit to quantize, fine-tune, and serve LLMs locally on Apple Silicon, no...
W4A16 quantization of MiniMaxAI/MiniMax-M2.7, produced with llm-compressor. — Format: compressed-tensors pack-quantized, int4 weights / fp16 activations — Group...
Нормосохраняющая аблитерированная LoRA-настроенная модель Gemma 4 26B (A4B MoE), оптимизированная для кодирования, рассуждений, задач агента и полностью нецензурного...
This is a 4-bit AWQ quantization of Google’s Gemma-4-31B-it instruction-tuned multimodal model, optimized for deployment with vLLM. >...
This is a 4-bit GPTQ quantization of Google’s Gemma-4-31B-it instruction-tuned multimodal model, optimized for deployment on NVIDIA GPUs...
Huihui-Qwen3.5-9B-abliterated-GPTQ-Pro-4bit-g64 is a GPTQ-quantized checkpoint intended for efficient GPU inference, published by groxaxo. It is intended for open-source...
GGUF 4-битное преобразование huihui-ai/Huihui-Qwen3.5-27B-Claude-4.6-Opus-аблитерированного. Модальности:Генерация текста Области применения:Диалог / чат Задача: Генерация текста Автор: arandompothead Теги: gguf, quantization,...