Ornith-1.0-397B-W4A16-AutoRound
> Quantized release > This repository is an AutoRound W4A16 quantized version of deepreinforce-ai/Ornith-1.0-397B. > It is not...
Метка: w4a16
Ornith-1.0-35B-AutoRound-W4A16-Tuning
This model is a int4 weight-only quantization with group_size 128 and symmetric quantization of deepreinforce-ai/Ornith-1.0-35B generated by TUNING....
GLM-5.2-Int8Mix-NVFP4
This is an experimental hybrid GLM-5.2 checkpoint for vLLM/B12X serving. — the dense, attention, shared-expert, special-head, and MTP...
Qwythos-9B-Claude-Mythos-5-1M-AWQ
AWQ 4-bit (W4A16) quantization of empero-ai/Qwythos-9B-Claude-Mythos-5-1M — a Claude-Mythos/Fable-trace reasoning fine-tune of Qwen3.5-9B (qwen35: a dense hybrid GatedDeltaNet...
Qwen3.6-35B-A3B-INT4-W4A16
INT4 weight-only (W4A16) quantization of Qwen/Qwen3.6-35B-A3B — a hybrid Mixture-of-Experts model (256 experts, top-8, ~3B active) with GatedDeltaNet...
MiniMax-M2.7-AWQ-4bit
W4A16 quantization of MiniMaxAI/MiniMax-M2.7, produced with llm-compressor. — Format: compressed-tensors pack-quantized, int4 weights / fp16 activations — Group...
gemma-4-31B-it-4bit-W4A16-AWQ
This is a 4-bit AWQ quantization of Google’s Gemma-4-31B-it instruction-tuned multimodal model, optimized for deployment with vLLM. >...
gemma-4-31B-it-4bit-W4A16-GPTQ
This is a 4-bit GPTQ quantization of Google’s Gemma-4-31B-it instruction-tuned multimodal model, optimized for deployment on NVIDIA GPUs...
IQuest-Coder-V1-40B-Instruct-int4
Этот репозиторий предоставляет квантованный по массе INT4 (W4A16) вариант IQuestLab/IQuest-Coder-V1-40B-Instruct, квантованный с помощью llm-компрессора и сохраненный в формате...
Qwen3-30B-A3B-Thinking-2507-W4A16
W4A16 (4-bit weights, 16-bit activations) quantized version of Qwen/Qwen3-30B-A3B-Thinking-2507 using LLM-Compressor. — 🗜️ Memory: ~75% reduction vs FP16...