gemma-4-31B-it-4bit-W4A16-GPTQ
This is a 4-bit GPTQ quantization of Google’s Gemma-4-31B-it instruction-tuned multimodal model, optimized for deployment on NVIDIA GPUs...
This is a 4-bit GPTQ quantization of Google’s Gemma-4-31B-it instruction-tuned multimodal model, optimized for deployment on NVIDIA GPUs...
NVFP4 (W4A4) quantized version of trohrbaugh/GLM-4.7-heretic — a decensored zai-org/GLM-4.7, made using Heretic v1.2.0+custom. > Requires NVIDIA Blackwell...
> [!IMPORTANT] > Naming notice (2026-04-10). The «HLWQ» technique used in this model is being rebranded to HLWQ...
FP8 квантованное производное wangzhang/Qwen3.5-122B-A10B-аблитерированного, которое само является производным от Qwen/Qwen3.5-122B-A10B. Этот репозиторий предоставляет модифицированную производную контрольную точку для...
Website cyan.kiwi Models Hugging Face · ModelScope Connect X · Reddit · Email Version llm-compressor Calibration nvidia/Llama-Nemotron-Post-Training-Dataset Model...
— Model Architecture: Qwen3NextForCausalLM — Input: Text — Output: Text — Model Optimizations: — Weight quantization: FP8 —...
Website cyan.kiwi Models Hugging Face · ModelScope Connect X · Reddit · Email Version llm-compressor Calibration nvidia/Llama-Nemotron-Post-Training-Dataset Model...
This repository provides an AWQ quantized build of GLM-4.7-Flash repackaged for vLLM using the compressed-tensors runtime layout. >...
Baichuan-M3 is Baichuan AI’s new-generation medical-enhanced large language model, a major milestone following Baichuan-M2. In contrast to prior...
— Model Architecture: GraniteMoeHybridForCausalLM — Input: Text — Output: Text — Model Optimizations: — Weight quantization: FP8 —...