Qwen3-Reranker-4B-AWQ-INT4
Qwen 3 Reranker 4B в INT4. Сопряжение с набором Embedding для полностью локального стека поиска. ~ 2,7 ГБ...
Qwen 3 Reranker 4B в INT4. Сопряжение с набором Embedding для полностью локального стека поиска. ~ 2,7 ГБ...
3-bit base mixed-precision quantization of Qwen/Qwen3.6-27B for Apple Silicon, using the Unsloth Dynamic quantization strategy via mlx-node. Benchmarked...
W4A16 quantization of MiniMaxAI/MiniMax-M2.7, produced with llm-compressor. — Format: compressed-tensors pack-quantized, int4 weights / fp16 activations — Group...
This is a 4-bit AWQ quantization of Google’s Gemma-4-31B-it instruction-tuned multimodal model, optimized for deployment with vLLM. >...
8-bit base mixed-precision quantization of Qwen/Qwen3.5-35B-A3B for Apple Silicon, using the Unsloth Dynamic quantization strategy via mlx-node. Benchmarked...
6-bit base mixed-precision quantization of Qwen/Qwen3.5-35B-A3B for Apple Silicon, using the Unsloth Dynamic quantization strategy via mlx-node. Benchmarked...
This repository provides an AWQ quantized build of GLM-4.7-Flash repackaged for vLLM using the compressed-tensors runtime layout. >...
As of 2025-11-19, create a fresh Python environment and run: 𓌳 REAP𓌳 the Experts: Why Pruning Prevails for...
По состоянию на 2025-08-28 создайте свежую среду Python и запустите: DeepSeek-V3.1 — это гибридная модель, которая поддерживает как...
🤗 HuggingFace | 🤖 ModelScope | 🪡 AngelSlim 🖥️ Official Website | 🕖 HunyuanAPI | 🕹️ Demo Hunyuan is Tencent’s open-source efficient large language model series, designed for...