Qwen3-Coder-Next-NVFP4-GB10
Весовые коэффициенты идентичны байтам вышестоящего количества (проверено config.json и model.safetensors.index.json SHA-256). Это зеркало существует для обеспечения закрепленной, стабильной,...
Метка: quantized
DeepSeek-V4-Flash-MLX-Q3-mixed-gs128-affine
— Base model: deepseek-ai/DeepSeek-V4-Flash — Source revision: 6e763230a9d263eca2023f1d4a5ce1bfe126cf48 — Architecture: DeepseekV4ForCausalLM — Model type: deepseekv4` — Tooling branch:...
Qwen3.6-27B-GPTQ-Int4
Partial GPTQ Int4 quant of Qwen/Qwen3.6-27B, produced with the verbatim recipe from Qwen’s own Qwen/Qwen3.5-27B-GPTQ-Int4 — only MLP/FFN...
Qwen3.6-27B-Q8-NVFP4-GGUF
— Used mmangkad/Qwen3.6-27B-NVFP4 as base model (Thank you for doing ModelOpt quant!) — Another mixed precision quant: ssmout...
Qwen3.6-35B-A3B-TQ-apex3
Data-driven mixed-precision native TurboQuant checkpoint of Qwen/Qwen3.6-35B-A3B. Extends -TQ-apex2 by skipping the shared-expert down-projection — the tensor family...
Ornstein3.6-35B-A3B-SABER-GGUF
GGUF quantizations of DJLougen/Ornstein3.6-35B-A3B-SABER for use with llama.cpp, ollama, LM Studio, and compatible runtimes. Source model is the...
Qwen3.6-35B-A3B-UD-Q6_K_XL-mlx
6-bit base mixed-precision quantization of Qwen/Qwen3.6-35B-A3B for Apple Silicon, using the Unsloth Dynamic quantization strategy via mlx-node. Benchmarked...
Qwen3.6-35B-A3B-UD-Q3_K_XL-mlx
3-bit base mixed-precision quantization of Qwen/Qwen3.6-35B-A3B for Apple Silicon, using the Unsloth Dynamic quantization strategy via mlx-node. Benchmarked...
Qwen3.6-35B-A3B-oQ6
— Quantization: oQ6 (sensitivity-driven mixed precision, groupsize=64) — Format: MLX safetensors — Compatible with:** mlx-lm, mlx-vlm, oMLX on...
Qwen3.6-35B-A3B-oQ3
— Quantization: oQ3 (sensitivity-driven mixed precision, groupsize=64) — Format: MLX safetensors — Compatible with:** mlx-lm, mlx-vlm, oMLX on...