A.X-K2-GGUF
🤗 Original model | 🤗 Collection | 🖥️ Github | 📄 Technical Report This repository contains a quantized...
🤗 Original model | 🤗 Collection | 🖥️ Github | 📄 Technical Report This repository contains a quantized...
NVFP4 (4-bit) quantization of inclusionAI/Ling-3.0-flash (BailingMoeV3, 42-layer hybrid MoE + MTP) produced with NVIDIA ModelOpt using the DeepSeek-V4...
DeepSeek-V4-Flash-0731 compressed from 155.42 GiB to 91.93 GiB (1.69×) so it fits and serves on ONE NVIDIA DGX...
NVFP4 маршрутизируемое экспертное квантование deepseek-ai/DeepSeek-V4-Flash-0731, полученное с помощью собственного опубликованного потока NVIDIA Model-Optimizerdeepseekv4 `(modelopt 0.45.0). На момент публикации...
A 64.38 GiB NVFP4 quantization of poolside/Laguna-S-2.1 (117.6 B params) that serves on a single DGX Spark (GB10,...
Language Model Body (Text Body): All Self-Attention (qproj, kproj, vproj, oproj) and MLP (gateproj, upproj, downproj) layers are...
FP8 W8A8 (dynamic per-token activations) quantization of Nanbeige/Nanbeige4.2-3B — the looped transformer (22 layers × numloops: 2). 4.9...
Website cyan.kiwi Models Hugging Face · ModelScope Connect X · Reddit · Email Version cyankiwi 26.05.01 Calibration STEM...
Quality-first mixed-precision ModelOpt quantization of poolside/Laguna-S-2.1, exported directly from Poolside’s BF16 checkpoint. This is a serving-oriented checkpoint, not...
A 4-bit MXFP4 quantization of poolside/Laguna-S-2.1, produced with qstream. The routed MoE experts (~96% of the weights) are...