gemma-4-opencoder-40b-a8b-nvfp4-v2
Gemma 4 OpenCoder 40B-A8B v2 is a continued post-trained Gemma 4 coding model focused on agentic software engineering,...
Gemma 4 OpenCoder 40B-A8B v2 is a continued post-trained Gemma 4 coding model focused on agentic software engineering,...
FP8 W8A8 (dynamic per-token activations) quantization of Nanbeige/Nanbeige4.2-3B — the looped transformer (22 layers × numloops: 2). 4.9...
Website cyan.kiwi Models Hugging Face · ModelScope Connect X · Reddit · Email Version cyankiwi 26.05.01 Calibration STEM...
A 4-bit MXFP4 quantization of poolside/Laguna-S-2.1, produced with qstream. The routed MoE experts (~96% of the weights) are...
AWQ (W4A16) quantization of empero-ai/Qwythos-9B-v2 — a 9.65B reasoning / uncensored model from Empero AI (qwen35`: dense hybrid...
Luciole-8B-Instruct-1.1-FP8 is a FP8-quantized version of Luciole-8B-Instruct-1.1 in the transformers / compressed-tensors (https://github.com/neuralmagic/compressed-tensors) format, quantized with LLM Compressor...
We reduce Qwen3.5-4B inference latency on a single A10G by quantizing both the target model and its speculative-decoding...
Calibrated NVFP4 quantization of deepreinforce-ai/Ornith-1.0-35B (Qwen3.5-35B-A3B hybrid MoE) for vLLM. 24 GB, and it decodes at the same...
> [!WARNING] > This model is a beta preview and a research artifact. It is not an open...
Квантование NVFP4 (W4A4) модели мышления (рассуждения) llm-jp/llm-jp-4-32b-a3b-thinking — японской модели мышления (рассуждения) Mixture-of-Experts с 32B-A3B битами. Квантовано с...