GLM-5.3-Flash-AWQ-W4A16-aggr-w8-mtpq8c-int4g32-mixA
Derived from wtdcode/GLM-5.3-Flash-AWQ-W4A16 @ abd7b07 (INT4 AWQ experts, compressed-tensors pack-quantized), itself a quantization of zai-org/GLM-5.3-Flash (MIT). This repo...
Derived from wtdcode/GLM-5.3-Flash-AWQ-W4A16 @ abd7b07 (INT4 AWQ experts, compressed-tensors pack-quantized), itself a quantization of zai-org/GLM-5.3-Flash (MIT). This repo...
This is a MXFP8 quantization of Qwen/Qwen3.5-35B-A3B, generated by AutoRound. Please follow the license of the original model....
— Model Architecture: GlmMoeDsaForCausalLM — Input: Text — Output: Text — Model Optimizations: — Weight quantization: FP4 —...
Текстовая квантизация Qwen/Qwen3.8-27B со смешанной точностью, созданная для соответствия строгому ограничению в 20 000 000 000 байт всего...
Website cyan.kiwi Models Hugging Face · ModelScope Connect X · Reddit · Email Version cyankiwi 26.05.01 Calibration STEM...
> [!IMPORTANT] > ~3.7× smaller than the original 16-bit Qwen3-4B, with 96.5% accuracy retention. 3-bit weight-only quantization for...
FP8 quantization of amalia-llm/AMALIA-9B-0626-DPO, the European Portuguese language model, for serving with vLLM. To the best of our...
Квантование INT4 (W4A16) Qwen/Qwen3.8-27B построено специально для того, чтобы модель работала на графических процессорах Pre-Hopper, включая Volta (V100,...
> [!NOTE] > This repository contains the NVFP4 version of Granite-4.2-30B. > > Please refer to the original...
> Work in progress. This card and the checkpoint are still being validated. Routed experts of DeepSeek-V4-Flash-0731 transcoded...