kai-os_Grug-35B-A3B-GGUF
— llama.cpp — ramalama — LM Studio — koboldcpp — Jan AI — Text Generation Web UI —...
— llama.cpp — ramalama — LM Studio — koboldcpp — Jan AI — Text Generation Web UI —...
35B MoE Qwen3.6-A3B trunk (3B active) + embedded NextN-MTP head, quantized for single-GPU inference. — Trunk: IQ4XS (imatrix-calibrated)...