GGUF quantization of mlasli/Nemotron-3.5-Lightning-30B-A3B-Heretic-Uncensored-BF16 — NVIDIA-Nemotron-3.5-Lightning-30B-A3B (31.6B total / 3B active) with its refusal direction removed via Heretic....
The standard profile. 8-bit attention/routers/shared experts, 4-bit routed experts. JANG mixed-precision affine (JANG4M, group size 64) conversion of...
> NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 is the full-precision reference release of NVIDIA’s Nemotron 3.5 Lightning model, a hybrid Mixture-of-Experts architecture interleaving...
This model was converted to GGUF format from nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 using llama.cpp via the ggml.ai’s GGUF-my-repo space. Refer to...
The pre-training data has a cutoff date of September 2025. The post-training data has a cutoff date of...
