GGUF quantizations of DJLougen/Ornstein3.6-35B-A3B-SABER for use with llama.cpp, ollama, LM Studio, and compatible runtimes. Source model is the SABER-ablated variant of Ornstein3.6-35B-A3B (Qwen3.5 MoE, 35B total / ~3B active). See the source model card for a description of SABER. I’m a PhD student in visual neuroscience at the University of Toronto who also happens to spend way too much time fine-tuning, merging, and quantizing open-weight models on rented H100s and a local DGX Spark. All training compute is self-funded — balancing GPU costs against a student budget. If my uploads have been useful to you, consider buying a PhD student a coffee. It goes a long way toward keeping these experiments running. Active parameters per token are ~3B regardless of file size; the table reflects total weights on disk. Research and red-teaming. The SABER-ablated model complies with requests its parent model refused. Deploy behind your own policy/logging layer.
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: GestaltLabs
Теги: gguf, llama.cpp, quantized, qwen3_5_moe_text, qwen3_5_moe, mixture-of-experts, qwen3.6, saber
Лайков: 4 | Загрузок: 201
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
