A 2.4 MB adapter, not a checkpoint. The 0.95 GB ternary pack stays byte-identical and the refusal direction is removed inside the compute graph, at a strength you set per request. The measurements behind this card are public. Built by the team behind Atomic Chat, the app that runs open-weight models locally and offline. Load it with —lora-scaled Ternary-Bonsai-2-4B-Uncensored-LoRA.gguf:1. Scale 1 takes held-out refusals to 0%, scale 0 switches it off, so one process serves both. It needs PrismML’s llama.cpp fork — stock llama.cpp and Ollama cannot open the base pack at all. Research-grade: MMLU is unchanged, but the residual leak along the direction is about 1e-4, not the 1e-6 of the 27B adapter. A rank-1 LoRA adapter that removes a refusal direction from prism-ml/Ternary-Bonsai-2-4B-gguf at inference time, built and measured by AtomicChat. The base pack stays byte-identical; nothing is requantized. The direction was estimated on the ternary pack itself. The 27B was measured with a 64-token reply budget and 500 MMLU questions on fork release prism-b10709-9a9394a; the smaller sizes with a 256-token budget and 300 questions on prism-b10777-e3de715. Compare base with adapter inside…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: AtomicChat
Теги: gguf, llama.cpp, lora, uncensored, abliteration, refusal-direction, ternary, bonsai
Лайков: 3 | Загрузок: 462
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
