These plots show successful removal of refusal behavior — harmless and harmful prompts are well-mixed across layers. This model uses the Heretic ABLIteration method for neural direction ablation: 1. Identify Refusal Direction — Train a LoRA on harmful behavior datasets to identify neural directions controlling «refusal behavior» 2. Direction Extraction — Extract the «refusal vector» from the trained LoRA 3. Ablative Removal — Subtract this direction from the original model weights, removing the censorship mechanism This method only modifies model weights without changing the architecture or adding inference overhead. > For detailed technical principles, refer to: Heretic Abliteration 1. Minor Capability Loss — NLL increased by approximately 4.2%, which may slightly affect performance on complex tasks 2. User Discretion Required — Users must independently judge the appropriateness of generated outputs — Original Model: Qwen/Qwen3.5-27B — Heretic Method: alignlab/heretic
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: LiconStudio
Теги: gguf, heretic, uncensored, ablation, qwen, zh, en, endpoints_compatible
Лайков: 4 | Загрузок: 389
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
