This model is a Representation Engineering study on google/gemma-4-E2B-it, achieved through Arbitrary-Rank Ablation (ARA) to mathematically isolate and remove the model’s refusal direction. The model’s alignment vectors were modified using the Heretic framework. Instead of fine-tuning the model on alternative data, the internal «refusal vector» was mathematically located and ablated at the matrix level. Technique: Arbitrary-Rank Ablation (ARA) Trial Selected: Trial 71 KL Divergence: 0.1650 Why Trial 71? During comparative analysis, higher ablation (e.g., Trial 129 / KL: 0.3542) successfully removed all refusal behaviors but resulted in severe semantic drift and performance degradation (e.g., hallucinating when asked technical questions). Trial 71 was selected because a KL divergence of 0.1650 represents an optimal threshold. It successfully alters the safety alignment while preserving the model’s core logic, spatial reasoning, and technical vocabulary. This model proves that advanced Representation Engineering can be done entirely locally on consumer hardware. Hardware: NVIDIA RTX 3080 (10GB VRAM) Processing Time: 6 hours, 13 minutes Framework: Heretic (Experimental ARA…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: Kasper-Bankler
Теги: gguf, gemma4, uncensored, gemma, ablation, heretic, Arbitrary-Rank Ablation, ARA
Лайков: 4 | Загрузок: 717
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.