Abliterated version of openNemo-9B with safety refusals removed. Built using Snakehead — Empero AI’s internal abliteration tool specialized for hybrid Mamba2 + sparse attention architectures like Nemotron-H. Standard abliteration tools don’t work on these models because they only target transformer attention layers. Snakehead operates on both Mamba SSM blocks and attention blocks across the full residual stream. KL divergence of 0.022 means the model’s output distribution on normal prompts is almost identical to the original — coherence, reasoning, and knowledge are fully preserved. Nemotron-H is a 56-layer hybrid model with three block types: — Mamba2 SSM blocks — majority of layers, using chunked structured state-space duality — Grouped Query Attention blocks — sparse attention at 5 positions — MLP blocks — feed-forward layers This is the same pure-PyTorch implementation from openNemo — no mamba-ssm or causal-conv1d dependencies required. This model has had its safety alignment removed. It will comply with requests that the original model would refuse. The creators are not responsible for how this model is used. Intended for research, creative writing, and applications where the…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: empero-ai
Теги: nemotron_h, nvidia, abliteration, uncensored, conversational, custom_code, en, es
Лайков: 4 | Загрузок: 49
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
