FadedRedStar/Anubis-Mini-8B-v1-heretic-GGUF

This repository hosts GGUF weights for Anubis-Mini-8B-v1-heretic, quantized from the source floating-point tensors provided by coder3101/Anubis-Mini-8B-v1-heretic. 🔄 Sister Repository: Check out the Imatrix Sister Repository for enhanced precision at lower bit fractions. > [!NOTE] > If you plan on using 4-bit or 5-bit variants, consider the imatrix sister repository instead — importance matrix calibration improves logic retention at those bit depths. This repository is best suited if you want the near-lossless Q80` build. Anubis-Mini-8B-v1 is a Llama-3.3-8B fine-tune by TheDrummer, purpose-built for immersive roleplay, collaborative storytelling, and creative writing. TheDrummer’s models prioritise creativity, dynamism, imagination, and reduced alignment over benchmark scores — the goal is to broaden the model’s range of expression for fiction, TTRPG, and entertainment use cases rather than optimise for factual correctness or safety compliance. The heretic suffix denotes post-processing via the Heretic v1.3.0 abliteration framework performed by coder3101, which surgically suppresses refusal vectors while preserving the model’s core creative and roleplay capabilities. > [!NOTE] >…

Модальности:
Генерация текста

Области применения:
Диалог / чат

Задача: Генерация текста
Автор: FadedRedStar
Теги: gguf, llama.cpp, heretic, llama-3.3, uncensored, abliterated, conversational, q4_k_m
Лайков: 4  |  Загрузок: 1,149

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.