Abiray/Huihui-Ministral-3B-Instruct-2512-abliterated-GGUF

This repository contains GGUF Quantizations of the Huihui-Ministral-3B-Instruct-2512-abliterated model. The model is based on Ministral 3B, which has been «abliterated» (uncensored) to remove refusal mechanisms. This modification makes it highly responsive and capable of handling complex, unrestricted creative writing tasks. These GGUF files are strictly optimized for high-performance local inference on edge devices, laptops, and consumer-grade hardware. — Developed by: Abhiray (Quantization), Huihui-AI (Abliteration), Mistral AI (Base Model) — Model type: GGUF Quantized LLM (Text Generation) — Language(s) (NLP): English (Primary), Multilingual capabilities inherited from Ministral. — License: Apache 2.0 — Finetuned from model: huihui-ai/Huihui-Ministral-3-3B-Instruct-2512-abliterated — Base Model Repository: huihui-ai/Huihui-Ministral-3-3B-Instruct-2512-abliterated — Original Model: Mistral AI Ministral-3B This model is engineered for efficient local inference on hardware with limited VRAM. It is compatible with major GGUF inference engines including: Ollama llama.cpp LM Studio KoboldCPP It is particularly effective for Creative Writing, Interactive Assistants, and Narrative…

Модальности:
Генерация текста

Области применения:
Диалог / чат Следование инструкциям

Задача: Генерация текста
Автор: Abiray
Теги: gguf, ministral, mistral, quant, uncensored, abliterated, text-generation-inference, edge-computing
Лайков: 4  |  Загрузок: 663

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.