This repository contains GGUF format model files for huihui-ai/Huihui-Qwen3.5-9B-abliterated. We provide a spectrum of quantizations to suit different hardware capabilities. If you are unsure which to choose, Q4KM is the recommended standard for the best balance of speed, size, and reasoning retention. These GGUF files are fully compatible with popular local AI software, including: LM Studio Ollama Jan text-generation-webui (Oobabooga) llama.cpp** Qwen models strictly use the ChatML format for prompting. Your system prompt and user inputs must be wrapped exactly like this: text system You are a helpful assistant. user Write a simple Python script. assistant
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: Abiray
Теги: gguf, qwen, qwen3.5, abliterated, uncensored, endpoints_compatible, conversational
Лайков: 4 | Загрузок: 3,762
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
