Model: Qwen2.5-14B-Instruct-abliterated-v2 Made by: huihui-ai Made with exllamav2 0.2.3 with the default dataset. Exl2 quants can be used with Nvidia RTX2xxx or newer GPUs on Windows/Linux or AMD on Linux. This model format works the best when a model fits your GPU, otherwise it’s better to use GGUF versions. For example with RTX3060/12GB I could fit 4.5bpw/5bpw with Q6 cache and 16k context. Use with with Text-Generation-WebUI, TabbyAPI or other apps that have exllamav2 loader. This is an uncensored version of Qwen2.5-14B-Instruct created with abliteration (see this article to know more about it). Special thanks to @FailSpy for the original code and technique. Please follow him if you’re interested in abliterated models. Important Note This version is an improvement over the previous one Qwen2.5-14B-Instruct-abliterated. You can use this model in your applications by loading it with Hugging Face’s transformers library:
Модальности:
Генерация текста
Области применения:
Диалог / чат Следование инструкциям
Задача: Генерация текста
Автор: cgus
Теги: qwen2, chat, abliterated, uncensored, conversational, en, endpoints_compatible, 4-bit
Лайков: 4 | Загрузок: 15
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
