This is an uncensored Quantized version of Qwen/Qwen3-4B-Thinking-2507 created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens. Quantized using the Intel auto-round tool with weight-only quantization (Weight-Only INT4, group_size=128), achieving excellent precision retention at low bits with almost no noticeable quality degradation. — Risk of Sensitive or Controversial Outputs: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs. — Not Suitable for All Audiences: Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security. — Legal and Ethical Responsibilities: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences. — Research and Experimental Use: It is recommended…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: huihui-ai
Теги: qwen3, abliterated, uncensored, auto-round, conversational, text-generation-inference, endpoints_compatible, 4-bit
Лайков: 4 | Загрузок: 25
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
