GGUF builds of darrellbest/Qwen-Image-2.1-PE-T2I-Heretic, the refusal-ablated text-to-image prompt rewriter: it turns a short request into a detailed prompt plus a recommended aspect ratio. For llama.cpp and Ollama, including machines with no CUDA GPU and ARM machines such as the DGX Spark. > Not affiliated with or endorsed by Alibaba / Qwen. Derived from > Qwen/Qwen-Image-2.1-PE-T2I under the Qwen Research > License (copy included). Non-commercial use only. systemprompt.txt is included and required. It defines the output contract, and the model is useless without it. Ollama packs the file into a single model, so nothing extra is needed at run time. converthftogguf.py from llama.cpp (bd4f514), then llama-quantize. Converting this architecture needed a one-line fix: the Qwen converter reads mtpnumhiddenlayers with a default, but these checkpoints set it to null, so it has to be coerced to 0 (other converters in llama.cpp already do this with or 0). Checked after conversion: the Q8_0 build was imported into Ollama and run on a real image, and it described the picture correctly and produced a valid rewrite. Same prompt, greedy decoding (temperature 0), one RTX PRO 6000 via Ollama.…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: darrellbest
Теги: gguf, heretic, abliterated, prompt-rewriting, qwen-image, llama-cpp, ollama, endpoints_compatible
Лайков: 3 | Загрузок: 2,836
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.