GGUF quantizations of empero-ai/Qwythos-9B-Claude-Mythos-5-1M for llama.cpp, Ollama, LM Studio, jan, KoboldCpp, and other GGUF runtimes. Qwythos-9B is a full-parameter reasoning model post-trained on over 500 million tokens of high-quality Claude Mythos / Claude Fable traces with chain-of-thought generated in-house by Empero AI’s internal rethink tool. It dominates the base Qwen3.5-9B under matched evaluation (+34 pts MMLU, +30 pts gsm8k-strict, +19 pts gsm8k-flex), supports native function calling per the Qwen3.5 spec, and ships with a 1,048,576-token (1M) context window via YaRN rope-scaling enabled by default. For full training details, evaluation numbers, and capability writeup, see the base model card. If you don’t know which to pick, Q4KM is the right starting point — it’s the smallest practical quant with good quality preservation. Qwythos inherits its vision tower from the Qwen3.5-9B base model — the vision path was frozen during SFT (training was text-only), so the vision behavior is identical to base Qwen3.5-9B’s multimodal capability. The mmproj is interchangeable with any community-built Qwen3.5-9B mmproj-.gguf`. Qwythos supports image input out of the box. Download…
Модальности:
Генерация текста Компьютерное зрение Мультимодальность
Области применения:
Логика и рассуждение Вызов функций (Tool use)
Задача: Генерация текста
Автор: arabsya87sy7a8
Теги: gguf, llama.cpp, quantized, qwen3.5, reasoning, uncensored, long-context, 1M-context
Лайков: 4 | Загрузок: 293
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.