Original model: https://huggingface.co/OliviaRossi/MiMo-Ornith-9B-AGSI Model details: — Parameter count: 10B — Input support: text — Speculative decoding: yes (MTP) — details — imatrix: yes — details Don’t know which to choose? Grab Q4KM (5.98GB) — usually a good mix of size and performance. Download instructions available here These quants run with llama.cpp — installable in one line via llama.app: llama-server includes a built-in chat web UI, served at http://localhost:8080 by default. These quants were made with llama.cpp release b11159 — if this model’s architecture is newly supported, you’ll need that release or newer to run them. They also work in: LM Studio · koboldcpp · ramalama · Jan AI · Text Generation Web UI · LoLLMs · Atomic Chat This model has MTP (Multi-Token Prediction) layers, and they are included in these quants MTP layers act as a built-in draft model, letting llama.cpp run speculative decoding for faster generation. To use them, add the following flag to your llama.cpp command: Some of these files were built with a layout computed for this model instead of llama.cpp’s standard one-size-fits-all rules. A Q4KM is still mostly Q4K; the extra precision goes to the…
Модальности:
Генерация текста
Области применения:
Генерация кода Логика и рассуждение Диалог / чат Вызов функций (Tool use)
Задача: Генерация текста
Автор: OliviaRossi
Теги: gguf, merge, agsi, qwen, qwen3_5, reasoning, coding, agentic
Лайков: 3 | Загрузок: 1,165
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
