Original model: https://huggingface.co/togethercomputer/HybridAgent-14B-Agentic Model details: — Parameter count: 15B (source checkpoint) — Input support: text — Speculative decoding: no — imatrix: yes — details Don’t know which to choose? Grab Q4KM (9.32GB) — usually a good mix of size and performance. Download instructions available here These quants run with llama.cpp — installable in one line via llama.app: llama-server includes a built-in chat web UI, served at http://localhost:8080 by default. These quants were made with llama.cpp release b11716 — if this model’s architecture is newly supported, you’ll need that release or newer to run them. They also work in: LM Studio · koboldcpp · ramalama · Jan AI · Text Generation Web UI · LoLLMs · Atomic Chat Some of these files were built with a layout computed for this model instead of llama.cpp’s standard one-size-fits-all rules. A Q4KM is still mostly Q4K; the extra precision goes to the weights this particular model is most sensitive to. The S, M or L in a name says how much of the model stays at the base precision: about 90 % for S, 70 % for M and 50 % for L. An L name is simply the large size of its family. Q4KL is to Q4KM what…
Модальности:
Генерация текста
Области применения:
Диалог / чат Вызов функций (Tool use)
Задача: Генерация текста
Автор: bartowski
Теги: gguf, hybrid-reasoning, latent-reasoning, agent, tool-use, en, endpoints_compatible, conversational
Лайков: 3 | Загрузок: 4,128
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.