Original model: https://huggingface.co/LiquidAI/LFM2.5-24B-A2B Model details: — Parameter count: 24B (source checkpoint) — Input support: text — Speculative decoding: no — imatrix: yes — details Don’t know which to choose? Grab Q4KM (15.35GB) — usually a good mix of size and performance. Download instructions available here These quants run with llama.cpp — installable in one line via llama.app: llama-server includes a built-in chat web UI, served at http://localhost:8080 by default. These quants were made with llama.cpp release b11606 — if this model’s architecture is newly supported, you’ll need that release or newer to run them. They also work in: LM Studio · koboldcpp · ramalama · Jan AI · Text Generation Web UI · LoLLMs · Atomic Chat Some of these files were built with a layout computed for this model instead of llama.cpp’s standard one-size-fits-all rules. A Q4KM is still mostly Q4K; the extra precision goes to the weights this particular model is most sensitive to. The S, M or L in a name says how much of the model stays at the base precision: about 90 % for S, 70 % for M and 50 % for L. An L name is simply the large size of its family. Q4KL is to Q4KM what Q4KM is to Q4KS;…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: bartowski
Теги: gguf, liquid, lfm2.5, edge, moe, en, ar, zh
Лайков: 3 | Загрузок: 11,089
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
