AtomicChat/Inkling-GGUF - Каталог нейросетей
Генерация текста

AtomicChat/Inkling-GGUF

Добавлено:
AtomicChat/Inkling-GGUF

Inkling, self-quantized to GGUF by Atomic Chat. Built straight from Thinking Machines Lab’s original weights with a per-tensor importance matrix, so this is not a repack of somebody else’s files. Runs fully offline. — 952.4B parameters: the weights this repo quantizes. — 66 layers: Mixture-of-Experts. — Modalities: the base model handles Text, Image, Audio; this repo ships text-only quants, it carries no vision projector. — Full imatrix ladder: every quant is calibrated with an importance matrix, published here alongside the quants. > [!NOTE] > These GGUFs are self-quantized from the original weights, not a repack. The importance matrix keeps low-bit quants closer to the full-precision model. > [!IMPORTANT] > Always pass —jinja so the Inkling chat template is applied. Without it the model can emit malformed turns. Scores are Thinking Machines Lab’s published results for the base thinkingmachines/Inkling, not our own measurements. Quantization preserves the large majority of this; Q4KM and up stay close to full precision. — Atomic Chat: the easiest path. Open the app, search AtomicChat/Inkling-GGUF, pick a quant, hit Use this model. — llama.cpp: llama-server -hf…

Модальности:
Генерация текста

Области применения:
Диалог / чат


Задача: Генерация текста
Автор: AtomicChat
Теги: gguf, atomic-chat, inkling, thinkingmachines, llama.cpp, imatrix, quantized, endpoints_compatible
Лайков: 4  |  Загрузок: 412

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.