Q-U-164M Q-164M, fine-tuned for dialogue with exact tool calls > [!IMPORTANT] > This is a research release, not a product. It is small and often factually wrong outside its trained > tool-calling domain. See Results below before using it for anything beyond experimentation. Q-U-164M is Q-164M — a 164.6M-parameter ternary-weight, frozen-fingerprint-vocabulary text model — fine-tuned in two stages specifically for dialogue: chat-SFT, then RL on a verifiable reward supplied by the model’s own deterministic tool executor (the same expr mechanism the base model uses, circuits.py). Same architecture and weights format as the base model, different weights. Current release: v5. The first four fine-tuning passes all shared the same real bug: in a multi-turn conversation the model would drop tool-calling by turn 2-3 and drift into disconnected prose. The actual cause only surfaced with a controlled A/B test — the synthetic training conversations never included conversational connectives (“thanks, now what’s…”, “one more question…”), just bare questions back to back, so the model had never seen “acknowledge small talk and still call the tool” in one…
Модальности:
Генерация текста
Области применения:
Диалог / чат Вызов функций (Tool use)
Задача: Генерация текста
Автор: q-project
Теги: qagent, causal-lm, custom-architecture, ternary-weights, bitnet, frozen-embeddings, exact-circuits, tool-use
Лайков: 3 | Загрузок: 201
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.