pfeifferj/VibeThinker-3B-GSQ-RCO-GGUF - Каталог нейросетей
Генерация текста

pfeifferj/VibeThinker-3B-GSQ-RCO-GGUF

Добавлено:
pfeifferj/VibeThinker-3B-GSQ-RCO-GGUF

> TL;DR: VibeThinker-3B at 1.16 GB (3-bit) or 1.35 GB (3.5-bit), compared with 6.18 GB in BF16. > Independent community reproduction. These files were produced by a third party using the published GSQ and RCO methods. They are not an IST-DASLab release and carry no endorsement from the authors of either paper. Both methods were developed at the Deep Algorithms and Systems Lab (DASLab), Institute of Science and Technology Austria. INVALID LANGUAGE PAIR SPECIFIED. EXAMPLE: LANGPAIR=EN|IT USING 2 LETTER ISO OR RFC3066 LIKE ZH-CN. ALMOST ALL LANGUAGES SUPPORTED BUT SOME MAY HAVE NO CONTENT IFEval scores 16 prompts with the strict checker and a 1,024-token output cap. Both use the source thinking template, temperature 0 and an 8,192-token context. IFEval checks the text after . If the thinking block never closes, it scores an empty answer. One of the BF16 reference’s two passes reached the output cap. Source: WeiboAI/VibeThinker-3B…

Модальности:
Генерация текста

Области применения:
Диалог / чат


Задача: Генерация текста
Автор: pfeifferj
Теги: gguf, gsq, rco, quantization, mixed-precision, en, endpoints_compatible, conversational
Лайков: 3  |  Загрузок: 295

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.