BananaMind-2-Mini-Chat is the instruction-tuned version of BananaMind-2-Mini. It was fully fine-tuned on HuggingFaceTB/smol-smoltalk with loss applied only to assistant tokens and the assistant-ending EOS token. The model has 25,178,752 parameters, a 4,096-token context window, and a custom 8,192-token digit-aware byte-level BPE tokenizer. It supports system prompts, multi-turn conversations, and KV-cached generation. INVALID LANGUAGE PAIR SPECIFIED. EXAMPLE: LANGPAIR=EN|IT USING 2 LETTER ISO OR RFC3066 LIKE ZH-CN. ALMOST ALL LANGUAGES SUPPORTED BUT SOME MAY HAVE NO CONTENT Supra 1.0 used the same fallback and a copied checkpoint with 3.0x linear RoPE scaling, extending its context from 1,024 to 3,072 tokens without additional long-context training so it could fit the benchmark inputs. These scores are self-evaluated and may vary with the benchmark revision, Transformers version, dtype, hardware, and generation settings. System and user messages were retained as context but masked from the…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: BananaMind
Теги: bananamind2_mini, causal-lm, chat, instruction-tuned, full-finetune, small-language-model, bananamind, bananamind2
Лайков: 4 | Загрузок: 324
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
