> STATUS: TRAINING COMPLETE — RESEARCH BASE MODEL. Final checkpoint of a single 760,000-step run. This is a base > (pretrained) model, not instruction-tuned: it continues text and does not follow commands. An instruction-tuned > version is a separate model with its own card. Results below use our protocol, not official benchmark submissions, > and are compared only with our own earlier models (GoLLeM v4 and v5) measured the same way. GoLLeM v6 is a 252.8M-parameter decoder-only language model trained from scratch on a Polish–English mix (about two thirds Polish, one third English). It is a Fabryka AI project (formerly SlayerLab). Intended use: research on small bilingual language models, comparison with GoLLeM v4 (Polish only) and v5 (English only), and text continuation in Polish and English. Not intended for: production use, question answering without context, or following instructions. Like any base model of this size it has limited factual knowledge and may produce fluent but wrong text. All numbers: final checkpoint 221b1286…, single run, seed 1337. Our protocol, not official. English — our implementation of the Glint leaderboard metrics (the same harness we used for GoLLeM…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: SlayerLab
Теги: polish, english, language-model, research, gollem, pl, en
Лайков: 3 | Загрузок: 287
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
