OLMo 2 13B SFT November 2024 is post-trained variant of the OLMo 2 13B November 2024 model, which has undergone supervised finetuning on an OLMo-specific variant of the Tülu 3 dataset. Tülu 3 is designed for state-of-the-art performance on a diversity of tasks in addition to chat, such as MATH, GSM8K, and IFEval. Check out the OLMo 2 paper (forthcoming) or Tülu 3 paper for more details! OLMo is a series of Open Language Models designed to enable the science of language models. These models are trained on the Dolma dataset. We are releasing all code, checkpoints, logs (coming soon), and associated training details. The core models released in this batch include the following: — Model type: A model trained on a mix of publicly available, synthetic and human-created datasets. — Language(s) (NLP): Primarily English — License: Apache 2.0 — Finetuned from model: allenai/OLMo-2-13B-1124 — Project Page: https://allenai.org/olmo — Repositories: — Core repo (training, inference, fine-tuning etc.): https://github.com/allenai/OLMo — Evaluation code: https://github.com/allenai/olmes — Further fine-tuning code: https://github.com/allenai/open-instruct — Paper: https://arxiv.org/abs/2501.00656 -…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: allenai
Теги: olmo2, conversational, en, endpoints_compatible
Лайков: 3 | Загрузок: 196
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
