We introduce Olmo 3, a new family of 7B and 32B models both Instruct and Think variants. Long chain-of-thought thinking improves reasoning tasks like math and coding. Olmo is a series of Open language models designed to enable the science of language models. These models are pre-trained on the Dolma 3 dataset and post-trained on the Dolci datasets. We are releasing all code, checkpoints, logs (coming soon), and associated training details. The core models released in this batch include the following: You can use OLMo with the standard HuggingFace transformers library: For faster performance, you can quantize the model using the following method: The quantized model is more sensitive to data types and CUDA operations. To avoid potential issues, it’s recommended to pass the inputs directly to CUDA using: — Developed by: Allen Institute for AI (Ai2) — Model type: a Transformer style autoregressive language model. — Language(s) (NLP): English — License: This model is licensed under Apache 2.0. It is intended for research and educational use in accordance with Ai2’s Responsible Use Guidelines. — Contact: Technical inquiries: olmo@allenai.org. Press: press@allenai.org — Date cutoff:…
Модальности:
Генерация текста
Области применения:
Диалог / чат Следование инструкциям
Задача: Генерация текста
Автор: allenai
Теги: olmo3, conversational, en, endpoints_compatible
Лайков: 3 | Загрузок: 12,120
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
