> This checkpoint is identical to tartuNLP/Llama-3.1-EstLLM-8B-Instruct-0825 llama-estllm-prototype-0825 is the first artifact produced by the EstLLM project. The intention of this release is to evaluate the first prototype in a conversational ChatbotArena-style setting on baromeeter.ai, and thus establish a baseline for future improvements. The model underwent continuous pre-training starting from meta-llama/Llama-3.1-8B on approximately 35B tokens, which resulted in tartuNLP/Llama-3.1-EstLLM-8B-0525, then supervised fine-tuning and direct preference optimization were applied. — Developed by: TartuNLP and TalTechNLP research groups — Funded by: Estonian Ministry of Education and Research, “Estonian Language Technology Program 2018-2027” — Model type: Causal Language Model, Instruction-following — Language(s) (NLP): Estonian, English — License: Llama 3.1 Community License Agreement — Finetuned from model: tartuNLP/Llama-3.1-EstLLM-8B-0525 Continued Pre-Training was performed for a single epoch on: — Estonian National Corpus (8.6B tokens) — Python-Ed
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: tartuNLP
Теги: llama, conversational, et, en, text-generation-inference, endpoints_compatible
Лайков: 3 | Загрузок: 25
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
