— Base Model: Built on Llama-3.2-1B. — Languages: — Full support: Norwegian Bokmål (nb), Norwegian Nynorsk (nn), English (en). — Partial support: Swedish (sv), Danish (da). — Purpose: Supports Norwegian-specific tasks such as question-answering, summarization, and language modeling, while being capable of multilingual generation and translation. Efforts have been made to preserve the English capabilities from the underlying Meta Llama model. — Training Data: Combines publicly available multilingual datasets with synthetic data generation, focusing on Norwegian, English, Swedish, and Danish sources. Additional details are provided below. — Architecture: The model uses the Llama 3.2 architecture. It is an auto-regressive language model with an optimized transformer architecture. The tuned versions use supervised fine-tuning (SFT) and Direct Preference Optimization (DPO) for alignment. The primary goal of NB-Llama-3.2-1B is to advance support for Norwegian language technologies and strengthen support for Norwegian Bokmål and Norwegian Nynorsk. Since much knowledge and culture are also expressed in English, Swedish, and Danish, open sources in these languages are included in the…
Модальности:
Генерация текста
Области применения:
Мультиязычность
Задача: Генерация текста
Автор: NbAiLab
Теги: llama, norwegian, bokmål, nynorsk, swedish, danish, multilingual, no
Лайков: 3 | Загрузок: 31
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
