norallm/normistral-11b-long - Каталог нейросетей
Генерация текста

norallm/normistral-11b-long

Добавлено:
norallm/normistral-11b-long

![](https://huggingface.co/norallm/normistral-11b-warm/resolve/main/images/puffin_2.png) NorMistral-11b-long is a length-extended version of NorMistral-11b-warm. It has been extended to 32,768 context length by continual training on additional 50 billion subword tokens – using a mix of Scandinavian, Sámi, English and code data (four repetitions of open Norwegian texts). The model follows our earlier paper Small Languages, Big Models: A Study of Continual Training on Languages of Norway by Samuel et al. 2025, and forms part of the NORA.LLM family developed by the Language Technology Group at the University of Oslo (LTG). Disclaimer: This model is pretrained on raw (mostly web-based) textual data. It is not finetuned to follow instructions, and it can generate harmful completions after inappropriate user prompts. It is primarily intended for research purposes. We release the model under Apache 2.0 license to indicate that we do not impose any additional constraints on the model weights. However, we do not own the data in the training collection. The model is pretrained on a combination of publicly available data and a custom web crawl for Sámi. The total training corpus consists of…

Модальности:
Генерация текста


Задача: Генерация текста
Автор: norallm
Теги: mistral, norwegian, sami, bokmaal, nynorsk, nb, nn, no
Лайков: 4  |  Загрузок: 332

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.