AI Sweden Base models GPT-Sw3 126M | GPT-Sw3 356M | GPT-Sw3 1.3B GPT-Sw3 6.7B | GPT-Sw3 6.7B v2 | GPT-Sw3 20B GPT-Sw3 40B Instruct models GPT-Sw3 126M Instruct | GPT-Sw3 356M Instruct | GPT-Sw3 1.3B Instruct GPT-Sw3 6.7B v2 Instruct | GPT-Sw3 20B Instruct Quantized models GPT-Sw3 6.7B v2 Instruct 4-bit gptq | GPT-Sw3 20B Instruct 4-bit gptq GPT-SW3 is a collection of large decoder-only pretrained transformer language models that were developed by AI Sweden in collaboration wi GPT-SW3 has been trained on a dataset containing 320B tokens in Swedish, Norwegian, Danish, Icelandic, English, and programming code. The model was pretrained using a causal language modeling (CLM) objective utilizing the NeMo Megatron GPT implementation. GPT-SW3 is an autoregressive large language model that is capable of generating coherent text in 5 different languages, and 4 programming languages. GPT-SW3 can also be instructed to perform text tasks that it has not been explicitly trained for, by casting them as text generation tasks. Like other large language models for which the diversity (or lack thereof) of training data induces downstream impact on the…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: AI-Sweden-Models
Теги: gpt2, da, sv, no, en, is, text-generation-inference, endpoints_compatible
Лайков: 2 | Загрузок: 9
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.