The gpt-sw3-6.7b-v2-translator is a finetuned version of gpt-sw3-6.7b-v2-instruct on a carefully selected translation pair dataset that was gathered by AI Sweden. Translate text data from English to Swedish, or Swedish to English. The training was done on 1 NVIDIA DGX using DeepSpeed ZeRO 3 for three epochs on roughly 4GB of carefully selected translation data. It is a full finetune of all of the model parameters. AI Sweden Base models GPT-Sw3 126M | GPT-Sw3 356M | GPT-Sw3 1.3B GPT-Sw3 6.7B | GPT-Sw3 6.7B v2 | GPT-Sw3 20B GPT-Sw3 40B Instruct models GPT-Sw3 126M Instruct | GPT-Sw3 356M Instruct | GPT-Sw3 1.3B Instruct GPT-Sw3 6.7B v2 Instruct | GPT-Sw3 20B Instruct Quantized models GPT-Sw3 6.7B v2 Instruct 4-bit gptq | GPT-Sw3 20B Instruct 4-bit gptq GPT-SW3 is a collection of large decoder-only pretrained transformer language models that were developed by AI Sweden in collaboration wi GPT-SW3 has been trained on a dataset containing 320B tokens in Swedish, Norwegian, Danish, Icelandic, English, and programming code. The model was pretrained using a causal language modeling (CLM) objective utilizing the NeMo Megatron GPT…
Модальности:
Генерация текста
Области применения:
Перевод
Задача: Генерация текста
Автор: AI-Sweden-Models
Теги: gguf, translation, sv, da, no, en, endpoints_compatible
Лайков: 3 | Загрузок: 0
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
