somosnlp-hackathon-2023/opt-6.7b-lora-sag-t3000-v300-v2 - Каталог нейросетей
Генерация текста

somosnlp-hackathon-2023/opt-6.7b-lora-sag-t3000-v300-v2

Добавлено:
somosnlp-hackathon-2023/opt-6.7b-lora-sag-t3000-v300-v2

This adapter was created as part of the SomosNLP Hackathon 2023 with the PEFT library and allowed the base model facebook/opt-6.7b to be fine-tuned on the SQUADES (v1.1.0) and MLSUM by using the method LoRA*. — Developed by: — 🇵🇪 Enrique Ubaldo — 🇵🇪 Fernando Alva-Manchego — 🇵🇪 @Levi111 — 🇲🇽 @IvanHU — 🇨🇺 Alberto Carmona Barthelemy — Model type: Text2Text Generation — Language(s) (NLP): Spanish — License: apache-2.0 This model is designed for use in Spanish language instruction, specifically for tasks such as generating summaries, creating questions, and generating answers based on a given context and question. Please note that this model inherits biases from its original base model. You can review these biases by visiting the following link. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations. We selected 1000 examples for each of the three tasks in the training dataset, and 100 examples for each task in the validation dataset. This resulted in a total of 3000 examples for training and 300 examples for validation. — Training regime: fp16 — Steps:: 80 — Learning rate:: 2e-4 -…

Модальности:
Генерация текста


Задача: Генерация текста
Автор: somosnlp-hackathon-2023
Теги: adapter-transformers, text2text-generation, es
Лайков: 3  |  Загрузок: 5

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.