Fine-tuned model on Spanish language using Opensubtitle dataset. The original GPT-2 model was used as backbone which has been trained from scratch on the Spanish portion of OSCAR dataset, according to the Flax/Jax Community by HuggingFace. First, the model used as backbone was the OpenAI’s GPT-2, introduced in the paper «Language Models are Unsupervised Multitask Learners» by Alec Radford et al. Second, transfer learning approach with a large dataset in Spanish was used to transform the text generation model to conversational tasks. The use of special tokens plays a key role in the process of fine-tuning. You can use this model directly with a pipeline for auto model with casual LM:
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: erikycd
Теги: gpt2, conversational, es, text-generation-inference, endpoints_compatible
Лайков: 3 | Загрузок: 10
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.