pszemraj/gpt-peter-2.7B

— This model is a fine-tuned version of EleutherAI/gpt-neo-2.7B on about 80k WhatsApp and iMessage texts. — The model is too large to use the inference API. linked here is a notebook for testing in Colab. — alternatively, you can message a bot on telegram where I test LLMs for dialogue generation — the telegram bot code and the model training code can be found in this repository (example above for simplicity, but adding generation parameters such as norepeatngramsize are recommended to get better generations)_ The following hyperparameters were used during training: — learningrate: 6e-05 — trainbatchsize: 2 — evalbatchsize: 2 — seed: 42 — distributedtype: multi-GPU — gradienta

Модальности:
Генерация текста

Задача: Генерация текста
Автор: pszemraj
Теги: gpt_neo, gpt-neo, gpt-peter, chatbot
Лайков: 2  |  Загрузок: 14

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.