tekkonetes/fineneo

> Created by Tekkonetes with debugging help from ChatGPT. > @Tekkonetes (HuggingFace) / @pxlmastrXD (Replit) So, you want to fine-tune a GPT-Neo model? Well, here’s the simplest script you will get. It uses a text dataset to fine-tune, and it also will tune the model fairly quickly. Normally, it takes about 5 seconds for an epoch to finish, so here are some estimated times: Yes, it’s fairly fast. However, it depends on which GPT-Neo model you’re fine-tuning. For example, the chart above is the EleutherAI/GPT-Neo-125M model. If you use the Gpt-Neo-1.3B model, it will probably take longer. First, download the tune.py file to your computer. Then (optional) set up a virtual environment: Finally, create your dataset, modify the file to use the dataset, and run the python script. Your model and tokenizer will appear in the fine-tuned-gpt-neo directory. You can then use transformers to run the model, or upload the files to the HuggingFace hub.

Модальности:
Генерация текста

Задача: Генерация текста
Автор: tekkonetes
Теги: gpt_neo, gpt2, en, endpoints_compatible
Лайков: 3  |  Загрузок: 13

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.