This model is a fine-tuned version of gpt2-large on the customized dataset. The following hyperparameters were used during training: — learningrate: 0.00013 — trainbatchsize: 1 — evalbatchsize: 8 — seed: 42 — distributedtype: multi-GPU — numdevices: 6 — totaltrainbatchsize: 6 — totalevalbatchsize: 48 — optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 — lrschedulertype: linear — numepochs: 2.5 — Transformers 4.32.1 — Pytorch 2.0.1+cu117 — Datasets 2.10.1 — Tokenizers 0.13.3
Модальности:
Генерация текста
Задача: Генерация текста
Автор: Mikivis
Теги: gpt2, generated_from_trainer, text-generation-inference, endpoints_compatible
Лайков: 2 | Загрузок: 125
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.