This model is a fine-tuned version of gpt2 on an unknown dataset. It achieves the following results on the evaluation set: — Loss: 1.8095 The following hyperparameters were used during training: — learningrate: 0.0001 — trainbatchsize: 32 — evalbatchsize: 32 — seed: 42 — gradientaccumulationsteps: 4 — totaltrainbatchsize: 128 — optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 — lrschedulertype: linear — numepochs: 3 — mixedprecision_training: Native AMP — Transformers 4.16.2 — Pytorch 1.9.1 — Datasets 1.18.4 — Tokenizers 0.11.6
Модальности:
Генерация текста
Задача: Генерация текста
Автор: bipin
Теги: tensorboard, gpt2, generated_from_trainer, text-generation-inference, endpoints_compatible
Лайков: 3 | Загрузок: 14
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.