The model is a version of the SFT that trained on purpose to do DPO on Yi model. I was unable to resolve the OOM issue while trying to train DPO, so I am only uploading the SFT. If you would like to DPO on that model, please use the maywell/whynoonedodpoonyi dataset. Below code used to load maywell/whynoonedodpoonyi dataset on axolotl.
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: maywell
Теги: llama, conversational, text-generation-inference, endpoints_compatible
Лайков: 2 | Загрузок: 15
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.