Delcos/internal_chat_model_e2 - Каталог нейросетей
Генерация текста

Delcos/internal_chat_model_e2

Добавлено:
Delcos/internal_chat_model_e2

Pymalion 6B is a proof-of-concept dialogue model based on EleutherAI’s GPT-J-6B. Warning: This model is NOT suitable for use by minors. It will output X-rated content under certain circumstances. The fine-tuning dataset consisted of 56MB of dialogue data gathered from multiple sources, which includes both real and partially machine-generated conversations. Model weights were initialized from the uft-6b ConvoGPT model made available in this commit. The model was then further fine-tuned on ~48.5 million tokens for ~5k steps on 4 NVIDIA A40s using DeepSpeed. We provide a notebook with a Gradio UI for playing around with the model without having to manually format inputs. This notebook can be found here. The model can be used as a regular text generation model, but it’ll perform best if the input prompt adheres to the following format: Where [CHARACTER] is, as you can probably guess, the name of the character you want the model to portray, should be used verbatim as a delimiter token to separate persona and scenario data from the dialogue, and [DIALOGUE HISTORY] is chat history so the model can have some conversational context to draw from. Ideally it’ll be pairs of messages like:…

Модальности:
Генерация текста

Области применения:
Диалог / чат


Задача: Генерация текста
Автор: Delcos
Теги: gptj, text generation, conversational, en
Лайков: 2  |  Загрузок: 0

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.