Genstruct 7B is an instruction-generation model, designed to create valid instructions given a raw text corpus. This enables the creation of new, partially synthetic instruction finetuning datasets from any raw-text corpus. Previous methods largely rely on in-context approaches to generate instructions, while Ada-Instruct trained a custom instruction-generation model. Inspired by this, we took this approach further by grounding the generations in user-provided context passages. Further, the model is trained to generate questions involving complex scenarios that require detailed reasoning, allowing for models trained on the generated data to reason step-by-step. An example notebook is provided here, which details how to load and sample from the model. The input is the text up to and including «[[[User]]] «, and the completion is everything that follows. bibtext @misc{Genstruct, url={https://https://huggingface.co/NousResearch/Genstruct-7B}, title={Genstruct}, author={«euclaise»} } «`
Модальности:
Генерация текста
Области применения:
Следование инструкциям Диалог / чат
Задача: Генерация текста
Автор: Goekdeniz-Guelmez
Теги: gguf, mistral, Mistral, instruct, finetune, synthetic, conversational, en
Лайков: 3 | Загрузок: 205
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
