This model will generate instructions given some text. It is useful for labelling unlabeled datasets. It’s based on a llama 7B model with 32k context length (togethercomputer/LLaMA-2-7B-32K). It was trained across the reverse-instruct dataset for 2 epochs. Final validation loss was .72, with rouge-l of .66 . Here is an inference example, with some random text from falcon-refinedweb: And the output instruction for the above example would be: Write a product review for the SE3 Condenser Microphone from SE Electronics Sonic Distribution. It works with code, too, although llama-7b is undertrained on code.
Модальности:
Генерация текста
Области применения:
Следование инструкциям
Задача: Генерация текста
Автор: vikp
Теги: llama, custom_code, text-generation-inference, endpoints_compatible
Лайков: 3 | Загрузок: 10
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
