The first commercially available language model released by Nous Research! Redmond-Puffin-13B is one of the worlds first llama-2 based, fine-tuned language models, leveraging a hand curated set of 3K high quality examples, many of which take full advantage of the 4096 context length of Llama 2. This model was fine-tuned by Nous Research, with LDJ leading the training and dataset curation, along with significant dataset formation contributions by J-Supha. Special thank you to Emozilla for assisting with training experimentations and many issues encountered during training. Notable mentions for assisting in some of the training issues goes to: Caseus and Teknium. Redmond-Puffin-13B-V1.3 is a new model trained for multiple epochs on a dataset of 3,000 carefully curated GPT-4 examples, most of which are long context conversations between a real human and GPT-4. Additional data came from carefully curated sub sections of datasets such as CamelAI’s Physics, Chemistry, Biology and Math. The original Puffin model was loved by many, however it was quickly discovered to have dataset errors in a significant amount of the conversations. Puffin-V1.3 dataset solves this issue and the resulting…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: 4bit
Теги: llama, llama-2, sft, eng, text-generation-inference, endpoints_compatible
Лайков: 2 | Загрузок: 10
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
