jondurbin/airoboros-13b-gpt4-1.2

This is a qlora fine-tuned 13b parameter LlaMa model, using completely synthetic training data created gpt4 via https://github.com/jondurbin/airoboros This is mostly an extension of 1.1, but with thousands of new training data and an update to allow «PLAINFORMAT» at the end of coding prompts to just print the code without backticks or explanations/usage/etc. The dataset used to fine-tune this model is available here, with a specific focus on: — coding — math/reasoning (using orca style ELI5 instruction/response pairs) — trivia — role playing — multiple choice and fill-in-the-blank — context-obedient question answering — theory of mind — misc/general This model was fine-tuned with a fork of qlora, which among other things was updated to use a slightly modified vicuna template to be compatible with the 7b/13b versions: So in other To run the full precision/pytorch native version, you can use my fork of FastChat, which is…

Модальности:
Генерация текста

Задача: Генерация текста
Автор: jondurbin
Теги: llama, text-generation-inference, endpoints_compatible
Лайков: 3  |  Загрузок: 57

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.