LoneStriker/Yarn-Mistral-7b-128k-8.0bpw-h8-exl2 - Каталог нейросетей
Генерация текста

LoneStriker/Yarn-Mistral-7b-128k-8.0bpw-h8-exl2

Добавлено:

Nous-Yarn-Mistral-7b-128k is a state-of-the-art language model for long context, further pretrained on long context data for 1500 steps using the YaRN extension method. It is an extension of Mistral-7B-v0.1 and supports a 128k token context window. To use, pass trustremotecode=True when loading the model, for example In addition you will need to use the latest version of transformers (until 4.35 comes out) Short context benchmarks showing that quality degradation is minimal: — bloc97: Methods, paper and evals — @theemozilla: Methods, paper, model training, and evals — @EnricoShippole: Model training — honglu2875: Paper and evals The authors would like to thank LAION AI for their support of compute for this model. It was trained on the JUWELS supercomputer.

Модальности:
Генерация текста


Задача: Генерация текста
Автор: LoneStriker
Теги: mistral, custom_code, text-generation-inference, endpoints_compatible
Лайков: 2  |  Загрузок: 10

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.