An adapter for KnutJaegersberg/Yi-34B-Llamafied. 5 epochs with NEFTune. The brand new bitsandbytes 4-bit file format. Run pip install -U bitsandbytes and install this pull requested transformer version: https://github.com/poedator/transformers/tree/save4 Might still be buggy. It was a bit too early. I’ll wait until the functionality is officially supported, due to some cuda issues. I don’t want to resolve those, I’ll just wait a couple of days.
Модальности:
Генерация текста
Задача: Генерация текста
Автор: KnutJaegersberg
Теги: llama, feature-extraction, text-generation-inference, endpoints_compatible, 4-bit, bitsandbytes
Лайков: 2 | Загрузок: 5
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.