nitky/Superswallow-70b-v0.1 - Каталог нейросетей
Генерация текста

nitky/Superswallow-70b-v0.1

Добавлено:
nitky/Superswallow-70b-v0.1

Two potential bugs have been found in this model: — NEED repetitionpenalty — NEED high temperature`** Reference: Japanese LLM benchmark results at Nejumi LLM Leaderboad Neo The current benchmark results are worse than Swallow, which was used as a merge-based model. These bugs may be the reason for the low score, but it is also quite possible that this merged model is underperforming. The author’s experience is that the performance has improved with the test parameters. In particular, the ability to follow instructions during role play should be about 25% to 50% of the performance of the Tulu 2 DPO. I would be happy if you could try it out and give me feedback. These issue may be caused by the self-attention layers and will be fixed in the next version. (However, I don’t know if the benchmark score will improve) This model partially utilizes the parameters of Tulu V2 DPO finetuned based on Llama 2, so it may inherit the AI2 ImpACT license. Please use the model keeping in mind that there may be changes regarding the license if AI2 contacts me. The AI2 ImpACT license includes information about data artifacts and model artifacts, but does not cover the case of directly applying parts…

Модальности:
Генерация текста


Задача: Генерация текста
Автор: nitky
Теги: llama, mergekit, merge, en, ja, text-generation-inference, endpoints_compatible
Лайков: 3  |  Загрузок: 24

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.