Any feedback regarding the model its behaviour is very welcome. In V1 i experimented with a giraffe base but i noticed the giraffe version quickly lossed the long context ability. This model was merged using the breadcrumbs_ties merge method using Llama-3-70B-Instruct-Gradient-262k as a base. The following models were included in the merge: Llama-3-Lumimaid-70B-v0.1-OAS Smaug-Llama-3-70B-Instruct * Llama-3-70B-Instruct-abliterated-v3 The following YAML configuration was used to produce this model:
Модальности:
Генерация текста
Области применения:
Следование инструкциям Диалог / чат
Задача: Генерация текста
Автор: ryzen88
Теги: llama, mergekit, merge, llama 3, smaug, lumimaid, abliterated, gradent
Лайков: 3 | Загрузок: 34
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.