A Llama-3 Decoder only model by combining 2x finetuned Llama-3 70B models into 1. The following models were included in the merge: Steelskull/L3-MS-Astoria-70b Sao10K/L3-70B-Euryale-v2.1 The following YAML configuration was used to produce this model: As both models are based off from instruct, Use the default Llama 3 Instruct format would be fine. The original ratios come from Goliath and are used as is. As such thanks to both Alpindale and @Undi95 for their inital work. Credits goes to @chargoddard for developing the framework used to merge the model — mergekit.
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: KaraKaraWarehouse
Теги: llama, mergekit, merge, conversational, text-generation-inference, endpoints_compatible
Лайков: 3 | Загрузок: 14
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.