The merge script was taken from MarinaraSpaghetti/NemoMix-Unleashed-12B. All I did was replace the models (and I couldn’t find a replacement for one of the models so I just increased the weight on one) and it seems to work pretty well. ChatML prompt format seems to work fine. Gemma 2 format seems to also work. ChatML seems cause it to incorrectly spew this at the end |im_end|> so Gemma 2 format might work better. This is a merge of pre-trained language models created using mergekit. This model was merged using the della_linear merge method using unsloth/gemma-2-9b as a base. The following models were included in the merge: crestf411/gemma2-9B-sunfall-v0.5.2 anthracite-org/magnum-v4-9b unsloth/gemma-2-9b-it nbeerbower/Gemma2-Gutenberg-Doppel-9B The following YAML configuration was used to produce this model:
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: mpasila
Теги: gemma2, mergekit, merge, conversational, text-generation-inference, endpoints_compatible
Лайков: 3 | Загрузок: 10
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
