Another experimental model. This one is in the vein of advanced 2.1, but we replace the simpo model used in the original recipe, with a different simpo model, that was more finetuned with writing in mind, ifable. We also use another writing model, which was trained on gutenberg. We use this one at a higher density because SPPO, on paper is the superior training method, to simpo, and quite frankly, ifable is finicky to work with, and can end up being a little too strong.. or heavy in merges. It’s a very strong writer but it introduced quite a bit slop in v2. This is a merge of pre-trained language models created using mergekit. https://huggingface.co/lemon07r/Gemma-2-Ataraxy-v3i-9B-Q8_0-GGUF This model was merged using the della merge method using unsloth/gemma-2-9b-it as a base. The following models were included in the merge: nbeerbower/Gemma2-Gutenberg-Doppel-9B ifable/gemma-2-Ifable-9B * wzhouad/gemma-2-9b-it-WPO-HB The following YAML configuration was used to produce this model:
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: lemon07r
Теги: gemma2, mergekit, merge, conversational, model-index, text-generation-inference, endpoints_compatible
Лайков: 3 | Загрузок: 24
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
