@import url(‘https://fonts.googleapis.com/css2?family=Vollkorn:ital,wght@0,400..900;1,400..900&display=swap’); We are thrilled to unveil palmer-004, the fourth iteration in our esteemed palmer series, designed to push the boundaries of performance and context window capacity. Merging the best of palmer-003 with the expansive capabilities of palmer-002-32k, palmer-004 is a testament to the power of merging similar trained models, think of it as palmer-003 with 32k context with minimal performance degradation. Crafted using the TIES merge method, palmer-004 elevates its predecessor’s prowess to a remarkable 32k context window without needing to train on additional data. This model doesn’t just aim to match; it surpasses, outperforming the current state-of-the-art coventiny1.1b32korpo_alpha on several benchmarks. As of June 1, 2024, palmer-004 stands as the 2nd best 1b overall model as well as the best 32k 1B model to fine-tune from on Hugging Face, setting a new standard for excellence in the open-source AI community. If you are using Windows, you can now support me by purchasing a copy of quark, a cool text editor that uses language models. Still in beta but super cool still.
Модальности:
Генерация текста
Задача: Генерация текста
Автор: appvoid
Теги: llama, mergekit, merge, text-generation-inference, endpoints_compatible
Лайков: 3 | Загрузок: 15
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
