liminerity/phigment6-slerp - Каталог нейросетей
Генерация текста

liminerity/phigment6-slerp

Добавлено:
liminerity/phigment6-slerp

Title: Creating the Number 1 3B Parameter LLM in the World — Phigment6, A Phi-2 Based Model Using Divergent Knowledge Enhancement through Retrograde Merging Strategies (DKERS) Methodology Abstract The rapid advancements in artificial intelligence have led to the development of large language models (LLMs). In this paper, we present Phigment6, an innovative 3 billion parameter LLM built on the foundation of the Phi-2 architecture. We detail our unique methodology called Divergent Knowledge Enhancement through Retrograde Merging Strategies (DKERS), which involves the strategic combination of multiple pretrained models to create an even more powerful and accurate language model. Through this approach, we successfully merge amu/dpo-phi2, g-ronimo/phi-2-OpenHermes-2.5, vince62s/phi-2-psy, and mobiuslabsgmbh/aanaphi2-v0.1, leading to the creation of Phigment6. Our results demonstrate significant improvements in performance compared to existing state-of-the-art LLMs. Introduction Recent years have witnessed tremendous growth in natural language processing capabilities, driven by advances in deep learning techniques and the introduction of transformers in NLP tasks. Large language models…

Модальности:
Генерация текста


Задача: Генерация текста
Автор: liminerity
Теги: phi, merge, mergekit, lazymergekit, liminerity/phive, mobiuslabsgmbh/aanaphi2-v0.1, custom_code, model-index
Лайков: 3  |  Загрузок: 66

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.