— MiniMaid-L2 is a Finetuned Model of MiniMaid-L1 model, with even big and higher quality dataset used to generated roleplaying Capabilities, MiniMaid-L2 also were extracted from Knowledge Distilling A Popular Roleplaying Model named NoroMaid-7B-DPO, Which we’ve used to enchanced its lacking Ends for coherent And Good Roleplaying Capabilities. — MiniMaid-L2 Outcompete its predecessor as it uses a Clever Knowledge distilling to transfer Knowledge from NoroMaid, And Finetuned it, building on top of MiniMaid-L1 to Produce a better AI model. Sacrificing Some Non-noticable Token-Generation speed, with a near perfect and Competitive Model against 3b Alternatives! — MiniMaid-L1 achieve a good Performance through process of DPO and Combined Heavy Finetuning, To Prevent Overfitting, We used high LR decays, And Introduced Randomization techniques to prevent the AI from learning and memorizing, However since training this on Google Colab is difficult, the Model might underperform or underfit on specific tasks Or overfit on knowledge it manage to latched on! However please be guided that we did our best, and it will improve as we move onwards! — MiniMaid-L2 is Another Instance of Our Smallest…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: N-Bot-Int
Теги: peft, unsloth, Uncensored, text-generation-inference, llama, trl, roleplay, conversational
Лайков: 3 | Загрузок: 29
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
