CallComply/DeciLM-7B-Instruct-128k - Каталог нейросетей
Генерация текста

CallComply/DeciLM-7B-Instruct-128k

Добавлено:
CallComply/DeciLM-7B-Instruct-128k

DeciLM-7B-instruct is a model for short-form instruction following. It is built by LoRA fine-tuning on the SlimOrca dataset. DeciLM-7B-instruct is a derivative of the recently released DeciLM-7B language model, a pre-trained, high-efficiency generative text model with 7 billion parameters. DeciLM-7B-instruct is one the best 7B instruct models obtained using simple LoRA fine-tuning, without relying on preference optimization techniques such as RLHF and DPO. — Developed by: Deci — Model type: DeciLM is an auto-regressive language model using an optimized transformer decoder architecture that includes variable Grouped-Query Attention. — Language(s) (NLP): English — License: Apache 2.0 AutoNAC was employed to optimize the selection of the GQA numkeyvalueheads for each model layer. — Blog: DeciLM-7B Technical Blog — Demo: DeciLM-7B-instruct Demo — Finetuning Notebook: DeciLM-7B Finetuning Notebook — Text Generation Notebook: DeciLM-7B-instruct Text Generation Notebook The model is intended for commercial and research use in English. Below are DeciLM-7B and DeciLM-7B-instruct’s evaluation results. — In order to replicate the results of the Hugging Face benchmarks, you can use this code…

Модальности:
Генерация текста

Области применения:
Диалог / чат Следование инструкциям


Задача: Генерация текста
Автор: CallComply
Теги: deci, conversational, custom_code, en
Лайков: 3  |  Загрузок: 26

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.