這是一個於llama2 7B Chat上訓練的Lora,其資料集使用了大量的AI生成的對話範例，使llama2 7B能夠盡可能地維持原本充滿活力的對話方式，並能在繁體中文的情況下更加擅長去扮演除了助手以外的角色 This is a Lora trained on llama2 7B Chat, with its dataset consisting of a large number of AI-generated conversation examples. This training allows llama2 7B to maintain its original vibrant conversational style as much as possible and excel in roles other than just being an assistant, especially in Chinese contexts. 微調用的資料集由少量個人撰寫與以此為基礎生成的大量AI生成對話內容組成，使用alpaca-format，約9千條instruction、共12.6MB的大小 The fine-tuning dataset used consists of a small number of personally written conversations and a large amount of AI-generated dialogue content based on these, utilizing the alpaca-format. It comprises approximately 7,000 instructions in total and has a size of 9MB. 使用text-generation-webui中的Training工具，在google colab上調用V100，以4bit模式讀取Llama2 7B後以Lora Rank64,Lora Alpha128,Epochs5,其餘用預設參數訓練，訓練總計花費約5小時 Using the Training tool in the text-generation-webui, calling a V100 on Google Colab, and reading Llama2 7B in 4-bit mode, training was performed with default parameters. The total training time took approximately 2 hours 這是個lora，你必須先行讀取Llama2 7B，再讀取Llama2-7BTraditionalChineseroleplaychat_lora…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: Tarklanse
Теги: peft, zh, en
Лайков: 2 | Загрузок: 7
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
