Considering LLaMA’s license constraints, the model is for research and learning only. Please strictly respect LLaMA’s usage policy. We are not allowed to publish weights for LLaMA, of course, even finetuned, but there is no problem publishing the difference, a patch that we suggest to apply to the files. The encryption is a simple XOR between files, ensuring that only the people that have access to the original weights (from completely legal sources, of course) can transform them into finetuned weights. You can find the decrypt code on https://github.com/LianjiaTech/BELLE/tree/main/models . If you find this model helpful, please like this model and star us on https://github.com/LianjiaTech/BELLE ! The code of inference can be found in our Github project repository: https://github.com/LianjiaTech/BELLE/tree/main/gptq. Basically, 8-bit quantization and 128 groupsize are recommended. 2. Decrypt the files using the scripts in https://github.com/LianjiaTech/BELLE/tree/main/models You can use the following command in Bash. Please replace «/path/toencrypted» with the path where you stored your encrypted file, replace «/path/tooriginalllama7B» with the path where you stored your original…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: BelleGroup
Теги: text2text-generation, zh, en
Лайков: 2 | Загрузок: 0
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
