If you find this model helpful, please like this model and star us on https://github.com/LianjiaTech/BELLE ! The code of inference can be found in our Github project repository: https://github.com/LianjiaTech/BELLE/tree/main/gptq. Basically, 4-bit quantization and 128 groupsize are recommended. There still exists a few issues in the model trained on current base model and data: 1. The model might generate factual errors when asked to follow instructions related to facts. 2. Occasionally generates harmful responses since the model still struggles to identify potential harmful instructions. Since the model still has its limitations, we require developers only use the open-sourced code, data, model and any other artifacts generated via this project for research purposes. Commercial use and other potential harmful use cases are not allowed. Cite the original BLOOM, Stanford Alpaca and Self-Instruct papers as well! 如果您觉得此模型对您有帮助,请like此模型并在https://github.com/LianjiaTech/BELLE 项目中star我们! 此模型的推理代码请见https://github.com/LianjiaTech/BELLE/tree/main/models/gptq . 基于以上模型局限性,我们要求开发者仅将我们开源的代码、数据、模型及后续用此项目生成的衍生物用于研究目的,不得用于商业,以及其他会对社会带来危害的用途。
Модальности:
Генерация текста
Задача: Генерация текста
Автор: BelleGroup
Теги: bloom, text-generation-inference, endpoints_compatible
Лайков: 3 | Загрузок: 22
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.