4bit/Qwen-14B-Chat-Int4 - Каталог нейросетей
Генерация текста

4bit/Qwen-14B-Chat-Int4

Добавлено:

🤗 Hugging Face&nbsp&nbsp | &nbsp&nbsp🤖 ModelScope&nbsp&nbsp | &nbsp&nbsp 📑 Paper&nbsp&nbsp | &nbsp&nbsp🖥️ Demo WeChat (微信)&nbsp&nbsp | &nbsp&nbsp DingTalk (钉钉) &nbsp&nbsp | &nbsp&nbspDiscord&nbsp&nbsp 通义千问-14B(Qwen-14B)是阿里云研发的通义千问大模型系列的140亿参数规模的模型。Qwen-14B是基于Transformer的大语言模型, 在超大规模的预训练数据上进行训练得到。预训练数据类型多样,覆盖广泛,包括大量网络文本、专业书籍、代码等。同时,在Qwen-14B的基础上,我们使用对齐机制打造了基于大语言模型的AI助手Qwen-14B-Chat。本仓库为Qwen-14B-Chat的Int4量化模型的仓库。 Qwen-14B is the 14B-parameter version of the large language mode Tongyi Qianwen), proposed by Alibaba Cloud. Qwen-14B is a Transformer-based large language model, which is pretrained on a large volume of data, including web texts, books, codes, etc. Additionally, based on the pretrained Qwen-14B, we release Qwen-14B-Chat, a large-model-based AI assistant, which is trained with alignment techniques. This repository is the one for the Int4 quantized model of Qwen-14B-Chat. For more details about the open-source model of Qwen-14B, please refer to the Github code repository. python 3.8及以上版本 pytorch 2.0及以上版本,推荐2.0及以上版本 建议使用CUDA 11.4及以上(GPU用户、flash-attention用户等需考虑此选项) python 3.8 and above pytorch 2.0 and above, 2.0 and above are recommended CUDA 11.4…

Модальности:
Генерация текста

Области применения:
Диалог / чат


Задача: Генерация текста
Автор: 4bit
Теги: qwen, custom_code, zh, en, 4-bit, gptq
Лайков: 2  |  Загрузок: 28

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.