This is the AWQ quantized model of the base model, instead of chat model! CodeQwen1.5 is the Code-Specific version of Qwen1.5. It is a transformer-based decoder-only language model pretrained on a large amount of data of codes. Strong code generation capabilities and competitve performance across a series of benchmarks; Supporting long context understanding and generation with the context length of 64K tokens; Supporting 92 coding languages Excellent performance in text-to-SQL, bug fix, etc. For more details, please refer to our blog post and GitHub repo. CodeQwen1.5 is based on Qwen1.5, a language model series including decoder language models of different model sizes. It is trained on 3 trillion tokens of data of codes, and it includes group query attention (GQA) for efficient inference. The code of Qwen1.5 has been in the latest Hugging face transformers and we advise you to install transformers>=4.37.0, or you might encounter the following error: For the base language model, we do not advise you to use it for chat. You can use it for finetuning, and you can also use it for code infilling, code generation, etc., but please be careful about your stopping criteria.
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: Qwen
Теги: qwen2, pretrained, conversational, en, text-generation-inference, endpoints_compatible, 4-bit, awq
Лайков: 3 | Загрузок: 226
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.