This version of Qwen2.5-1.5B-Instruct has been converted to run on the RK3588 NPU using [‘w8a8’, ‘w8a8g128’, ‘w8a8g256’, ‘w8a8_g512’] quantization. This model has been optimized with the following LoRA: Pretty much anything by these folks: marty1885 and happyme531 Converted using https://github.com/c0zaut/ez-er-rkllm-toolkit Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2: — Significantly more knowledge and has greatly improved capabilities in coding and mathematics, thanks to our specialized expert models in these domains. — Significant improvements in instruction following, generating long texts (over 8K tokens), understanding structured data (e.g, tables), and generating structured outputs especially JSON. More resilient to the diversity of system prompts, enhancing role-play implementation and condition-setting for chatbots. — Long-context Support up to 128K tokens and can generate up to 8K tokens. — Multilingual support for over 29 languages, including Chinese, English,…
Модальности:
Генерация текста
Области применения:
Диалог / чат Следование инструкциям
Задача: Генерация текста
Автор: c01zaut
Теги: qwen2, chat, conversational, en, endpoints_compatible
Лайков: 3 | Загрузок: 22
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
