INVALID LANGUAGE PAIR SPECIFIED. EXAMPLE: LANGPAIR=EN|IT USING 2 LETTER ISO OR RFC3066 LIKE ZH-CN. ALMOST ALL LANGUAGES SUPPORTED BUT SOME MAY HAVE NO CONTENT ExLlamaV3 Direct Python API for embedding the model in your own code or pipeline. Quantization recipe (advanced, embedded in quantization_config.json) Loaded automatically by every ExLlamaV3 loader; reproduced here for searchability. > [!IMPORTANT] > Use and license follow the base model. > Quantization adds no additional restrictions. Refer to the upstream repository for terms, citation, and safety documentation. Quantized with BlockQuant · convention {org}/{model}-exl3-{bpw}bpw First EXL3 of this architecture. Loading needs exllamav3 with OpenPanguV2 support from Honkware/exllamav3@openpangu; stock exllamav3 releases will not load it yet. mHC, MoME conv, attention sink and DSA…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: blockblockblock
Теги: exllamav3, openpangu_v2, exl3, quantized, mixture-of-experts, conversational, custom_code, 4-bit
Лайков: 3 | Загрузок: 20
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
