INVALID LANGUAGE PAIR SPECIFIED. EXAMPLE: LANGPAIR=EN|IT USING 2 LETTER ISO OR RFC3066 LIKE ZH-CN. ALMOST ALL LANGUAGES SUPPORTED BUT SOME MAY HAVE NO CONTENT For Arabic: in August 2023 I would recommend the bilingual JAIS model, which is also 13B parameters can be quantized. In August 2023 AI-Forever added 1.3B-param models for 20+ languages. If your language is Mongolian, for example, it might be better to use mGPT-1.3B-mongol and not this one. They also have a 1.3B param model for all languages, which I further quantized here: https://huggingface.co/monsoon-nlp/mGPT-quantized Quantization of mGPT-13B was done using bitsandbytes library, CoLab Pro with an A100 GPU, and a lot of space on Google Drive. — mGPT could be further quantized (4-bit), but model.savepretrained() currently throws a NotImplementedError` error.
Модальности:
Генерация текста
Области применения:
Мультиязычность
Задача: Генерация текста
Автор: monsoon-nlp
Теги: gpt2, multilingual, ar, hi, id, text-generation-inference, endpoints_compatible, 8-bit
Лайков: 2 | Загрузок: 12
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
