Cendol is an open-source collection of fine-tuned generative large language models in Indonesian languages covering decoder-only and encoder-decoder transformer model architectures ranging in scale from 300 million to 13 billion parameters. This is the repository for the 13B Cendol LLaMA-2 Instruct model. Links to other models can be found below. IndoNLP developed and publicly released the Cendol family of large language models (LLMs), a collection of pretrained and fine-tuned generative text models ranging in scale from 560 million to 13 billion parameters. Cendol models cover two instruction-tuned versions: 1. Cendol-Instruct that is instruction-tuned on tasks-specific NLP data such as sentiment analysis, topic modeling, machine translation, summarization, question answering, paraphrasing, etc 2. Cendol-Chat that is continuously instruction-tuned from Cendol-Instruct on general knowledge and human-centric prompts. Both Cendol-Instruct and Cendol-Chat are designed for a single-turn conversation. Cendol outperforms open-source multilingual and region-specific LLMs on most benchmarks we tested by a huge margin, with the smaller version ( Cendol comes from 2 base models (mT5 and…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: indonlp
Теги: llama, id, su, jv, text-generation-inference, endpoints_compatible
Лайков: 2 | Загрузок: 8
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.