Document Title h1 { font-size: 36px; color: navy; font-family: ‘Tahoma’; text-align: center; } Introducing the Kancil family of open models Kancil is a fine-tuned version of Llama 3 8B using synthetic QA dataset generated with Llama 3 70B. Version zero of Kancil is the first generative Indonesian LLM gain functional instruction performance using solely synthetic data. ❕Go straight to the colab demo❕ Beta preview I am ultra-overjoyed to introduce you… the 🦌 Kancil! It’s a fine-tuned version of Llama 3 8B with the TumpengQA, an instruction dataset of 6.7 million words. Both the model and dataset is openly available in Huggingface. 📚 The dataset was synthetically generated from Llama 3 70B. A big problem with existing Indonesian instruction dataset is they’re in reality not-very-good-translations of English datasets. Llama 3 70B can generate fluent Indonesian! (with minor caveats 😔) 🦚 This follows previous efforts for collection of open, fine-tuned Indonesian models, like Merak and Cendol. However, Kancil solely leverages synthetic data in a very creative way, which makes it a very unique contribution! This is the very first working prototype, Kancil V0. It supports basic QA…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: afrizalha
Теги: llama, unsloth, llama3, indonesia, id, text-generation-inference, 8-bit
Лайков: 3 | Загрузок: 20
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
