Goal is to create a strong language generation model for Mongolian Since initial code and data is pretty much written by @patrickvonplaten and other huggingface members, it should not be so hard to get the first sense. A causal language modeling script for Flax is available here 1. It can be used pretty much without any required code changes. If there is time left, I’d love to try some private crawling and integrate it datasets. Lack of data → OSCAR Mongolian is just 2.2G. Maybe we need to research ways to acquire more data with this.
Модальности:
Генерация текста
Задача: Генерация текста
Автор: flax-community
Теги: jax, gpt2, mn, text-generation-inference, endpoints_compatible
Лайков: 3 | Загрузок: 10
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
