This is a bilingual Mistral chat / instruct model trained in both English and Welsh languages. The model is based on BangorAI/mistral-7b-cy-epoch-2 which is a continual pre-training of the Mistral-7B-v0.1 model with Welsh data from the allenai/MADLAD-400 dataset for 2 epochs. The model was then fine-tuned using the yahma/alpaca-cleaned dataset in both Welsh and English languages, also for 2 epochs. An online demo of the model can be found at https://demo.bangor.ai It’s an experimental LLM, so don’t take any response from the model seriously or as factually correct. You are responsible for any output you generate. The language of the system prompt will guide the LLM as to which language it should respond in. For example, in English: Contains information from allenai/MADLAD-400 which is made available under the ODC Attribution License.
Модальности:
Генерация текста
Задача: Генерация текста
Автор: BangorAI
Теги: mistral, cy, en, text-generation-inference, endpoints_compatible
Лайков: 3 | Загрузок: 32
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
