GaMS-2B, GaMS-9B and GaMS-27B represent new improved and larger models of the GaMS (Generative Model for Slovene) familly. The models are based on Google’s Gemma 2 familly and continually pretrained on Slovene, English and some portion of Croatian, Serbian and Bosnian corpora. The model was developed within the PoVeJMo research program (Adaptive Natural Language Processing with Large Language Models), particularly within the research project titled SloLLaMai — Open-access computationally efficient models for Slovenian. The program is funded within the Recovery and Resilience Plan by the Slovenian Research and Innovation Agency (ARIS) and NextGenerationEU. The authors also acknowledge the financial support from the Slovenian Research and Innovation Agency (research core funding No. P6-0411 — Language Resources and Technologies for Slovene). We thank everyone who worked on data collection and preparation, enabling us to train our model. Special thanks go to Nikola Ljubešić, Taja Kuzman, Tjaša Arčon, Jaka Čibej, Simon Krek, Tomaž Erjavec, Iztok Kosem and Tomaž Savodnik. — Developed by: team of researchers at the University of Ljubljana, Faculty for Computer and Information Science.…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: cjvt
Теги: gemma2, sl, en, hr, sr, bs, text-generation-inference, endpoints_compatible
Лайков: 3 | Загрузок: 190
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
