eunyounglee/GPT-NeoX-2.7B-Vietnamese-finetune

This model is pretrained and fine-tuned with Vietnamese language, based on GPT-NeoX which is a large language model developed by EleutherAI. — Pre-train: Culturax Vietnamese Dataset(450GB) + AI-Hub Vietnamese Dataset(1.3GB) + Crawled Vietnamese Wikipedia Dataset(630MB) + viwik18 Dataset(1.27GB) — Fine-tuning: 12MB Vietnamese Question & Answer dataset Vietnamese Alpaca(16412 rows) + Vietnamese QA Dataset based on viwik18(14293 rows) Trained on A100 40GB GPU and 48 core CPU. Took 18 hours to reach 10 epochs. The model can be loaded using the AutoModelForCausalLM functionality:

Модальности:
Генерация текста

Задача: Генерация текста
Автор: eunyounglee
Теги: gpt_neox, vie, text-generation-inference, endpoints_compatible
Лайков: 3  |  Загрузок: 34

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.