> Preview Release: This is an early preview (v0.1) for validation purposes. > Not intended for production use. Evaluation and model quality may improve in future versions. Gemma-3-Tonsai-1B is a Khmer-enhanced language model built through Continued Pre-Training (CPT) of Google’s Gemma 3 1B on a mixture of Khmer, English, and parallel data. > Note: This is a base model trained via Continued Pre-Training. It is designed as a > foundation for downstream task-specific fine-tuning (e.g., translation, summarization, > question answering). For best results, we recommend fine-tuning on your target task > using Supervised Fine-Tuning (SFT) before deployment. Evaluation on OPUS-100 (en-km) translation and Khmer perplexity tasks. Khmer Wikipedia perplexity drops dramatically (9.06 → 2.14), showing significant improvement in Khmer text prediction. CulturaX perplexity is comparable, as the model is still mid-training. Translation performance improves substantially in both directions, especially en→km zero-shot (BLEU 1.62 → 18.04). This model is a continual pre-trained base model — it has been trained to improve Khmer language understanding and generation but has not been fine-tuned for any…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: mengsay
Теги: gemma3_text, khmer, continued-pretraining, gemma3, tonsai, preview, km, en
Лайков: 3 | Загрузок: 12
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
