Gemma-2-Llama-Swallow series was built by continual pre-training on the gemma-2 models. Gemma 2 Swallow enhanced the Japanese language capabilities of the original Gemma 2 while retaining the English language capabilities. We use approximately 200 billion tokens that were sampled from a large Japanese web corpus (Swallow Corpus Version 2), Japanese and English Wikipedia articles, and mathematical and coding contents, etc (see the Training Datasets section of the base model) for continual pre-training. The instruction-tuned models (it) were built by supervised fine-tuning (SFT) on the synthetic data specially built for Japanese. See the Swallow Model Index section to find other model variants. Built with Gemma. Built with Llama. — May 19, 2025: Released Gemma-2-Llama-Swallow-2b-pt-v0.1, Gemma-2-Llama-Swallow-9b-pt-v0.1, Gemma-2-Llama-Swallow-27b-pt-v0.1, Gemma-2-Llama-Swallow-2b-it-v0.1, Gemma-2-Llama-Swallow-9b-it-v0.1, and Gemma-2-Llama-Swallow-27b-it-v0.1. The website https://swallow-llm.github.io/ provides large language models developed by the Swallow team. — Model type: Please refer to Gemma 2 paper for details on the model architecture. — Language(s): Japanese, English -…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: tokyotech-llm
Теги: gemma2, conversational, en, ja, text-generation-inference, endpoints_compatible
Лайков: 4 | Загрузок: 615
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.