This repository presents Persian Gemma 2b, an early-stage experimental model derived from Google’s Gemma-2-2b-it. It has been fine-tuned using QLoRA on the mshojaei77/Persiansft dataset to explore its capabilities in Persian language conversational tasks.** Base Model: google/gemma-2-2b-it Architecture Type: Gemma2ForCausalLM Model Size: 2 billion parameters. Description: Persian Gemma 2b inherits the architecture of Gemma-2-2b-it, a lightweight yet capable model known for its efficiency and strong performance for its size. It is designed for text generation tasks and is particularly suited for conversational applications. The model uses standard transformer layers with attention mechanisms, enabling it to process and generate text in Persian. Dataset Name: mshojaei77/Persiansft Dataset Description: The Persiansft dataset is a collection of Persian conversations designed for instruction fine-tuning of language models. It likely contains examples of user queries and desired model responses in Persian, formatted for conversational fine-tuning. Dataset Type: Supervised Fine-tuning (SFT) dataset for conversational AI. Language: Primarily Persian (fa). * Severe…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: mshojaei77
Теги: gguf, gemma2, conversational, persian, gemma, qlora, fine-tuned, experimental
Лайков: 4 | Загрузок: 59
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
