Unsloth Dynamic 2.0 achieves superior accuracy & outperforms other leading quants. > [!Note] > This repository corresponds to the 270m instruction-tuned version of the Gemma 3 model using Quantization Aware Training (QAT). > > The checkpoint in this repository is unquantized, please make sure to quantize with Q40 with your favorite tool > > Thanks to QAT, the model is able to preserve similar quality as bfloat16` while significantly reducing the memory requirements > to load the model. [Gemma 3 Technical Report][g3-tech-report] [Responsible Generative AI Toolkit][rai-toolkit] [Gemma on Kaggle][kaggle-gemma] [Gemma on Vertex Model Garden][vertex-mg-gemma3] Summary description and brief definition of inputs and outputs. Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models. Gemma 3 models are multimodal, handling text and image input and generating text output, with open weights for both pre-trained variants and instruction-tuned variants. Gemma 3 has a large, 128K context window, multilingual support in over 140 languages, and is available in more sizes than previous versions.…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: unsloth
Теги: gemma3_text, gemma3, unsloth, gemma, google, conversational, text-generation-inference, endpoints_compatible
Лайков: 3 | Загрузок: 368
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
