vrfai/gemma-4-E4B-it-fp8

FP8 quantized version of google/gemma-4-E4B-it (8B params, edge model). Produced and maintained by vrfai. This model was quantized using NVIDIA ModelOpt with the following configurations: You can deploy this model using vLLM with the modelopt quantization backend. Please ensure you refer to the vLLM documentation for Gemma 4 for advanced serving options. The recipes and scripts used to quantize this model can be found in the following repository: — VinRobotics/model-quantization-recipes

Модальности:
Генерация текста

Области применения:
Диалог / чат

Задача: Генерация текста
Автор: vrfai
Теги: gemma4, image-text-to-text, fp8, quantized, vrfai, conversational, endpoints_compatible, modelopt
Лайков: 4  |  Загрузок: 843

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.