INVALID LANGUAGE PAIR SPECIFIED. EXAMPLE: LANGPAIR=EN|IT USING 2 LETTER ISO OR RFC3066 LIKE ZH-CN. ALMOST ALL LANGUAGES SUPPORTED BUT SOME MAY HAVE NO CONTENT Until that is merged, this repo provides a workaround by modifying configuration files to make TranslateGemma compatible with vLLM’s standard chat API. This conversion is based entirely on the work done by Infomaniak-AI/vllm-translategemma-4b-it. The same conversion approach was applied to the 12B model. Full credit goes to the Infomaniak AI team for figuring out the necessary changes. The following files were modified from the original google/translategemma-12b-it for vLLM compatibility. All other files (model weights, tokenizer, etc.) are unchanged. — config.json — RoPE parameters simplified for vLLM — generationconfig.json — Added temperature, bostokenid, maxlength; adjusted eostokenid ordering — chattemplate.jinja` — Replaced structured content format with delimiter-based string format The…
Модальности:
Генерация текста
Области применения:
Диалог / чат Мультиязычность Перевод
Задача: Генерация текста
Автор: chbae624
Теги: gemma3, image-text-to-text, translation, vllm, translategemma, conversational, multilingual, text-generation-inference
Лайков: 4 | Загрузок: 163,819
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
