https://github.com/spydaz — Developed by: LeroyDyer — License: apache-2.0 — Finetuned from model : LeroyDyer/MixtralAIVision-Instruct_X To use the multimodal capabilities of this model and use vision you need to load the specified mmproj file, this can be found inside this model repo. (LeroyDyer/MixtralAIVision-Instruct_X) You can load the mmproj** by using the corresponding section in the interface: For loading 4-bit use 4-bit mmproj file.- mmproj-MixtralAIVision-InstructX-Q4_0 For loading 8-bit use 8 bit mmproj file — mmproj-MixtralAIVision-InstructX-Q8_0 For loading 8-bit use 8 bit mmproj file — mmproj-MixtralAIVision-InstructX-f16 Instruction format In order to leverage instruction fine-tuning, your prompt should be surrounded by [INST] and [/INST] tokens. The very first instruction should begin with a begin of sentence id. The next instructions should not. The assistant generation will be ended by the end-of-sentence token id. This mistral model was trained 2x faster with Unsloth and Huggingface’s TRL library.
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: LeroyDyer
Теги: gguf, llava, text-generation-inference, unsloth, mistral, trl, sft, conversational
Лайков: 3 | Загрузок: 175
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
