Chat & support: TheBloke’s Discord server Want to contribute? TheBloke’s Patreon page TheBloke’s LLM work is generously supported by a grant from andreessen horowitz (a16z) — Model creator: VAGO solutions — Original model: SauerkrautLM Mixtral 8X7B Instruct This repo contains GPTQ model files for VAGO solutions’s SauerkrautLM Mixtral 8X7B Instruct. Multiple GPTQ parameter permutations are provided; see Provided Files below for details of the options provided, their parameters, and the software used to create them. AWQ model(s) for GPU inference. GPTQ models for GPU inference, with multiple quantisation parameter options. 2, 3, 4, 5, 6 and 8-bit GGUF models for CPU+GPU inference VAGO solutions’s original unquantised fp16 model in pytorch format, for GPU inference and for further conversions GPTQ models are currently supported on Linux (NVidia/AMD) and Windows (NVidia only). macOS users: please use GGUF models. These GPTQ models are known to work in the following inference servers/webuis. — text-generation-webui — KoboldAI United — LoLLMS Web UI — Hugging Face Text Generation Inference (TGI) This may not be a complete list; if you know of others, please let me know! Multiple…
Модальности:
Генерация текста
Области применения:
Следование инструкциям Диалог / чат
Задача: Генерация текста
Автор: TheBloke
Теги: mixtral, mistral, finetune, dpo, Instruct, augmentation, german, conversational
Лайков: 3 | Загрузок: 129
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
