— EXL2: 2.4bpw | 2.65bpw | 2.9bpw | 4.0bpw — GGUF: IQ3XXS | Q4KS+Q4K_M — HF: wolfram/miquliz-120b This is a 120b frankenmerge created by interleaving layers of miqu-1-70b-sf with lzlv70bfp16_hf using mergekit. Thanks for the support, CopilotKit — the open-source platform for building in-app AI Copilots into any product, with any LLM model. Check out their GitHub. Thanks for the EXL2 and GGUF quants, Lone Striker and NanoByte! See also: 🐺🐦⬛ LLM Prompt Format Comparison/Test: Mixtral 8x7B Instruct with 17 different instruct templates : LocalLLaMA The following YAML configuration was used to produce this model: — 1st model: — original (unreleased) model: mistralai (Mistral AI) — leaked model: miqudev/miqu-1-70b — f16 model: 152334H/miqu-1-70b-sf — 2nd model: lizpreciatior/lzlv70bfp16hf — mergekit: arcee-ai/mergekit: Tools for merging pretrained large language models. — mergekit_config.yml: alpindale/goliath-120b — My Ko-fi page if you’d like to tip me to say thanks or request specific models to be tested or merged with priority. Also consider supporting your favorite model creators, quantizers, or frontend/backend devs if you can afford to do so. They deserve it!
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: LoneStriker
Теги: llama, mergekit, merge, conversational, en, de, fr, es
Лайков: 3 | Загрузок: 15
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
