wolfram/miquliz-120b-v2.0-4.0bpw-h6-exl2

— HF: wolfram/miquliz-120b-v2.0 — GGUF: Q2K | IQ3XXS | Q4KM | Q5KM — dranger003’s IQ2XS | IQ2XXS | IQ3XXS | Q80 — KnutJaegersberg’s IQ2XS — mradermacher’s i1-IQ1S – i1-Q5KM — mradermacher’s Q2K – Q80 — EXL2: 2.4bpw | 2.65bpw | 3.0bpw | 3.5bpw | 4.0bpw | 5.0bpw — Max Context w/ 48 GB VRAM: (24 GB VRAM is not enough, even for 2.4bpw, use GGUF instead!) — 2.4bpw: 32K (32768 tokens) w/ 8-bit cache, 21K (21504 tokens) w/o 8-bit cache — 2.65bpw: 30K (30720 tokens) w/ 8-bit cache, 1 Better than v1.0 thanks to the improved recipe adapted from TheProfessor-155b by Eric Hartford, it is now achieving top rank with double perfect scores in my LLM comparisons/tests. Thanks for the support, CopilotKit – the open-source platform for building in-app AI Copilots into any product, with any LLM model. Check out their GitHub. Thanks for the additional quants, DAN™, Knut Jägersberg, and Michael Radermacher! See also: 🐺🐦‍⬛ LLM Prompt Format Comparison/Test: Mixtral 8x7B…

Модальности:
Генерация текста

Области применения:
Диалог / чат

Задача: Генерация текста
Автор: wolfram
Теги: llama, mergekit, merge, conversational, en, de, fr, es
Лайков: 3  |  Загрузок: 24

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.