INVALID LANGUAGE PAIR SPECIFIED. EXAMPLE: LANGPAIR=EN|IT USING 2 LETTER ISO OR RFC3066 LIKE ZH-CN. ALMOST ALL LANGUAGES SUPPORTED BUT SOME MAY HAVE NO CONTENT regexerror) on Windows, or > — garbage/repeated output (> > > …) on any OS. > > You must build the patched fork described in Building the Runtime below.** There is currently no other correct way to run this GGUF with llama.cpp. This repository contains 3 quantized GGUF profiles of the K2-Horizon-MoVA-36B-A4B model, produced using Apex-Quant technology. > BPW = Bits Per Weight. Higher value = better quality. > > Note: unlike most model families, here i-balanced is larger than i-quality — it keeps all routed experts at Q5K or higher, while i-quality compresses mid-layer experts to IQ4XS. Choose based on your memory budget vs. precision preference. These models were created based on the K2-Horizon-MoVA-36B-A4B…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: vincespeed
Теги: gguf, moe, k2-horizon, mova, apex-quant, endpoints_compatible, conversational
Лайков: 3 | Загрузок: 201
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.