oQ6e (imatrix-enhanced mixed-precision ~6.5 BPW) quantization of the merged IFM/K2-Horizon-7B-Uno model — a diffusion-augmented LLM based on K2-Horizon-7B. The LoRA adapter is baked into the base weights, so it runs as a standard autoregressive model. Upstream model: IFM/K2-Horizon-7B-Uno by Institute of Foundation Models, released under Apache 2.0. Conversion: Merged using PyTorch + PEFT, validated with text generation, then quantized to MLX format using Hermes Agent with oMLX. K2-Horizon-7B is a reasoning model. Always use reasoningeffort=»high»`: K2-Horizon requires oMLX v0.6.4+ with the K2-Horizon support patch.
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: mlx-community
Теги: mlx, k2_horizon, apple-silicon, uno, oQ, oQ6e, conversational, custom_code
Лайков: 3 | Загрузок: 213
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
