This repository provides GGUF quantized versions of the Qwen/Qwen3.5-9B model, optimized for local execution using llama.cpp and compatible ecosystems. All quantizations were generated from the official FP16 weights. — Target: Efficient execution on consumer hardware, mobile/edge devices, and systems with limited memory. — Performance: The output quality (reasoning, coherence, and accuracy) is strictly dependent on the base model’s parameter scale (9B). — Quantization Date: 2026-03-07 — Tool used: llama-quantize (llama.cpp) — Method: K-Quantization (optimized for AVX2/AVX-512 and modern GPU architectures).
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: daniloreddy
Теги: gguf, llama.cpp, quantized, lightweight, lmstudio, jan, cobalt, text-generation-webui
Лайков: 4 | Загрузок: 9,376
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
