This repository contains an EXL3 quantization of Qwen/Qwen3.8-27B for ExLlamaV3. — Model: Qwen/Qwen3.8-27B — Quantizer: exllamav3-1.4.1 — Format: exl3 — Bits per weight: 4.00 — Head bits: 8 — Calibration: 250 rows, 2048 columns — Output scales: always — Codebook: mul1 — Files: 3 sharded .safetensors files For the original model card and non-quantized weights, see Qwen/Qwen3.8-27B. > [!Note] > This repository contains model weights and configuration files for the post-trained model in the Hugging Face Transformers format. > > These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, TokenSpeed, etc. > [!Tip] > For users seeking managed, scalable inference without infrastructure maintenance, the official Qwen API service is provided by Qwen Cloud. > In particular, Qwen3.8-27B will be available as a hosted version with more production features, e.g., 1M context length by default, official built-in tools. For more information, please refer to the Qwen3.8-27B Overview. The service is coming soon. Stay tuned for updates. Following the widespread community adoption of the Qwen3.5 and Qwen3.6 series, we are pleased to introduce Qwen3.8, the most capable generation in…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: darkbit1001
Теги: exllamav3, qwen3_5, exl3, quantized, conversational, 4-bit
Лайков: 3 | Загрузок: 120
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
