— Model Architecture: Qwen3NextForCausalLM — Input: Text — Output: Text — Model Optimizations: — Weight quantization: FP8 — Activation quantization: FP8 — Release Date: — Version: 1.0 — Model Developers:: Red Hat This model was obtained by quantizing the weights and activations of Qwen/Qwen3-Coder-Next to FP8 data type. This optimization reduces the number of bits per parameter from 16 to 8, reducing the disk size and GPU memory requirements by approximately 50%. Only the weights and activations of the linear operators within transformers blocks of the language model are quantized. This model was quantized using the llm-compressor library as shown below. The model was evaluated on the OpenLLM leaderboard task, using lm-evaluation-harness. vLLM was used for all evaluations.
Модальности:
Генерация текста
Области применения:
Диалог / чат Генерация кода
Задача: Генерация текста
Автор: RedHatAI
Теги: qwen3_next, fp8, quantized, llm-compressor, compressed-tensors, red hat, conversational
Лайков: 3 | Загрузок: 93,817
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
