5 October 2026 image, with the launcher of 6 October: ghcr.io/eliovp/paiton-vllm-plugin:qwen38-rocm10-vllm029-20261005-r1@sha256:245c71d54f046f89b74dbfbd4c894003754561e55c9d215a8d3ce65364fb0f80. One image serves the MXFP4 path and the optional 3-bit weights, with prefix caching, images and up to 262,144 tokens per request. The plugin README has the downloads, the commands and the measurements; the launcher pins the image by digest, no registry login needed. What you get on one R9700 (all commands start with bash models/Qwen3.8-MXFP4-DFlash2/): In 20-turn coding sessions growing from about 100K to 181K tokens, the 3-bit coding mode solved 87.5 % of the tasks with no decline over the turns (MXFP4 —mode long: 83.75 %) (long-context results). The sections below document the 20 September images and the historical v1.0.0 files of this repository. They stay runnable, but the release above replaces them. Use Linux x86-64, Python 3, Docker, and one Radeon AI PRO R9700 with 32 GB VRAM and working AMD GPU device access. Run the following commands from a checkout of the public plugin repository: The images contain the runtime; download the target and draft weights separately using the…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: EliovpAI
Теги: paiton, vllm, amd, rocm, rdna4, gfx1201, mxfp4, nvfp4
Лайков: 3 | Загрузок: 0
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
