This repository contains the DCOCO (DFlash Contextual Corrector) speculative-decoding drafter for NVIDIA Nemotron 3.5 Super VL 120B-A12B, from the paper Contextual Correction of Parallel Drafts for Speculative Decoding. It is a draft model: serve it together with NVIDIA Nemotron 3.5 Super VL 120B-A12B, which verifies every token, so the output distribution is exactly the target model’s. Paper: Contextual Correction of Parallel Drafts for Speculative Decoding Code: github.com/two-delta/DCOCO Diffusion-style drafters such as DFlash propose a whole block of tokens in a single pass, but each position is predicted without seeing which tokens were chosen before it. DCOCO keeps the top-16 candidates at every drafted position and scores how well each candidate fits each candidate at the next position, using candidate representations and a pair state over adjacent slots, all in one small batched pass. A prefix-first walk over those scores then picks the draft. This restores intra-block dependencies at a cost of a few percent of the drafting cycle. DCOCO runs in vLLM, through the speculative-decoding dflash method; vLLM selects the corrector from the checkpoint’s DCOCODraftModel…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: TD-Labs
Теги: vllm, qwen3, speculative-decoding, dcoco, dflash, draft-model, nemotron
Лайков: 3 | Загрузок: 259
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.