A DFlash speculative-decoding drafter for Qwen/Qwen3.6-35B-A3B and its derivatives — including Ornith-1.0-35B-AEON-Ultimate-Uncensored (a light RL post-train of that base). ~0.9 GB. Gives ~1.9× single-stream decode on a DGX Spark with no quality loss (lossless speculative decoding: the target model verifies every token). This drafter is 8 layers of full attention — deliberately no sliding-window attention (SWA). That single design choice is the difference: Why the no-patch part matters. Qwen3.6-35B-A3B / Ornith is a hybrid stack — full attention + GatedDeltaNet (Mamba) recurrent state. vLLM unifies KV-cache page sizes across layer types by scaling blocksize, but Mamba/GDN state pages are shape-based and don’t scale. INVALID LANGUAGE PAIR SPECIFIED. EXAMPLE: LANGPAIR=EN|IT USING 2 LETTER ISO OR RFC3066 LIKE ZH-CN. ALMOST ALL LANGUAGES SUPPORTED BUT SOME MAY HAVE NO CONTENT
Модальности:
Генерация текста
Задача: Генерация текста
Автор: AEON-7
Теги: qwen3, feature-extraction, dflash, speculative-decoding, drafter, qwen3_5_moe, aeon, aeon-7
Лайков: 3 | Загрузок: 3,552
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
