INVALID LANGUAGE PAIR SPECIFIED. EXAMPLE: LANGPAIR=EN|IT USING 2 LETTER ISO OR RFC3066 LIKE ZH-CN. ALMOST ALL LANGUAGES SUPPORTED BUT SOME MAY HAVE NO CONTENT Validated against: — gghfez/MiMo-V2.5-Pro-ikllama-unfused-GGUF, file MiMo-V2.5-Pro-IQ3S-unfused.gguf (IQ3_S, about 349 GiB) The validation used an unfused target. One fused-MoE conversion tested during the PR produced garbled target-only output, so it was excluded from the DFlash results. That observation does not establish that every fused MiMo conversion is incompatible. — —spec-type dflash:… selects the DFlash speculator. nmax=1 was optimal in this test. crossctx=16 is a small ring buffer of recent target positions visible to the draft; larger values reduced acceptance sharply. — -sm graph —max-gpu 4 was the best multi-GPU profile tested on 4×H200 NVL. Pinning the draft to one GPU with -devd added overhead under graph…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: ji-farthing
Теги: gguf, ik_llama, dflash, speculative-decoding, draft-model, mimo, endpoints_compatible, conversational
Лайков: 4 | Загрузок: 345
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
