INVALID LANGUAGE PAIR SPECIFIED. EXAMPLE: LANGPAIR=EN|IT USING 2 LETTER ISO OR RFC3066 LIKE ZH-CN. ALMOST ALL LANGUAGES SUPPORTED BUT SOME MAY HAVE NO CONTENT The original root-level v1 files remain for users of the > July fork; v1 and v2 differ only in GGUF metadata (mainline counts the MTP layer > in blockcount = 44, per-layer arrays span 44, and the per-layer hchead copies > are dropped in favor of the global tensors) — the model bits are identical. Every public DeepSeek-V4-Flash GGUF strips the model’s multi-token-prediction (MTP) head: llama.cpp’s converter drops the mtp. tensors and its C++ has no code to run them. These are, as far as we know, the first and only V4-Flash GGUFs anywhere with the head preserved and working — the model drafts a token ahead of itself and verifies it in the same forward pass, for free decode speedup with zero quality change (every draft is verified by the full model). For…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: rogerai-fyi
Теги: llama.cpp, gguf, deepseek, deepseek-v4, mtp, speculative-decoding, mixture-of-experts, endpoints_compatible
Лайков: 4 | Загрузок: 1,963
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
