jhkim55/Motif-3-Direct-IQ2-XXS-DGX-Spark - Каталог нейросетей
Генерация текста

jhkim55/Motif-3-Direct-IQ2-XXS-DGX-Spark

Добавлено:
jhkim55/Motif-3-Direct-IQ2-XXS-DGX-Spark

Research closed — September 10, 2026. This IQ2 download is unchanged. A separate internal-NVMe Q4 experiment recorded 2.81 generated tokens/s over 1,024 tokens; BF16/Q4 behavioral parity remains unverified. No Q4 weights are uploaded here. The final source-and-evidence report is available on GitHub: English · 한국어. !Motif-3 315B on one DGX Spark: 83.56 GiB, 316.71 tok/s prompt processing, and 16.49 tok/s generation This is a mixed IQ2XXS build of the 314.7B-parameter Motif-3 core, tested entirely on one 128 GB NVIDIA DGX Spark. The final GGUF is 83.56 GiB** and loads all model layers on the GPU. These are five-run means from the pinned public build. The speed rows predate the tokenizer patch described below; 83.56 GiB is the file size, not runtime memory use. Source, build instructions, benchmark records, and checksums are available in the GitHub repository. The full Korean guide is available there as well. > Before downloading: this model was validated with the pinned > Motif-capable llama.cpp runtime and tokenizer patch below. Compatibility with > stock upstream llama.cpp has not been established. The quant also did not > pass the prespecified BF16 quality-preservation gates, so…

Модальности:
Генерация текста


Задача: Генерация текста
Автор: jhkim55
Теги: gguf, llama.cpp, llama-cpp, motif3, motif-3, mixture-of-experts, moe, dgx-spark
Лайков: 3  |  Загрузок: 31

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.