We sincerely thank the open-source community developers and contributors unsloth for providing BF16 version and imatrix file. We really appreciate the attention and we’re also happy to share additional quantization variants for everyone to try out and experiment with — hope you enjoy them! > Note: NemotronHForCausalLM features a distinctive MoE architecture, markedly different from existing MoE implementations. Because of this uniqueness, we are providing only the most reliable and broadly compatible quantization options at this stage. > Download Available for huggingfacehub, huggingface-cli, snapshotdownload, xet. Example of runing gguf with local build of llama.cpp. (llama-cli/llama-server) This repository builds upon the outstanding work of the following open-source authors and projects: — nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 — ggml-org/llama.cpp, unsloth.ai, bartowski. — ikawrakow/ik_llama.cpp, ikawrakow, ubergarm. We sincerely thank them for their excellent contributions to the open-source community.
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: moxin-org
Теги: gguf, nvidia, GGUF, llama.cpp, moxin-org, NemotronHForCausalLM, en, es
Лайков: 3 | Загрузок: 114
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
