> NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 is the full-precision reference release of NVIDIA’s Nemotron 3.5 Lightning model, a hybrid Mixture-of-Experts architecture interleaving Mamba-2 and MoE layers with select Attention layers, totaling 30B parameters with only 3B active at inference and supporting up to 1M tokens of context (256K on a single H100). Pre-trained on over 20 trillion tokens using an NVFP4 recipe and enhanced with Multi-Token Prediction (MTP) layers for richer training signals, it underwent a four-stage pipeline — pretraining, MTP continued pretraining, supervised fine-tuning on code/math/science/tool-calling data, and multi-environment GRPO reinforcement learning across math, code, instruction-following, and structured-output tasks — supporting configurable reasoning mode (enablethinking`), English plus fiv This BF16 checkpoint is intended primarily as a starting point for customization — post-training (SFT/RL/distillation), domain adaptation, or producing quantized (NVFP4, W4A16, GGUF) variants — rather than direct production deployment, for which NVIDIA…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: prithivMLmods
Теги: gguf, text-generation-inference, nvidia, llama-cpp, nemotron-3.5, en, es, fr
Лайков: 3 | Загрузок: 261
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
