SDLLM-Duo-1.7B-Base is a 1.7B parameter language model based on uniform-state diffusion. Unlike absorbing-state diffusion models where tokens are masked, the uniform-state diffusion process allows tokens to transition to any token in the vocabulary during the forward process. This model is evaluated as part of the study «Scaling Beyond Masked Diffusion Language Models,» which investigates diffusion-based approaches to language modeling. SDLLM-Duo-1.7B-Base is released under the CC BY-NC 4.0 license. By using this model, you are agreeing to the terms and conditions of the license. This model is intended for research purposes only and may not be used for commercial applications. SDLLM-Duo-1.7B-Base is intended for use by researchers studying diffusion-based language modeling approaches. Hugging Face 09/02/2026 via https://huggingface.co/nvidia/SDLLM-Duo-1.7B-Base Scaling Beyond Masked Diffusion Language Models Nemotron Nano 2 Dataset This repository includes a self-contained SDLLM inference and evaluation package. Use python sample.py —help for sampler overrides. With no prompt the script performs unconditional generation. Release defaults are: AR uses Gumbel-max ancestral…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: nvidia
Теги: diffusion-language-modeling, en
Лайков: 3 | Загрузок: 37
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
