> Release status: complete and verified. All 48 BF16 safetensors shards are published at metadata commit 105ef75053e89b3700f8b6dc793fa7a8c04e12ee, with model.safetensors.index.json and config.json independently verified (36,599 tensors; 608,450,282,488 payload bytes). The companion GGUF release is also complete. BF16 safetensors for DeepSeek-V4-Flash-0731-Ornstein, a reasoning-oriented fine-tune of deepseek-ai/DeepSeek-V4-Flash-0731 (commit 7872f01b1d1fe23eabc4c98b48bffcef5a386062). The model architecture is DeepseekV4ForCausalLM (deepseekv4`), a Mixture-of-Experts (MoE) model with 43 layers, hidden size 4096, 256 routed experts (6 active experts per token) plus 1 shared expert, a 128-token sliding window, and a 1,048,576 token context window configured with YaRN RoPE scaling. The LoRA adapter was trained on Fireworks AI and merged into the base model weights. This checkpoint injects Ornstein thinking into DeepSeek-V4-Flash-0731. It is an early merge, not a finished quality release. Planned quality work uses RL environments and energy-based fine-tuning. No downstream task evaluation or benchmark suite has been run on this checkpoint yet. Weight-level verification is not evidence…
Модальности:
Генерация текста
Области применения:
Логика и рассуждение
Задача: Генерация текста
Автор: GestaltLabs
Теги: deepseek_v4, moe, agentic, reasoning, endpoints_compatible
Лайков: 3 | Загрузок: 234
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
