This is an MLX conversion of deepreinforce-ai/Ornith-1.0-397B, quantized to 8-bit for use on Apple Silicon with mlx-lm. — Base model: deepreinforce-ai/Ornith-1.0-397B (Qwen3.5-MoE, Qwen35MoeForConditionalGeneration, 397B total / MoE) — Format: MLX, 8-bit (affine) — Approx. size on disk: ~421 GB — Converted with:** mlx-lm 0.31.2 > Note — text-only. The original Ornith-1.0-397B is multimodal (vision encoder + language model). mlx-lm converts the language model only; the vision tower is not included. This build is for text generation. The tokenizer, chat template, and generationconfig` are included. This is a large MoE model. You need an Apple Silicon Mac with enough unified memory to hold the weights (roughly ~421 GB plus runtime overhead/KV cache). A 512 GB M3 Ultra runs all of these comfortably.
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: pipenetwork
Теги: mlx, qwen3_5_moe, moe, conversational, en, 8-bit
Лайков: 3 | Загрузок: 37
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.