ABLITERIX TRIAL 16 BF16 OpenMDW-1.1 Laguna-S-2.1-Uncensored English | 📖 中文文档 Uncensored 118B-A8B MoE · abliterix Trial 16 · BF16 safetensors (46 shards) 🌊 About this release Laguna S 2.1 is a poolside ~118B total / ~8B active per token Mixture-of-Experts model for agentic coding and long-horizon work. Architecture highlights: token-choice routing with softplus gates, 256 routed experts + 1 shared expert (top-10), GQA, 1:3 global/sliding-window attention (48 layers: 12 global + 36 local, window 512), and up to about 1M context, with optional native thinking interleaved with tool use. This release builds on the official weights in two steps: Uncensored behavior edit via abliterix (ROCm + bitsandbytes 4-bit search path), selecting Trial 16 LoRA, stream-merged back to BF16, plus MoE safety-expert router bake-in. Thinking was restored: the abliteration-time force-false override was removed from the chat template (see below). Full-precision release: this repo ships the uncensored weights as BF16 safetensors (46 shards, ~219 GB). Quantized APEX I-tier GGUFs + imatrix built from this exact merge live in the sibling repo Laguna-S-2.1-Uncensored-APEX-GGUF. License: OpenMDW-1.1 (same…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: SC117
Теги: laguna, moe, uncensored, abliterix, bf16, poolside, conversational, custom_code
Лайков: 3 | Загрузок: 382
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
