> [!NOTE] > Weights live and byte-verified (all 83 LFS files sha256-matched against the > assembly manifest; structural gate at assembly verified all 58,368 promoted > expert slots K3-shaped). KLD measurement to follow — the sibling releases’ > measured table below gives the ladder context; this checkpoint’s row will be > published here. Expectation revised 2026-08-30: brandonmusic’s independent > calibrated uniform-K3 draft > scored 0.0375 (clean bf16 replay) on this lineage’s exact confirmation > windows; since this checkpoint is uniform-K3 without calibration and is > scored through fp8-KV serving, expect ~0.04-0.05 here, not the naive > ladder extrapolation (~0.030). Flat K3 concentrates damage in the worst-expert > tail that the 3.25/3.42 siblings protect with K4 — that is the trade this > artifact makes for context breadth. The > reproduction kit in kld/ scores it unmodified. Trellis (EXL3) quantization of zai-org/GLM-5.3 (755B glmmoedsa MoE: 78 layers + MTP, 256 routed experts/layer), following the GLM-5.2 TR3 lineage layout. Fits TP4 on 4x 96 GB (RTX PRO 6000 Blackwell class) with FP8 KV cache. From the upstream card: «GLM-5.3 uses the same base model as GLM-5.2 — every…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: davidsyoung
Теги: glm_moe_dsa, exl3, trellis, tr3, conversational, en, zh, endpoints_compatible
Лайков: 3 | Загрузок: 95
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.