Text-only conversion of Cantina Security Apex Flash 1 abliterated, revision cecb5eeb9c6b32404a0dd930df81de2c239bdd84. Converted directly from BF16 using IQ2XXS routed gate/up, Q2K routed down and higher-precision non-expert tensors, matching the stock counterpart’s recipe. Q2 names a mixed recipe, not a uniform tensor format. No activation-calibrated importance matrix was used; IQ2 uses a weight-column-energy fallback. MTP tensors are retained, but speculative decoding is not qualified. Vision weights are omitted. File: apex-flash-1-abliterated-DS4-Q2.gguf, 96,505,818,944 bytes (89.88 GiB), 1,412 tensors. Requires a DS4 runtime supporting the GLM architecture and these mixed expert types. GGUF alone does not establish compatibility with llama.cpp, Ollama, MLX, LM Studio or their embedded engines. Memory needs depend on the exact runtime, expert cache and context; file size alone is not a RAM requirement. Full output-payload integrity verification passed. The conversion does not inherit upstream benchmark scores. Abliteration targets refusal behavior; it does not establish improved reasoning, reliability or capability. Experimental, not a stable-agent release. Tested on 2026-10-04…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: shamidk
Теги: gguf, ds4, mixed-quantization, abliterated, endpoints_compatible, conversational
Лайков: 3 | Загрузок: 332
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
