Uncensored Llama 3.3 70B on Apple Silicon, at 8-bit for maximum fidelity. Abliterated and converted to MLX — 75 GB, for 96–128 GB Macs. No cloud, no API key, no refusals. An 8-bit MLX quantization of huihui-ai/Llama-3.3-70B-Instruct-abliterated, packaged for fast local inference on Apple Silicon. 8-bit was chosen instead of the more common 4-bit so the quant preserves as much of the base model’s quality as possible — meant for users who have the unified-memory headroom and care more about output fidelity than minimum footprint. You need an Apple Silicon Mac with enough unified memory to hold the full model in RAM, plus headroom for the KV cache and your OS: — Will not run on 64 GB Macs — use a 4-bit quant instead. — Minimum: ~80 GB free unified memory (so a 96 GB Ultra or a 128 GB Max). — Comfortable: 128 GB or more, especially if you want long contexts. — Base abliteration by huihui-ai, built on Meta’s meta-llama/Llama-3.3-70B-Instruct. — MLX 8-bit conversion by divinetribe using mlx-lm. — For background on the abliteration technique, see Maxime Labonne’s write-up on Hugging Face. Inherits the Llama 3.3 Community License from the upstream model. Use of this quant is bound by the…
Модальности:
Генерация текста
Области применения:
Диалог / чат Следование инструкциям
Задача: Генерация текста
Автор: divinetribe
Теги: mlx, llama, facebook, meta, llama-3, abliterated, uncensored, mlx-lm
Лайков: 3 | Загрузок: 1,332
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
