deepsweet/Qwen3.6-35B-A3B-MLX-VL-oQ6-FP16

This model was converted to MLX format and quantized from Qwen3.6-35B-A3B using oMLX. «VL» is Vision-Language, meaning quantization preserves the original model’s multimodality. «FP16» is an M1/M2 Apple Silicon tweak that delivers a very noticeable prompt processing boost, because older M-series lack native BF16 hardware support. See «Metal FP32 Vs BF16 Vs FP16 benchmark» for details. No «FP16» means quantization is better suited for M3+ Apple Silicon. [01]: https://huggingface.co/deepsweet/Qwen3.6-35B-A3B-MLX-oQ8 [02]: https://huggingface.co/deepsweet/Qwen3.6-35B-A3B-MLX-oQ6 [03]: https://huggingface.co/deepsweet/Qwen3.6-35B-A3B-MLX-oQ5 [04]: https://huggingface.co/deepsweet/Qwen3.6-35B-A3B-MLX-oQ4 [05]: https://huggingface.co/deepsweet/Qwen3.6-35B-A3B-MLX-VL-oQ8 [06]: https://huggingface.co/deepsweet/Qwen3.6-35B-A3B-MLX-VL-oQ6 [07]: https://huggingface.co/deepsweet/Qwen3.6-35B-A3B-MLX-VL-oQ5 [08]: https://huggingface.co/d

Модальности:
Генерация текста

Области применения:
Диалог / чат

Задача: Генерация текста
Автор: deepsweet
Теги: mlx, qwen3_5_moe, conversational, en, 6-bit
Лайков: 3  |  Загрузок: 42

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.