granite-4.2-8b-4bit-mlx
4-bit quantized MLX format of ibm-granite/granite-4.2-8b optimized for Apple Silicon inference. — 4-bit Quantization: Low memory footprint (~4.9...
4-bit quantized MLX format of ibm-granite/granite-4.2-8b optimized for Apple Silicon inference. — 4-bit Quantization: Low memory footprint (~4.9...
Disclaimer on MLX Patcher — Provided as-is, no warranty of any kind. Read the code before running —...
> Built with mlx-optiq, the MLX-native toolkit to quantize, fine-tune, and serve LLMs locally on Apple Silicon, no...
The Model adrgrondin/MiniCPM5-2B-mlx-4Bit was converted to MLX format from openbmb/MiniCPM5-2B using mlx-lm version 0.31.2. Модальности:Генерация текста Области применения:Диалог...
oQ6e (imatrix-enhanced mixed-precision ~6.5 BPW) quantization of the merged IFM/K2-Horizon-7B-Uno model — a diffusion-augmented LLM based on K2-Horizon-7B....
Merged version of IFM/K2-Horizon-7B-Uno, a diffusion-augmented LLM based on K2-Horizon-7B. This repository contains the LoRA adapter merged directly...
This is the 4-bit MLX version of NeoHorse-1-4B for Apple Silicon. Converted from the original BF16 weights with...
Spark-X2.5-4B at 3.41 GiB — the size-first bundle. Fastest of the pair, and the one to run if...
Disclaimer on MLX Patcher — Provided as-is, no warranty of any kind. Read the code before running —...
MLX 8-bit conversion of OpenBMB/MiniCPM5-2B, a 2B dense Llama-based model for local deployment, coding, reasoning, long-context work, and...