Bonsai-2-27B-CRACK-1.75bit-JANG
Built for vMLX — the MLX inference engine for Apple Silicon with mixed-precision JANG bundles, KV-cache quantization, and...
Built for vMLX — the MLX inference engine for Apple Silicon with mixed-precision JANG bundles, KV-cache quantization, and...
oQ4e-quantized MLX build (created by xunlinkx with the omlx pipeline) of Mondk/Spark-X2.5-4B-Abliterated-Uncensored for first-class, all-local serving on Apple...
A 4-bit MLX port of NeoHorse-1-4B by TokenRhythm, quantized for Apple Silicon. This is the same fine-tuned model...
A Q4KM GGUF of Qwen/Qwen3.5-0.8B for on-device inference on any iPhone, iPad, or Apple Silicon Mac via llama.cpp...
> Built with mlx-optiq, the MLX-native toolkit to quantize, fine-tune, and serve LLMs locally on Apple Silicon, no...
oQ6e (imatrix-enhanced mixed-precision ~6.5 BPW) quantization of the merged IFM/K2-Horizon-7B-Uno model — a diffusion-augmented LLM based on K2-Horizon-7B....
Merged version of IFM/K2-Horizon-7B-Uno, a diffusion-augmented LLM based on K2-Horizon-7B. This repository contains the LoRA adapter merged directly...
Spark-X2.5-4B at 3.41 GiB — the size-first bundle. Fastest of the pair, and the one to run if...
oQ4e (imatrix-enhanced mixed-precision 4-bit) conversion of IFM/K2-Horizon-MoVA-36B-A4B, a sparse Mixture-of-Experts model with Mixture-of-Values attention (36B total / 4B...
TL;DR: аблитерированный Ornith-1.5-35B-A3B как 26 ГБ для Apple Silicon через mlx-lm; жесткие отказы снижены на общем мастере с...