Ornith-1.0-35B-GGUF-imatrix-GGUF
GGUF квантования deepreinforce-ai/Ornith-1.0-35B-GGUF, опубликованные Liodon AI. LM Studio / Jan — поиск liodon-ai/Ornith-1.0-35B-GGUF-imatrix-GGUF и выбор количества. Стандартное квантование...
Метка: quantized
Laguna-XS-2.1-4bit
INVALID LANGUAGE PAIR SPECIFIED. EXAMPLE: LANGPAIR=EN|IT USING 2 LETTER ISO OR RFC3066 LIKE ZH-CN. ALMOST ALL LANGUAGES SUPPORTED...
Ornith-1.0-35B-UD-Q8_K_XL-mlx
8-bit base mixed-precision quantization of deepreinforce-ai/Ornith-1.0-35B for Apple Silicon, using the Unsloth Dynamic per-tensor bit allocation (without imatrix...
Ornith-1.0-397B-GGUF
Converted to BF16 using converthftogguf.py, then quantized using llama-quantize` from llama.cpp. Did not use an imatrix for any...
Qwythos-9B-Claude-Mythos-5-1M-GGUF
GGUF quantizations of empero-ai/Qwythos-9B-Claude-Mythos-5-1M for llama.cpp, Ollama, LM Studio, jan, KoboldCpp, and other GGUF runtimes. Qwythos-9B is a...
gemma-4-12B-OBLITERATED-SHQ7-GGUF
> OBLITERATED + selective IQ hybrid for 8 GB Pascal GPUs. Uncensored coding model. 7.7% smaller than Q4KM...
gemma-4-26B-A4B-it-qat-OptiQ-4bit
> Built with mlx-optiq, the MLX-native toolkit to quantize, fine-tune, and serve LLMs locally on Apple Silicon, no...
Rio-3.5-Open-397B-NVFP4
NVFP4-quantized build of prefeitura-rio/Rio-3.5-Open-397B — a 397B-parameter (17B active) Qwen3.5-MoE vision-language model (512 experts, hybrid softmax + linear/DeltaNet...
Mellum2-12B-A2.5B-Instruct-GGUF
Text generation model Модальности:Генерация текста Области применения:Следование инструкциям Диалог / чат Задача: Генерация текста Автор: CodeFault Теги: gguf,...
Huihui-LFM2.5-8B-A1B-abliterated-NVFP4
NVFP4 (W4A4) quantization of huihui-ai/Huihui-LFM2.5-8B-A1B-abliterated — the abliterated (refusal-reduced) build of Liquid AI’s 8.3B-total / 1.5B-active mixture-of-experts reasoner...