CHATPRG-v1.2-Phi-3.5-mini-instruct-GGUF
— Modelo pre-entrenado para dar a conocer a estudiantes y personas externas, los reglamentos de la Universidad nacional...
Метка: 4bit
Bielik-11B-v2.2-Instruct-Quanto-4bit
This model was converted to Quanto format from SpeakLeash’s Bielik-11B-v.2.2-Instruct. DISCLAIMER: Be aware that quantised models show reduced...
Bielik-11B-v2.2-Instruct-MLX-4bit
This model was converted to MLX format from SpeakLeash’s Bielik-11B-v.2.2-Instruct. DISCLAIMER: Be aware that quantised models show reduced...
pygmalion-6b-4bit-128g
GPTQ quantization of https://huggingface.co/PygmalionAI/pygmalion-6b/commit/b8344bb4eb76a437797ad3b19420a13922aaabe1 Using this repository: https://github.com/mayaeary/GPTQ-for-LLaMa/tree/gptj-v2 Модальности:Генерация текста Области применения:Диалог / чат Задача: Генерация текста Автор:...
DeepSeek-V4-Flash-0731-GPTQ-Int4-V1
4-bit GPTQ (W4A16) quantization of deepseek-ai/DeepSeek-V4-Flash-0731, produced with GPTQModel. This is the V1 release (first calibration run). A...
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-OptiQ-4bit
> Built with mlx-optiq, the MLX-native toolkit to quantize, fine-tune, and serve LLMs locally on Apple Silicon, no...
gemma-4-26B-A4B-it-qat-OptiQ-4bit
> Built with mlx-optiq, the MLX-native toolkit to quantize, fine-tune, and serve LLMs locally on Apple Silicon, no...
gemma-4-e2b-it-OptiQ-4bit
> Built with mlx-optiq, the MLX-native toolkit to quantize, fine-tune, and serve LLMs locally on Apple Silicon, no...
Nanbeige4.1-3B-MLX-4bit
Это модель Nanbeige4.1-3B, преобразованная в формат MLX с 4-разрядным квантованием (аффин, размер группы=64) для эффективного вывода на Apple...
Meta-Llama-3.1-70B-Instruct-gptq-4bit
— биты: 4 — размер группы: 128 — уменьшение: true — staticgroups: false — sym: true — lmhead:...