gpt2-GPTQ-4bit
Model created using AutoGPTQ on a GPT-2 model with 4-bit quantization. You can load this model with the...
Model created using AutoGPTQ on a GPT-2 model with 4-bit quantization. You can load this model with the...
GPTQ quantization of https://huggingface.co/KoboldAI/PPO_Pygway-6b-Mix Using this repository: https://github.com/mayaeary/GPTQ-for-LLaMa/tree/gptj-v2 Модальности:Генерация текста Области применения:Диалог / чат Задача: Генерация текста Автор:...
GPTQ quantization of https://huggingface.co/TehVenom/PPOPygway-V8p4Dev-6b Using this repository: https://github.com/mayaeary/GPTQ-for-LLaMa/tree/gptj-v2 Модальности:Генерация текста Области применения:Диалог / чат Задача: Генерация текста Автор:...
> Built with mlx-optiq, the MLX-native toolkit to quantize, fine-tune, and serve LLMs locally on Apple Silicon, no...
Ultra-Lightweight 4-bit Thai Text Humanization Model for Apple Silicon (MLX 4-bit, ~6.3 GB) humanizerth-thai-12B-Q40-MLX is an ultra-lightweight, 4-bit...
> Built with mlx-optiq, the MLX-native toolkit to quantize, fine-tune, and serve LLMs locally on Apple Silicon, no...
> Созданный с помощью mlx-optiq, набор инструментов MLX-native для квантования, точной настройки и обслуживания LLM локально на Apple...
CyberStag-Security-26B-A4B-V1 is a highly specialized, text-only large language model designed explicitly for cybersecurity analysis and deep logical reasoning....
> Built with mlx-optiq, the MLX-native toolkit to quantize, fine-tune, and serve LLMs locally on Apple Silicon, no...
4-битный квант MLX смешанной точности, созданный с помощью mlx-optiq — инструментария квантования с учетом чувствительности для Apple Silicon....