Quantized GGUF versions of moonshotai/Kimi-Linear-48B-A3B-Instruct Works with llama.cpp · Ollama · LM Studio · Open WebUI · Jan — Most users: Kimi-Linear-48B-A3B-Instruct-Q4KM.gguf — best balance of size and quality — High RAM (32GB+): Kimi-Linear-48B-A3B-Instruct-Q80.gguf — near-original quality — Low RAM (8GB): Kimi-Linear-48B-A3B-Instruct-Q3KM.gguf` — fits in 8GB with room to spare GGUF is the standard file format for running large language models locally. Quantization reduces the number of bits per weight: Found an issue? Have a question? Open a Discussion in the Community tab above. If these quantizations were useful, please consider: — ⭐ Starring quant-kit on GitHub — 👍 Liking this model on HuggingFace — 💬 Leaving feedback in the Community tab
Модальности:
Генерация текста
Области применения:
Диалог / чат Следование инструкциям
Задача: Генерация текста
Автор: DhruvalLabs
Теги: gguf, conversational, custom_code, quantized, kimi_linear, en, endpoints_compatible
Лайков: 3 | Загрузок: 550
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
