reader-lm-1.5b-GGUF
— Model creator: jinaai — Original model: jinaai/reader-lm-1.5b arcee-train/reader-lm-1.5b-GGUF contains GGUF format model files for jinaai/reader-lm-1.5b. GGUF is...
Метка: 6-bit
DeepSeek-V2.5-GGUF
— Model creator: deepseek-ai — Original model: deepseek-ai/DeepSeek-V2.5 MaziyarPanahi/DeepSeek-V2.5-GGUF contains GGUF format model files for deepseek-ai/DeepSeek-V2.5. GGUF is...
SmolLM-135M-Instruct-GGUF
— Model creator: HuggingFaceTB — Original model: HuggingFaceTB/SmolLM-135M-Instruct MaziyarPanahi/SmolLM-135M-Instruct-GGUF contains GGUF format model files for HuggingFaceTB/SmolLM-135M-Instruct. GGUF is...
calme-2.8-qwen2-7b-GGUF
— Model creator: MaziyarPanahi — Original model: MaziyarPanahi/calme-2.8-qwen2-7b MaziyarPanahi/calme-2.8-qwen2-7b-GGUF contains GGUF format model files for MaziyarPanahi/calme-2.8-qwen2-7b. GGUF is...
dolphin-2.9.1-llama-3-70b-6.0bpw-exl2
This model fits comfortably within 72gb of VRAM with 32k context. Enjoy! Feel free to reach out for...
opus-v1.4-70b-llama3-exl2-6.0bpw-h8
Models for (steerable) story-writing and role-playing. Other quants Other models — Opus V1 prompting guide with many prompts...
Maiden-Unquirked-20B-6.0bpw-h6-exl2
This is a merge of pre-trained language models created using mergekit. This model was merged using the DARE...
Llama-3-8B-Instruct-DPO-v0.4-GGUF
— Создатель модели: MaziyarPanahi — Оригинальная модель: MaziyarPanahi/Llama-3-8B-Instruct-DPO-v0.4 MaziyarPanahi/Llama-3-8B-Instruct-DPO-v0.4-GGUF содержит файлы модели формата GGUF для MaziyarPanahi/Llama-3-8B-Instruct-DPO-v0.4. GGUF —...
Llama-3-70B-Instruct-32k-v0.1-GGUF
— Model creator: MaziyarPanahi — Original model: MaziyarPanahi/Llama-3-70B-Instruct-32k-v0.1 MaziyarPanahi/Llama-3-70B-Instruct-32k-v0.1-GGUF contains GGUF format model files for MaziyarPanahi/Llama-3-70B-Instruct-32k-v0.1. GGUF is...
ChaoticSoliloquy-4x8B-6bpw-h6-exl2
6bpw/h6 exl2 quantization of xxx777xxxASD/ChaoticSoliloquy-4x8B using default exllamav2 calibration dataset. Experimental RP-oriented MoE, the idea was to get...