reader-lm-1.5b-GGUF
— Model creator: jinaai — Original model: jinaai/reader-lm-1.5b arcee-train/reader-lm-1.5b-GGUF contains GGUF format model files for jinaai/reader-lm-1.5b. GGUF is...
Метка: quantized
DeepSeek-V2.5-GGUF
— Model creator: deepseek-ai — Original model: deepseek-ai/DeepSeek-V2.5 MaziyarPanahi/DeepSeek-V2.5-GGUF contains GGUF format model files for deepseek-ai/DeepSeek-V2.5. GGUF is...
SmolLM-135M-Instruct-GGUF
— Model creator: HuggingFaceTB — Original model: HuggingFaceTB/SmolLM-135M-Instruct MaziyarPanahi/SmolLM-135M-Instruct-GGUF contains GGUF format model files for HuggingFaceTB/SmolLM-135M-Instruct. GGUF is...
Athene-70B-IMat-GGUF
> [!IMPORTANT] > This repo is quantized from the updated version of Athene-70B as of the 24th of...
llm-compiler-13b-IMat-GGUF
Original Model: facebook/llm-compiler-13b Original dtype: BF16 (bfloat16) Quantized by: llama.cpp b3256 IMatrix dataset: here — Files — IMatrix...
calme-2.8-qwen2-7b-GGUF
— Model creator: MaziyarPanahi — Original model: MaziyarPanahi/calme-2.8-qwen2-7b MaziyarPanahi/calme-2.8-qwen2-7b-GGUF contains GGUF format model files for MaziyarPanahi/calme-2.8-qwen2-7b. GGUF is...
RoLlama3-8b-Instruct-IMat-GGUF
Llama.cpp imatrix quantization of OpenLLM-Ro/RoLlama3-8b-Instruct Original Model: OpenLLM-Ro/RoLlama3-8b-Instruct Original dtype: BF16 (bfloat16) Quantized by: llama.cpp b3206 IMatrix dataset:...
Qwen2-7B-Instruct-IMat-GGUF
Оригинальная модель: Qwen/Qwen2-7B-Instruct Оригинальный dtype: BF16 (bfloat16) Quantized by: llama.cpp b3091 IMatrix dataset: here — Files — IMatrix...
Nxcode-CQ-7B-orpo-IMat-GGUF
Original Model: NTQAI/Nxcode-CQ-7B-orpo Original dtype: BF16 (bfloat16) Quantized by: llama.cpp b3067 IMatrix dataset: here — Files — IMatrix...
K2-IMat-GGUF
Original Model: LLM360/K2 Original dtype: FP16 (float16) Quantized by: llama.cpp b3051 IMatrix dataset: here — Files — IMatrix...