ibm-granite_granite-3.2-2b-instruct-GGUF
Original model: https://huggingface.co/ibm-granite/granite-3.2-2b-instruct Run them directly with llama.cpp, or any other llama.cpp based project Some of these quants...
Метка: imatrix
LatitudeGames_Wayfarer-Large-70B-Llama-3.3-GGUF
Original model: https://huggingface.co/LatitudeGames/Wayfarer-Large-70B-Llama-3.3 Run them directly with llama.cpp, or any other llama.cpp based project Some of these quants...
PygmalionAI_Pygmalion-3-12B-GGUF
Original model: https://huggingface.co/PygmalionAI/Pygmalion-3-12B Run them directly with llama.cpp, or any other llama.cpp based project Some of these quants...
Rombos-Qwen2.5-Writer-32b-GGUF
Original model: https://huggingface.co/SubtleOne/Rombos-Qwen2.5-Writer-32b Some of these quants (Q3KXL, Q4KL etc) are the standard quantization method with the embeddings...
HuatuoGPT-o1-72B-GGUF
Оригинальная модель: https://huggingface.co/FreedomIntelligence/HuatuoGPT-o1-72B Некоторые из этих квантов (Q3KXL, Q4KL и т. д.) являются стандартным методом квантования с вложениями...
Llama3.2_1b_NOVA-Castellano_y_Sin_Censura
📲 Gracias por mostrar interes en este modelo cuantizado del todopoderoso Novaciano que es capaz de correr en...
FuseChat-Qwen-2.5-7B-Instruct-GGUF
Original model: https://huggingface.co/FuseAI/FuseChat-Qwen-2.5-7B-Instruct Some of these quants (Q3KXL, Q4KL etc) are the standard quantization method with the embeddings...
FuseChat-Llama-3.2-1B-Instruct-GGUF
Original model: https://huggingface.co/FuseAI/FuseChat-Llama-3.2-1B-Instruct Some of these quants (Q3KXL, Q4KL etc) are the standard quantization method with the embeddings...
deepthought-8b-llama-v0.01-alpha-GGUF
Original model: https://huggingface.co/ruliad/deepthought-8b-llama-v0.01-alpha Some of these quants (Q3KXL, Q4KL etc) are the standard quantization method with the embeddings...
Llama-3.1-70B-ArliAI-RPMax-v1.3-GGUF
Оригинальная модель: https://huggingface.co/ArliAI/Llama-3.1-70B-ArliAI-RPMax-v1.3 Некоторые из этих квантов (Q3KXL, Q4KL и т. д.) являются стандартным методом квантования с вложениями...