Qwen2.5-Math-72B-Instruct-GGUF
Original model: https://huggingface.co/Qwen/Qwen2.5-Math-72B-Instruct Some of these quants (Q3KXL, Q4KL etc) are the standard quantization method with the embeddings...
Метка: imatrix
Donnager-70B-v1-GGUF
Оригинальная модель: https://huggingface.co/TheDrummer/Donnager-70B-v1 Некоторые из этих квантов (Q3KXL, Q4KL и т. д.) являются стандартным методом квантования с вложениями...
Chronos-Divergence-33B-GGUF
Original model: https://huggingface.co/ZeusLabs/Chronos-Divergence-33B Some of these quants (Q3KXL, Q4KL etc) are the standard quantization method with the embeddings...
DeepSeek-Coder-V2-Instruct-0724-GGUF
Original model: https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Instruct-0724 Some of these quants (Q3KXL, Q4KL etc) are the standard quantization method with the embeddings...
Bielik-11B-v2.3-Instruct-GGUF-IQ-Imatrix
This is an experimental version of the repository containing quantized Bielik-11B-v.2.3-Instruct models using calibration with importance matrix (imatrix)....
L3.1-70B-Euryale-v2.2-GGUF
Original model: https://huggingface.co/Sao10K/L3.1-70B-Euryale-v2.2 Some of these quants (Q3KXL, Q4KL etc) are the standard quantization method with the embeddings...
magnum-v3-34b-GGUF
Original model: https://huggingface.co/anthracite-org/magnum-v3-34b Some of these quants (Q3KXL, Q4KL etc) are the standard quantization method with the embeddings...
Infinity-Instruct-7M-Gen-Llama3_1-70B-GGUF
Original model: https://huggingface.co/BAAI/Infinity-Instruct-7M-Gen-Llama3_1-70B Some of these quants (Q3KXL, Q4KL etc) are the standard quantization method with the embeddings...
functionary-medium-v3.2-GGUF
Оригинальная модель: https://huggingface.co/meetkai/functionary-medium-v3.2 Новые обновления от mlabonne, никаких подробностей, но я уверен, что это того стоит! Некоторые из...
internlm2_5-1_8b-chat-GGUF
👾 LM Studio Community models highlights program. Highlighting new & noteworthy models by the community. Join the conversation...