Mistral-Nemo-Gutenberg-Doppel-12B-GGUF
Original model: https://huggingface.co/nbeerbower/Mistral-Nemo-Gutenberg-Doppel-12B Some of these quants (Q3KXL, Q4KL etc) are the standard quantization method with the embeddings...
Метка: gguf
Hercules-6.0-Llama-3.1-8B-GGUF
Original model: https://huggingface.co/Locutusque/Hercules-6.0-Llama-3.1-8B Some of these quants (Q3KXL, Q4KL etc) are the standard quantization method with the embeddings...
Llama-3.2-1B-Instruct-GGUF
!image/png This model was quantized by SanctumAI. To leave feedback, join our community in Discord.* Model creator: meta-llama...
Apollo-2.0-Llama-3.1-8B-GGUF
This is quantized version of Locutusque/Apollo-2.0-Llama-3.1-8B created using llama.cpp SFT of Llama-3.1 8B. I was going to use...
Mistral-Small-Instruct-2409-abliterated-gguf
This model was converted to GGUF format from byroneverson/Mistral-Small-Instruct-2409-abliterated using llama.cpp via the ggml.ai’s GGUF-my-repo space. Refer to...
gemma-2-Ifable-9B-i1-GGUF
Original model: https://huggingface.co/ifable/gemma-2-Ifable-9B All quants were made using the imatrix option (except BF16, that’s the original precision). The...
Astra-v1-12B-GGUF
Astra-v1-12B is a fine-tuned version of the base model Mistral-Nemo-Base-2407, developed for general-purpose natural language processing tasks. It...
NightyGurps-14b-v1.1-GGUF
Original model: https://huggingface.co/AlexBefest/NightyGurps-14b-v1.1 Some of these quants (Q3KXL, Q4KL etc) are the standard quantization method with the embeddings...
bloom-7b1-GGUF
This is quantized version of bigscience/bloom-7b1 created using llama.cpp BLOOM LM BigScience Large Open-science Open-access Multilingual Language Model...
stella_en_1.5B_v5_GGUF
This is a direct GGUF conversion of dunzhang/stellaen1.5B_v5. Модальности:Генерация текста Области применения:Диалог / чат Задача: Генерация текста Автор:...