Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF
This model was converted to GGUF format from meta-llama/Meta-Llama-3.1-8B-Instruct using llama.cpp via the ggml.ai’s GGUF-my-repo space. Refer to...
This model was converted to GGUF format from meta-llama/Meta-Llama-3.1-8B-Instruct using llama.cpp via the ggml.ai’s GGUF-my-repo space. Refer to...
Original model: https://huggingface.co/HiroseKoichi/Llama-3-8B-Stroganoff-3.0 Some of these quants (Q3KXL, Q4KL etc) are the standard quantization method with the embeddings...
Kushtrim/Llama-3.1-8B-Instruct-bnb-4bit-shqip is a fine-tuned version of the Llama 3.1 model, specifically optimized for Albanian language tasks. This model...
Official AQLM quantization of meta-llama/Meta-Llama-3.1-8B finetuned with PV-Tuning. For this quantization, we used 1 codebook of 16 bits...
This is 8-bit GPTQ version of Meta-Llama-3.1-8B-Instruct. Quantization has been done using AutoGPTQ library. Starting with transformers >=...
Using llama.cpp commit b5e9546 for quantization, featuring llama 3.1 rope scaling factors. This fixes low-quality issues when using...
This is a 4.0bpw, h6 exl2 quant of the Llama 3.1 model. Big thanks to turboderp and grimulkan...
Оригинальная модель: https://huggingface.co/HiroseKoichi/Llama-3-8B-Stroganoff-2.0 Спасибо kalomaze и Dampf за помощь в создании набора данных калибровки imatrix Спасибо ZeroWw за...
Коллекция многоязычных больших языковых моделей (LLM) Meta Llama 3.1 представляет собой коллекцию предварительно обученных и настроенных на инструкцию...
Официальная библиотека моделей формата GGUF для использования в локальном приложении чата AI, Backyard AI. — Creator: meta-llama —...