miniG-GGUF
Some of these quants (Q3KXL, Q4KL etc) are the standard quantization method with the embeddings and output weights...
Метка: gguf
L3.1-70B-Euryale-v2.2-GGUF
Original model: https://huggingface.co/Sao10K/L3.1-70B-Euryale-v2.2 Some of these quants (Q3KXL, Q4KL etc) are the standard quantization method with the embeddings...
Bielik-11B-v2.2-Instruct-W8A8
This model was obtained by quantizing the weights and activations of Bielik-11B-v.2.2-Instruct to W8A8 (INT8) data type, ready...
Bielik-11B-v2.2-Instruct-FP8
This model was obtained by quantizing the weights and activations of Bielik-11B-v.2.2-Instruct to FP8 data type, ready for...
magnum-v3-34b-GGUF
Original model: https://huggingface.co/anthracite-org/magnum-v3-34b Some of these quants (Q3KXL, Q4KL etc) are the standard quantization method with the embeddings...
Bielik-11B-v2.2-Instruct-EXL2-6.5bit
This repo contains EXL2 (6.5-bit) format model files for SpeakLeash’s Bielik-11B-v.2.2-Instruct. DISCLAIMER: Be aware that quantised models show...
Bielik-11B-v2.2-Instruct-EXL2-4.5bit
This repo contains EXL2 (4.5-bit) format model files for SpeakLeash’s Bielik-11B-v.2.2-Instruct. DISCLAIMER: Be aware that quantised models show...
Bielik-11B-v2.2-Instruct-Quanto-4bit
This model was converted to Quanto format from SpeakLeash’s Bielik-11B-v.2.2-Instruct. DISCLAIMER: Be aware that quantised models show reduced...
Bielik-11B-v2.2-Instruct-HQQ-8bit-128gs
This repo contains HQQ (8-bit, 128 group size) format model files for SpeakLeash’s Bielik-11B-v.2.2-Instruct. DISCLAIMER: Be aware that...
Bielik-11B-v2.2-Instruct-HQQ-4bit-128gs
This repo contains HQQ (4-bit, 128 group size) format model files for SpeakLeash’s Bielik-11B-v.2.2-Instruct. DISCLAIMER: Be aware that...