Bielik-11B-v2.3-Instruct-GGUF-IQ-Imatrix
This is an experimental version of the repository containing quantized Bielik-11B-v.2.3-Instruct models using calibration with importance matrix (imatrix)....
Метка: finetuned
Bielik-11B-v2.2-Instruct-GGUF
Original model: https://huggingface.co/speakleash/Bielik-11B-v2.2-Instruct Some of these quants (Q3KXL, Q4KL etc) are the standard quantization method with the embeddings...
Bielik-11B-v2.2-Instruct-W8A8
This model was obtained by quantizing the weights and activations of Bielik-11B-v.2.2-Instruct to W8A8 (INT8) data type, ready...
Bielik-11B-v2.2-Instruct-FP8
This model was obtained by quantizing the weights and activations of Bielik-11B-v.2.2-Instruct to FP8 data type, ready for...
Bielik-11B-v2.2-Instruct-EXL2-6.5bit
This repo contains EXL2 (6.5-bit) format model files for SpeakLeash’s Bielik-11B-v.2.2-Instruct. DISCLAIMER: Be aware that quantised models show...
Bielik-11B-v2.2-Instruct-EXL2-4.5bit
This repo contains EXL2 (4.5-bit) format model files for SpeakLeash’s Bielik-11B-v.2.2-Instruct. DISCLAIMER: Be aware that quantised models show...
Bielik-11B-v2.2-Instruct-Quanto-4bit
This model was converted to Quanto format from SpeakLeash’s Bielik-11B-v.2.2-Instruct. DISCLAIMER: Be aware that quantised models show reduced...
Bielik-11B-v2.2-Instruct-HQQ-8bit-128gs
This repo contains HQQ (8-bit, 128 group size) format model files for SpeakLeash’s Bielik-11B-v.2.2-Instruct. DISCLAIMER: Be aware that...
Bielik-11B-v2.2-Instruct-HQQ-4bit-128gs
This repo contains HQQ (4-bit, 128 group size) format model files for SpeakLeash’s Bielik-11B-v.2.2-Instruct. DISCLAIMER: Be aware that...
Bielik-11B-v2.1-Instruct
Bielik-11B-v2.1-Instruct is a generative text model featuring 11 billion parameters. It is an instruct fine-tuned version of the...