Bielik-11B-v2.6-Instruct-AWQ
This repo contains AWQ format model files for SpeakLeash’s Bielik-11B-v2.6-Instruct. DISCLAIMER: Be aware that quantised models show reduced...
This repo contains AWQ format model files for SpeakLeash’s Bielik-11B-v2.6-Instruct. DISCLAIMER: Be aware that quantised models show reduced...
Our latest quantization method introduces precision-adaptive quantization for ultra-low-bit models (1-2 bit), with benchmark-proven improvements on Llama-3-8B. This...
This is an experimental version of the repository containing quantized Bielik-11B-v.2.3-Instruct models using calibration with importance matrix (imatrix)....
Original model: https://huggingface.co/speakleash/Bielik-11B-v2.2-Instruct Some of these quants (Q3KXL, Q4KL etc) are the standard quantization method with the embeddings...
This model was obtained by quantizing the weights and activations of Bielik-11B-v.2.2-Instruct to W8A8 (INT8) data type, ready...
This model was obtained by quantizing the weights and activations of Bielik-11B-v.2.2-Instruct to FP8 data type, ready for...
This repo contains EXL2 (6.5-bit) format model files for SpeakLeash’s Bielik-11B-v.2.2-Instruct. DISCLAIMER: Be aware that quantised models show...
This repo contains EXL2 (4.5-bit) format model files for SpeakLeash’s Bielik-11B-v.2.2-Instruct. DISCLAIMER: Be aware that quantised models show...
This model was converted to Quanto format from SpeakLeash’s Bielik-11B-v.2.2-Instruct. DISCLAIMER: Be aware that quantised models show reduced...
This repo contains HQQ (8-bit, 128 group size) format model files for SpeakLeash’s Bielik-11B-v.2.2-Instruct. DISCLAIMER: Be aware that...