xLAM-7b-r-GGUF
Some of these quants (Q3KXL, Q4KL etc) are the standard quantization method with the embeddings and output weights...
Метка: mistral
Fireball-12B-v1.13a-philosophers
This model is super fine-tune with philosophy of science, math, epistemology dataset, to provide high quality responses(from first...
Bielik-11B-v2.2-Instruct-W8A8
This model was obtained by quantizing the weights and activations of Bielik-11B-v.2.2-Instruct to W8A8 (INT8) data type, ready...
Bielik-11B-v2.2-Instruct-FP8
This model was obtained by quantizing the weights and activations of Bielik-11B-v.2.2-Instruct to FP8 data type, ready for...
Bielik-11B-v2.2-Instruct-EXL2-6.5bit
This repo contains EXL2 (6.5-bit) format model files for SpeakLeash’s Bielik-11B-v.2.2-Instruct. DISCLAIMER: Be aware that quantised models show...
Bielik-11B-v2.2-Instruct-EXL2-4.5bit
This repo contains EXL2 (4.5-bit) format model files for SpeakLeash’s Bielik-11B-v.2.2-Instruct. DISCLAIMER: Be aware that quantised models show...
Bielik-11B-v2.2-Instruct-Quanto-4bit
This model was converted to Quanto format from SpeakLeash’s Bielik-11B-v.2.2-Instruct. DISCLAIMER: Be aware that quantised models show reduced...
Bielik-11B-v2.2-Instruct-HQQ-8bit-128gs
This repo contains HQQ (8-bit, 128 group size) format model files for SpeakLeash’s Bielik-11B-v.2.2-Instruct. DISCLAIMER: Be aware that...
Bielik-11B-v2.2-Instruct-HQQ-4bit-128gs
This repo contains HQQ (4-bit, 128 group size) format model files for SpeakLeash’s Bielik-11B-v.2.2-Instruct. DISCLAIMER: Be aware that...
Bielik-11B-v2.1-Instruct
Bielik-11B-v2.1-Instruct is a generative text model featuring 11 billion parameters. It is an instruct fine-tuned version of the...