Sao10K_L3-8B-Stheno-v3.1-8_0bpw_exl2
Exllamav2 quant (exl2 / 8.0 bpw) made with ExLlamaV2 v0.0.21 This has been an experimental model I’ve been...
Метка: exl2
dolphin-2.9.1-llama-3-8b-8.0bpw-h8-exl2
Curated and trained by Eric Hartford, Lucas Atkins, and Fernando Fernandes, and Cognitive Computations We have retrained our...
Llama-3-Lumimaid-70B-v0.1-alt-2.4bpw-h6-exl2
Llama3 trained on our RP datasets, we tried to have a balance between the ERP and the RP,...
Llama-3-Lumimaid-8B-v0.1-OAS-8.0bpw-h8-exl2
Llama3 trained on our RP datasets, we tried to have a balance between the ERP and the RP,...
dolphin-2.9-llama3-70b-5.0bpw-h6-exl2
Curated and trained by Eric Hartford, Lucas Atkins, Fernando Fernandes, and with help from the community of Cognitive...
ChaoticSoliloquy-4x8B-6bpw-h6-exl2
6bpw/h6 exl2 quantization of xxx777xxxASD/ChaoticSoliloquy-4x8B using default exllamav2 calibration dataset. Experimental RP-oriented MoE, the idea was to get...
ChaoticSoliloquy-4x8B-8bpw-h8-exl2
8bpw/h8 exl2 quantization of xxx777xxxASD/ChaoticSoliloquy-4x8B using default exllamav2 calibration dataset. Experimental RP-oriented MoE, the idea was to get...
Llama-3-Soliloquy-8B-exl2-h8-8.0
Soliloquy-L3 is a fast, highly capable roleplaying model designed for immersive, dynamic experiences. With a vast knowledge base,...
c4ai-command-r-plus_exl2_2.75bpw
This is a 2.75bpw EXL2 quant of CohereForAI/c4ai-command-r-plus Details about the model can be found at the above...
c4ai-command-r-v01_exl2_6.0bpw
This is a 6.0bpw EXL2 quant of CohereForAI/c4ai-command-r-v01 Details about the model can be found at the above...