Llama-3.1-Nemotron-70B-Instruct-HF-4.3bpw-6hb-exl2
Enjoy! Raise an issue if you’d like other BPW levels. Base Model Card Follows: —————————|:—————-|:——|:———-|:——-| You can use...
Enjoy! Raise an issue if you’d like other BPW levels. Base Model Card Follows: —————————|:—————-|:——|:———-|:——-| You can use...
Enjoy! Raise an issue if you’d like other BPW levels. Base Model Card Follows: —————————|:—————-|:——|:———-|:——-| You can use...
Wandb: https://wandb.ai/undis95/Lumi-Mistral-Large?nw=nwuserundis95 As some people have told us our models are sloppy, Ikari decided to say fuck it...
Trained with compute from Backyard.ai | Thanks to them and @dynafire for helping me out. Relevant Axolotl Configurations:...
This model fits comfortably within 72gb of VRAM with 32k context. Enjoy! Feel free to reach out for...
This is a merge of pre-trained language models created using mergekit. This model was merged using the DARE...
Ethereal Rainbow is an 8B parameter merge of various Llama3-based finetunes created using mergekit. The purpose of Ethereal...
Exllamav2 3.75bpw quantization of Typhon-Mixtral-v1 from Sao10K, quantized with default calibration dataset. > [!IMPORTANT] >This bpw is the...
Codestrall-22B-v0.1 is trained on a diverse dataset of 80+ programming languages, including the most popular ones, such as...
Exllamav2 quant (exl2 / 8.0 bpw) made with ExLlamaV2 v0.0.21 This has been an experimental model I’ve been...