Llama3-8B-1.58-100B-tokens-GGUF
The Llama3-8B-1.58 models are large language models fine-tuned on the BitNet 1.58b architecture, starting from the base model...
Метка: 8-bit
Llama-3.1-Nemotron-70B-Instruct-HF-GGUF
— Model creator: mistralai — Original model: mistralai/Mistral-Small-Instruct-2409 MaziyarPanahi/Mistral-Small-Instruct-2409-GGUF contains GGUF format model files for mistralai/Mistral-Small-Instruct-2409. GGUF is...
Llama-3.1-Nemotron-70B-Instruct-HF-8.0bpw-8hb-exl2
Enjoy! Raise an issue if you’d like other BPW levels. Base Model Card Follows: —————————|:—————-|:——|:———-|:——-| You can use...
Qwen2.5-3B-Instruct-GPTQ-Int8
Qwen2.5 — это последняя серия больших языковых моделей Qwen. Для Qwen2.5 мы выпускаем ряд базовых языковых моделей и...
DeepSeek-V2.5-GGUF
— Model creator: deepseek-ai — Original model: deepseek-ai/DeepSeek-V2.5 MaziyarPanahi/DeepSeek-V2.5-GGUF contains GGUF format model files for deepseek-ai/DeepSeek-V2.5. GGUF is...
Bielik-11B-v2.2-Instruct-W8A8
This model was obtained by quantizing the weights and activations of Bielik-11B-v.2.2-Instruct to W8A8 (INT8) data type, ready...
Bielik-11B-v2.2-Instruct-Quanto-4bit
This model was converted to Quanto format from SpeakLeash’s Bielik-11B-v.2.2-Instruct. DISCLAIMER: Be aware that quantised models show reduced...
Meta-Llama-3.1-8B-Instruct-GPTQ-Q_8
This is 8-bit GPTQ version of Meta-Llama-3.1-8B-Instruct. Quantization has been done using AutoGPTQ library. Starting with transformers >=...
Meta-Llama-3-8B-Instruct-quantized.w8a16
— Архитектура модели: Meta-Llama-3 — Ввод: Текст — Вывод: Текст — Оптимизация модели: — Квантование веса: INT8 —...
L3-8B-Stheno-v3.3-32K-8.0bpw-h8-exl2
Trained with compute from Backyard.ai | Thanks to them and @dynafire for helping me out. Relevant Axolotl Configurations:...