Yuan2-M32-hf-IMat-GGUF
Original Model: IEITYuan/Yuan2-M32-hf Original dtype: BF16 (bfloat16) Quantized by: https://github.com/chong000/3rd_party/tree/main IMatrix dataset: here — Files — IMatrix —...
Метка: quantized
internlm2-math-plus-1_8b-IMat-GGUF
Llama.cpp imatrix quantization of internlm/internlm2-math-plus-18b_ Original Model: internlm/internlm2-math-plus-18b Original dtype: BF16 (bfloat16`) Quantized by: llama.cpp b3008 IMatrix dataset:...
llama-3-sqlcoder-8b-GGUF
GGUF (llama.cpp) build of defog/llama-3-sqlcoder-8b, a Llama-3 8B model fine-tuned for text-to-SQL generation. This repo packages a Q4KM...
Llama-3-8B-Instruct-DPO-v0.4-GGUF
— Создатель модели: MaziyarPanahi — Оригинальная модель: MaziyarPanahi/Llama-3-8B-Instruct-DPO-v0.4 MaziyarPanahi/Llama-3-8B-Instruct-DPO-v0.4-GGUF содержит файлы модели формата GGUF для MaziyarPanahi/Llama-3-8B-Instruct-DPO-v0.4. GGUF —...
Llama-3-70B-Instruct-32k-v0.1-GGUF
— Model creator: MaziyarPanahi — Original model: MaziyarPanahi/Llama-3-70B-Instruct-32k-v0.1 MaziyarPanahi/Llama-3-70B-Instruct-32k-v0.1-GGUF contains GGUF format model files for MaziyarPanahi/Llama-3-70B-Instruct-32k-v0.1. GGUF is...
Llama-3-8B-GPTQ-8-Bit
This model is generously created and made open source by Astronomer. Astronomer is the de facto company for...
zephyr-orpo-141b-A35b-v0.1-AWQ
MaziyarPanahi/zephyr-orpo-141b-A35b-v0.1-AWQ is a quantized (AWQ) version of HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1 Модальности:Генерация текста Области применения:Диалог / чат Задача: Генерация текста Автор:...
Mistral-7B-v0.2-GGUF
— Model creator: MaziyarPanahi — Original model: MaziyarPanahi/Mistral-7B-v0.2 MaziyarPanahi/Mistral-7B-v0.2-GGUF contains GGUF format model files for MaziyarPanahi/Mistral-7B-v0.2. Thanks to...
Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-AWQ
MaziyarPanahi/TruthfulDPOTomGrcFusionNet7Bx2MoE13B-AWQ is a quantized (AWQ) version of yunconglong/TruthfulDPOTomGrcFusionNet7Bx2MoE13B Модальности:Генерация текста Задача: Генерация текста Автор: MaziyarPanahi Теги: mixtral, finetuned,...
Starling-LM-7B-beta-AWQ
— Model creator: Nexusflow — Original model: Starling-LM-7B-beta — Developed by: Banghua Zhu , Evan Frick , Tianhao...