Qwen2.5-Lumen-14B-GGUF
This is quantized version of v000000/Qwen2.5-Lumen-14B created using llama.cpp Qwen direct preference optimization finetuned for ~3 epochs.* A...
Метка: DPO
Llama-3-8B-Magpie-Align-v0.3
Online Model Demo: https://huggingface.co/spaces/flydust/Chat-with-Magpie This model is an aligned version of meta-llama/Meta-Llama-3-8B. We apply the following pipeline: We...
cymist-2-v02-DPO-main
Cymist2-v0.2 is a cutting-edge language model developed by the Cypien AI Team, optimized for text-generation tasks. The model...
calme-2.2-phi3-4b
This model is a fine-tune (DPO) of microsoft/Phi-3-mini-4k-instruct model. All GGUF models are available here: MaziyarPanahi/calme-2.2-phi3-4b-GGUF You can...
janus-dpo-7b
— Homepage: https://lklab.kaist.ac.kr/Janus/ — Repository: https://github.com/kaistAI/Janus — Paper: https://arxiv.org/abs/2405.17977 — Point of Contact: seongyun@kaist.ac.kr Janus is a model...
Phi-3-mini-4k-instruct-dpo
INVALID LANGUAGE PAIR SPECIFIED. EXAMPLE: LANGPAIR=EN|IT USING 2 LETTER ISO OR RFC3066 LIKE ZH-CN. ALMOST ALL LANGUAGES SUPPORTED...
Orca-Llama-3-8B-Instruct-DPO
Finetuned Llama 3 8B Instruct on Intel/orcadpopairs using an single 3090 24GB. Данные сформированы с помощью шаблона ChatML....
Pulsar_7B
A more compliant, RP-oriented version of MTSAIR/multiversemodel, fine-tuned on carefully selected datasets. It’s smart, adept at following the...
Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-AWQ
MaziyarPanahi/TruthfulDPOTomGrcFusionNet7Bx2MoE13B-AWQ is a quantized (AWQ) version of yunconglong/TruthfulDPOTomGrcFusionNet7Bx2MoE13B Модальности:Генерация текста Задача: Генерация текста Автор: MaziyarPanahi Теги: mixtral, finetuned,...
AlphaMonarch-7B-GPTQ
tl;dr: AlphaMonarch-7B is a new DPO merge that retains all the reasoning abilities of the very best merges...