This repository contains the DPO-v2 LoRA adapter for Academic Humanize, a post-training project for reducing AI-like patterns in academic English while preserving meaning, terminology, citations, numbers, and logical relationships. This is a PEFT LoRA adapter, not a full standalone base model. To use it, load the base model first and then attach this adapter with peft. Academic Humanize is designed for academic paragraph rewriting. Given an AI-like academic draft, the model rewrites it into a more natural scholarly English paragraph while keeping the original meaning intact. 1. QLoRA SFT: teaches the model the academic humanization format and basic rewriting behavior. 2. SPIN-style iterative DPO: uses model-generated outputs as rejected responses and human references as chosen responses to further align the model toward more natural academic writing. This repository hosts the DPO-v2 adapter, which is the second DPO iteration after SFT and DPO-v1. — Developed by: XiaoXu123123 — Model type: PEFT LoRA adapter for causal language modeling — Language: English — Base model: Qwen/Qwen2.5-7B-Instruct — Training method: QLoRA SFT + SPIN-style DPO + iterative DPO — Task: Academic text…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: XiaoXu123123
Теги: peft, lora, qlora, dpo, academic-writing, text-rewriting, academic-humanization, conversational
Лайков: 4 | Загрузок: 135
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.