Lightweight medical finetune on top of Arcee’s AFM-4.5B for education and research use. Trained with a simple 3-stage recipe (SFT → DPO → GRPO-CoT) and finalized via Arcee Fusion weight merging (MergeKit). More information about our methodology will be available in a forthcoming blog post. All experiments were performed on AMD MI300x GPUs, with computing credits generously provided by Hot AISLE. > ⚠️ Medical safety > This model is not a clinician. It can hallucinate and should not be used for diagnosis or treatment. Always involve qualified medical professionals. 1. Domain SFT (medical + tools) Instruction-style synthetic medical Q&A + conversions; supervised search/tool-use traces to teach function-calling patterns compatible with chat templates. 2. Preference alignment — DPO Uses MedMCQA correctness as a proxy preference signal to bias toward concise, clinically reasonable options. 3. Reasoning enrichment — GRPO (CoT) Group Relative Policy Optimization without a critic; groups of sampled solutions are scored by verifiable rewards (answer correctness + light format checks). Trained with MedReason QA signal. 4. Finalization — Arcee Fusion (MergeKit) Selective weight fusion to…
Модальности:
Генерация текста
Области применения:
Диалог / чат Медицина
Задача: Генерация текста
Автор: openmed-community
Теги: arcee, medical, instruction-tuned, dpo, grpo, cot, mergekit, arcee-fusion
Лайков: 3 | Загрузок: 15
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
