openmed-community/AFM-4.5B-OpenMed-RL-CoT - Каталог нейросетей
Генерация текста

openmed-community/AFM-4.5B-OpenMed-RL-CoT

Добавлено:
openmed-community/AFM-4.5B-OpenMed-RL-CoT

Lightweight medical finetune on top of Arcee’s AFM-4.5B for education and research use. Trained using a straightforward 3-step process (SFT → DPO → GRPO-CoT) for optimal CoT enrichment. More information about our methodology will be available in a forthcoming blog post. All experiments were performed on AMD MI300x GPUs, with computing credits generously provided by Hot AISLE. > ⚠️ Medical safety > This model is not a clinician. It can hallucinate and should not be used for diagnosis or treatment. Always involve qualified medical professionals. 1. Domain SFT (medical + tools) Instruction-style synthetic medical Q&A + conversions; supervised search/tool-use traces to teach function-calling patterns compatible with chat templates. 2. Preference alignment — DPO Uses MedMCQA correctness as a proxy preference signal to bias toward concise, clinically reasonable options. 3. Reasoning enrichment — GRPO (CoT) Group Relative Policy Optimization without a critic; groups of sampled solutions are scored by verifiable rewards (answer correctness + light format checks). Trained with MedReason QA signal. > Author-run with the EleutherAI lm-evaluation-harness; seeds, prompts, and templates affect…

Модальности:
Генерация текста

Области применения:
Диалог / чат Медицина


Задача: Генерация текста
Автор: openmed-community
Теги: arcee, medical, instruction-tuned, dpo, grpo, cot, mergekit, arcee-fusion
Лайков: 4  |  Загрузок: 1,078

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.