Research checkpoints accompanying a controlled evaluation of how the choice of fine-tuning configuration affects medical question-answering performance at a fixed model scale. > Not for clinical use. These are evaluation artefacts. They have not been validated > for any clinical purpose and must not be used to inform patient care. The parent checkpoint, Qwen/Qwen3.6-27B, scores 43.76% and is not redistributed here. It is a vendor post-trained checkpoint, not an untuned base model. V1427Bmerged is a full merged model. All other folders are LoRA adapters and must be applied to the parent checkpoint. All derivatives share one parent checkpoint and were evaluated on the identical 2,450-item MedXpertQA-Text test set with deterministic decoding and a single exact-match scorer. — Accuracy spanned 16.86 percentage points across the parent and its derivatives, and 15.30 points among the derivatives themselves. — No derivative exceeded the parent on the primary endpoint. — Four derivatives finished within 2.41 points of the parent yet produced a different outcome on 15.1% to 18.2% of items. Aggregate accuracy understates how much individual behaviour changed. — Retention of parent-correct…
Модальности:
Генерация текста
Области применения:
Медицина
Задача: Генерация текста
Автор: Clinical-Reasoning-Hub
Теги: peft, medical, clinical-reasoning, medxpertqa, lora, model-evaluation, reproducibility, en
Лайков: 3 | Загрузок: 0
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.