This model is a fine-tuned version of microsoft/Phi-4-multimodal-instruct. Model Background: This benchmark evaluates a fine-tuned version of Microsoft’s Phi-4-mm-instruct, a multimodal model not originally designed for Turkish ASR. Key points: 1. Initial Limitations: — No Turkish ASR support in base model — Initial WER 100+% 2. Fine-Tuning Process: — Unfroze encoder layers for Turkish adaptation — Trained for 1 epoch on Turkish audio-text pairs 3. Current Status: — Achieved significant WER reduction (100+% → 9.7% on CommonVoice)* — Still under active development for better generalization — Results shared as incremental progress documentation Why This Matters: — Demonstrates adaptability of multimodal architectures — Provides baseline for Turkish ASR in resource-constrained scenarios — Encourages exploration of under-supported languages Note on CommonVoice Results: — CommonVoice’s relatively low WER (9.7%) may benefit f
Модальности:
Генерация текста
Задача: Генерация текста
Автор: ysdede
Теги: tensorboard, phi4mm, generated_from_trainer, custom_code, tr
Лайков: 4 | Загрузок: 96
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
