darkknight25/deepseek-16b-medical-GPT is a fine-tuned version of deepseek-ai/deepseek-l6b-moe-chat, optimized for medical question answering, reasoning, and clinical summarization using QLoRA and open-access healthcare datasets. This model uses Mixture-of-Experts (MoE) architecture with QLoRA-based adaptation, unlocking medical domain performance with efficient training. — 16B parameter MoE with 2-of-8 experts active per token — Low inference cost (~6B active) — Strong reasoning, multi-domain instruction-tuned — Trained on 2T tokens, multilingual support — Technique: QLoRA (4-bit quantization) + LoRA adapters — Target Modules: qproj, kproj, vproj, oproj — Trainable Params: ~85M — Batch Size: 4 — Epochs: 2 — Optim: pagedadamw8bit MIT License (same as base model). Use for research and commercial purposes freely, with proper attribution. 🙏 Acknowledgements @darkknight25 – Security Researcher | ML Engineer | Medical AI Want to collaborate on more medical AI projects or build a chatbot? Ping me.
Модальности:
Генерация текста
Области применения:
Диалог / чат Медицина Биология
Задача: Генерация текста
Автор: darkknight25
Теги: biology, medical, conversational, en, endpoints_compatible
Лайков: 3 | Загрузок: 0
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
