This is quantized version of FreedomIntelligence/HuatuoGPT-o1-8B created using llama.cpp HuatuoGPT-o1 is a medical LLM designed for advanced medical reasoning. It generates a complex thought process, reflecting and refining its reasoning, before providing a final response. You can use HuatuoGPT-o1 in the same way as Llama-3.1-8B-Instruct. You can deploy it with tools like vllm or Sglang, or perform direct inference: HuatuoGPT-o1 adopts a thinks-before-it-answers approach, with outputs formatted as:
Модальности:
Генерация текста
Области применения:
Диалог / чат Медицина
Задача: Генерация текста
Автор: QuantFactory
Теги: gguf, medical, en, endpoints_compatible, conversational
Лайков: 3 | Загрузок: 1,296
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
