This repository hosts the optimized versions of Mistral-7B-Instruct-v0.3 to accelerate inference with ONNX Runtime for DirectML. DirectML is a high-performance, hardware-accelerated DirectX 12 library for machine learning. DirectML provides GPU acceleration for common machine learning tasks across a broad range of supported hardware and drivers, including all DirectX 12-capable GPUs from vendors such as AMD, Intel, NVIDIA, and Qualcomm.
Модальности:
Генерация текста
Области применения:
Диалог / чат Следование инструкциям
Задача: Генерация текста
Автор: EmbeddedLLM
Теги: onnx, mistral, ONNX, DML, DirectML, ONNXRuntime, conversational, custom_code
Лайков: 3 | Загрузок: 12
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
