NexaAI/Granite-4-Micro-NPU

Run Granite-4.0-Micro optimized for Qualcomm NPUs with nexaSDK. 1. Install NexaSDK and create a free account at sdk.nexa.ai 2. Activate your device with your access token: Granite-4.0-Micro is a 3B parameter instruction-tuned model in the Granite 4.0 family, developed by IBM. It’s optimized for long-context reasoning (128K tokens), efficient inference, and enterprise-ready capabilities such as tool calling and retrieval-augmented generation. The model balances compact size with strong performance across general NLP tasks, making it suitable for both experimentation and production workloads. — Compact transformer architecture: 3B parameters with GQA, RoPE, SwiGLU, and RMSNorm layers. — Instruction-following & tool calling: Tuned with supervised finetuning, alignment (RLHF), and model merging for robust enterprise tasks. — Multilingual support: Covers 12+ languages including English, German, Spanish, French, Japanese, Korean, Arabic, and Chinese. — Extended context window: Supports sequences up to 128K tokens for long-form reasoning. — Conversational AI and virtual assistants. — Enterprise applications needing tool/API calling and structured outputs. — Long-document summarization,…

Модальности:
Генерация текста

Задача: Генерация текста
Автор: NexaAI
Теги: NPU
Лайков: 3  |  Загрузок: 23

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.