> [!NOTE] > This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite base model. > > Please reference the base model’s full model card here: > https://huggingface.co/ibm-granite/granite-guardian-3.2-5b Granite Guardian 3.2 5B is a thinned down version of Granite Guardian 3.1 8B designed to detect risks in prompts and responses. It can help with risk detection along many key dimensions catalogued in the IBM AI Risk Atlas. To generate this model, the Granite Guardian is iteratively pruned and healed on the same unique data comprising human annotations and synthetic data informed by internal red-teaming used for its training. About 30% of the original parameters were removed allowing for faster inference and lower resource requirements while still providing competitive performance. It outperforms other open-source models in the same space on standard benchmarks. The thinning procedure based on iterative pruning and healing is described in more details in its own section below. — Developers: IBM Research — GitHub Repository: ibm-granite/granite-guardian — Cookbook: Granite Guardian Recipes — Website: Granite Guardian…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: ibm-research
Теги: gguf, granite-3.2, guardian, conversational
Лайков: 3 | Загрузок: 279
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
