nassersala/bloom-small-166 - Каталог нейросетей
Генерация текста

nassersala/bloom-small-166

Добавлено:
nassersala/bloom-small-166

This repository hosts a significantly smaller version of the BLOOM model, designed primarily for functional testing purposes. It is an ideal choice for scenarios where computational efficiency and quick iterations are necessary, such as in development and testing environments. The original BLOOM model has been scaled down with the following changes: — Number of Layers (nlayer): Reduced to 12 from the original 70 layers. — Hidden Size (hiddensize): Decreased to 512 from the original 14336. — Number of Attention Heads (n_head): Lowered to 8 from the original 112 heads. This model is suitable for functional testing and development purposes. It is not recommended for tasks that require high accuracy or complex language understanding and generation capabilities. Please note that due to the significant reductions in size and complexity, this model does not retain the full capabilities of the original BLOOM model. Expect limitations in accuracy and depth of language understanding.

Модальности:
Генерация текста


Задача: Генерация текста
Автор: nassersala
Теги: bloom, en, text-generation-inference, endpoints_compatible
Лайков: 3  |  Загрузок: 16

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.