robinsyihab/Sidrap-7B-v2-GPTQ-4bit - Каталог нейросетей
Генерация текста

robinsyihab/Sidrap-7B-v2-GPTQ-4bit

Добавлено:

Sidrap-7B-v2-GPTQ-4bit is an 4-bit quantized model of Sidrap-7B-v2, which is one of the best open model LLM bahasa Indonesia available today. This model has been quantized using AutoGPTQ to get smaller model that allows us to run in a lower resource environment with faster inference. The quantization uses random subset of original training data to «calibrate» the weights resulting in an optimally compact model with minimall loss in accuracy.

Модальности:
Генерация текста


Задача: Генерация текста
Автор: robinsyihab
Теги: mistral, endpoints_compatible
Лайков: 2  |  Загрузок: 12

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.