facebook/OPT-125m quantized using bitsandbytes 4-bit NF4 quantization. All license matters are set based on the underlying facebook/OPT-125m model. This model is work in progress, use it for testing https://github.com/huggingface/transformers/pull/26037 pull request only. known issue: safetensors deleted linked «quantmap» / «nestedquantmap»` items.
Модальности:
Генерация текста
Задача: Генерация текста
Автор: poedator
Теги: opt, text-generation-inference, endpoints_compatible, 4-bit, bitsandbytes
Лайков: 2 | Загрузок: 509
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.