4bit/llama-13b-4bit-hf - Каталог нейросетей
Генерация текста

4bit/llama-13b-4bit-hf

Добавлено:
4bit/llama-13b-4bit-hf

LLaMA-13B converted to work with Transformers/HuggingFace. This is under a special license, please see the LICENSE file for details. This has been converted to int4 via GPTQ method. This requires some special support code that is also highly experimental. NOT COMPATIBLE WITH TRANSFORMERS LIBRARY. Data The data used to train the model is collected from various sources, mostly from the Web. As such, it contains offensive, harmful and biased content. We thus expect the model to exhibit such biases from the training data. Human life The model is not intended to inform decisions about matters central to human life, and should not be used in such a way. Mitigations We filtered the data from the Web based on its proximity to Wikipedia text and references. For this, we used a Kneser-Ney language model and a fastText linear classifier. Risks and harms Risks and harms of large language models include the generation of harmful, offensive or biased content. These models are often prone to generating incorrect information, sometimes referred to as hallucinations. We do not expect our model to be an exception in this regard. Use cases LLaMA is a foundational model, and as such, it should not be…

Модальности:
Генерация текста


Задача: Генерация текста
Автор: 4bit
Теги: llama, text-generation-inference, endpoints_compatible
Лайков: 2  |  Загрузок: 16

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.