TheBloke/AquilaChat2-34B-GPTQ - Каталог нейросетей
Генерация текста

TheBloke/AquilaChat2-34B-GPTQ

Добавлено:

Чат Multiple GPTQ parameter permutations are provided; see Provided Files below for details of the options provided, their parameters, and the software used to create them. These files were quantised using hardware kindly provided by Massed Compute. AWQ model(s) for GPU inference. GPTQ models for GPU inference, with multiple quantisation parameter options. 2, 3, 4, 5, 6 and 8-bit GGUF models for CPU+GPU inference Beijing Academy of Artificial Intelligence’s original unquantised fp16 model in pytorch format, for GPU inference and for further conversions These GPTQ models are known to work in the following inference servers/webuis. — text-generation-webui — KobaldAI United — LoLLMS Web UI — Hugging Face Text Generation Inference (TGI) This may not be a complete list; if you know of others, please let me know! Multiple…

Модальности:
Генерация текста

Области применения:
Диалог / чат


Задача: Генерация текста
Автор: TheBloke
Теги: aquila, custom_code, 4-bit, gptq
Лайков: 2  |  Загрузок: 16

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.