TheBloke/TinyLlama-1.1B-intermediate-step-480k-1T-GPTQ - Каталог нейросетей
Генерация текста

TheBloke/TinyLlama-1.1B-intermediate-step-480k-1T-GPTQ

Добавлено:

Chat & support: TheBloke’s Discord server Want to contribute? TheBloke’s Patreon page TheBloke’s LLM work is generously supported by a grant from andreessen horowitz (a16z) — Model creator: Zhang Peiyuan — Original model: TinyLlama 1.1B Intermediate Step 480K 1T This repo contains GPTQ model files for Zhang Peiyuan’s TinyLlama 1.1B Intermediate Step 480K 1T. Multiple GPTQ parameter permutations are provided; see Provided Files below for details of the options provided, their parameters, and the software used to create them. AWQ model(s) for GPU inference. GPTQ models for GPU inference, with multiple quantisation parameter options. 2, 3, 4, 5, 6 and 8-bit GGUF models for CPU+GPU inference Zhang Peiyuan’s original unquantised fp16 model in pytorch format, for GPU inference and for further conversions Multiple quantisation parameters are provided, to allow you to choose the best one for your hardware and requirements. Each separate quant is in a different branch. See below for instructions on fetching from different branches. Most GPTQ files are made with AutoGPTQ. Mistral models are currently made with Transformers. — Bits: The bit size of the quantised model. — GS: GPTQ…

Модальности:
Генерация текста


Задача: Генерация текста
Автор: TheBloke
Теги: llama, en, text-generation-inference, 4-bit, gptq
Лайков: 2  |  Загрузок: 35

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.