Chat & support: my new Discord server Want to contribute? TheBloke’s Patreon page This repo contains pytorch format fp16 model files for none. It is the result of merging and/or converting the source repository to float16. GPTQ models for GPU inference, with multiple quantisation parameter options. 2, 3, 4, 5, 6 and 8-bit GGML models for CPU+GPU inference Unquantised fp16 model in pytorch format, for GPU inference and for further conversions nRuaif’s original LoRA adapter, which can be merged on to the base model. For further support, and discussions on these models and AI in general, join us at: I’ve had a lot of people ask if they can contribute. I enjoy providing models and helping people, and would love to be able to spend even more time doing it, as well as expanding into new projects like fine tuning/training. If you’re able and willing to contribute it will be most gratefully received and will help me to keep providing more models, and to start work on new AI projects. Donaters will get priority support on any and all AI/LLM/model questions and requests, access to a private Discord room, plus other benefits. Patreon: https://patreon.com/TheBlokeAI Ko-Fi:…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: TheBloke
Теги: llama, text-generation-inference
Лайков: 2 | Загрузок: 17
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
