Chat & support: TheBloke’s Discord server Want to contribute? TheBloke’s Patreon page TheBloke’s LLM work is generously supported by a grant from andreessen horowitz (a16z) This repo contains pytorch format fp16 model files for nRuaif’s Kimiko v2 13B. It is the result of merging and/or converting the source repository to float16. GPTQ models for GPU inference, with multiple quantisation parameter options. 2, 3, 4, 5, 6 and 8-bit GGUF models for CPU+GPU inference 2, 3, 4, 5, 6 and 8-bit GGML models for CPU+GPU inference (deprecated) Unquantised fp16 model in pytorch format, for GPU inference and for further conversions * nRuaif’s original LoRA adapter, which can be merged on to the base model. For further support, and discussions on these models and AI in general, join us at: I’ve had a lot of people ask if they can contribute. I enjoy providing models and helping people, and would love to be able to spend even more time doing it, as well as expanding into new projects like fine tuning/training. If you’re able and willing to contribute it will be most gratefully received and will help me to keep providing more models, and to start work on new AI projects. Donaters will get…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: TheBloke
Теги: llama, en, text-generation-inference
Лайков: 3 | Загрузок: 17
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
