Chat & support: TheBloke’s Discord server Want to contribute? TheBloke’s Patreon page TheBloke’s LLM work is generously supported by a grant from andreessen horowitz (a16z) This repo contains GGML format model files for augtoma’s qCammel 70. The GGML format has now been superseded by GGUF. As of August 21st 2023, llama.cpp no longer supports GGML models. Third party clients and libraries are expected to still support it for a time, but many may also drop support. GPU acceleration is now available for Llama 2 70B GGML files, with both CUDA (NVidia) and Metal (macOS). The following clients/libraries are known to work with these files, including with GPU acceleration: llama.cpp, commit e76d630 and later. text-generation-webui, the most widely used web UI. KoboldCpp, version 1.37 and later. A powerful GGML web UI, especially good for story telling. LM Studio, a fully featured local GUI with GPU acceleration for both Windows and macOS. Use 0.1.11 or later for macOS GPU acceleration with 70B models. llama-cpp-python, version 0.1.77 and later. A Python library with LangChain support, and OpenAI-compatible API server. ctransformers, version 0.2.15 and later. A Python library…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: TheBloke
Теги: llama, llama-2, qCammel-70, en
Лайков: 3 | Загрузок: 13
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
