Yhyu13/manticore-13b-gptq-4bit

GPTQ 4-bit no actor version for compatibility that works in textgen-webui Generated by using scripts from https://gitee.com/yhyu13/llama_-tools Original weights: https://huggingface.co/openaccess-ai-collective/manticore-13b Manticore is by far the most satisfying LLaMA model I’ve used due to its fine-tuning datasets are generated from the best of Vicuna, Wizard, and ShareGPT/GPT4. Here is a conversation generated in textgen-webui, it shows step by step Chain of Thoughts comments along side generating complex code sample in an engaging tone!

Модальности:
Генерация текста

Задача: Генерация текста
Автор: Yhyu13
Теги: llama, text-generation-inference, endpoints_compatible
Лайков: 3  |  Загрузок: 60

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.