«Obsessed with GenAI’s potential? So am I ! Let’s create together 🚀 https://www.linkedin.com/in/pankajam» We evaluated model_009 on a wide range of tasks using Language Model Evaluation Harness from EleutherAI. Here are the results on metrics used by HuggingFaceH4 Open LLM Leaderboard This model required upto 45GB GPU VRAM in 4bit so it can be loaded directly on Single RTX 6000/L40/A40/A100/H100 GPU or Double RTX 4090/L4/A10/RTX 3090/RTX A5000 So, if you have access to Machine with 45GB GPU VRAM and have installed OobaBooga Web UI on it. You can just download this model by using HF repo link directly on OobaBooga Web UI «Model» Tab/Page & Just use load-in-4bit option in it. After that go to Default Tab/Page on OobaBooga Web UI and copy paste above prompt format into Input and Enjoy! While this model aims for accuracy, it can occasionally produce inaccurate or misleading results. Despite diligent efforts in refining the pretraining data, there remains a possibility for the generation of inappropriate, biased, or offensive content. Exercise caution and cross-check information when necessary.
Модальности:
Генерация текста
Области применения:
Математика
Задача: Генерация текста
Автор: pankajmathur
Теги: llama, en, model-index, text-generation-inference, endpoints_compatible
Лайков: 2 | Загрузок: 17
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
