One of the best 7B model on the Open LLM Leaderboard, with performance surpassing dolly-v2-12b! The training code and data will be open sourced later on Github(https://github.com/chi2liu/mamba-gpt-3b). mamba-gpt-7b is trained on multiple datasets: — Stanford Alpaca (en) — Open Assistant (multilingual) — LIMA (en) — CodeAlpaca 20k (en) — GPT-4 Generated Data (en&zh) — UltraChat (en) We have fine-tuned the OpenLLaMA model and surpassed the original model in multiple evaluation subtasks, making it currently one of the best performing 3B model, with comparable performance to llama-7b. — Base model: openlm-research/openllama7b_v2 To use the model with the transformers library on a machine with GPU(s), first make sure you have the transformers, accelerate and torch libraries installed. Please read this disclaimer carefully before using the large language model provided in this repository. Your use of the model signifies your agreement to the following terms and conditions. — Biases and Offensiveness: The large language model is trained on a diverse range of internet text data, which may contain biased, racist, offensive, or otherwise inappropriate content. By using this model, you…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: CobraMamba
Теги: llama, gpt, llm, large language model, en, text-generation-inference
Лайков: 3 | Загрузок: 74
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
