The smallest of cerebras GPT models with only 111M parameters instruction fine-tuned. The model has been evaluated with Huggingface’s Open LLM leaderboard. Have a look at the leaderboard for more details: https://huggingface.co/spaces/HuggingFaceH4/openllmleaderboard The performance of the instruction fine-tuned model does improve compared to the cerebras base model by about 5.7% (average score): Model | Average | ARC (25-shot) | HellaSwag (10-shot) | MMLU (5-shot) | TruthfulQA (0-shot) SebastianSchramm/Cerebras-GPT-111M-instruction | 31.6 | 24.3 | 26.2 Fine-tuning was performed with the promp template from stanford alpaca: It is recommended to format input according to the prompt template mentioned above during inference for best results.
Модальности:
Генерация текста
Области применения:
Следование инструкциям
Задача: Генерация текста
Автор: SebastianSchramm
Теги: gpt2, cerebras, LLM, en, text-generation-inference
Лайков: 3 | Загрузок: 183
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.