base model is meta llama 3 8b instruct trained on pippa then i trained that model on limarp, both at 8k context for 2 epochs each i would start with every sampler off and temperature at 1 and just make min p 0.05, i got good prompts from this but u can also try to gen settings from shori which are copy pasted below — Main choice (may have repetition issues) — Temperature: 1.0; Min-P: 0.05-0.10; Presence Penalty: 0.35-0.45 — Alternative 1 (appears to solve repetition issues wh — Alternative 2 — Mirostat type: 2, Mirostat Tau: 2.80-3.00; Mirostat Eta: 0.0175-0.0200; neutralize or disable all other samplers
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: ludis
Теги: llama, conversational, text-generation-inference, endpoints_compatible
Лайков: 3 | Загрузок: 21
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
