danube-ko-1.8b-base is a continual pre-trained Korean language model based on h2oai/h2o-danube2-1.8b-base. The vocabulary size was expanded from original 32000 to 40000 to add Korean tokens efficiently. We used the EEVE technique for training. The model has sequence length of 2048. Everything else is the same as the original model. INVALID LANGUAGE PAIR SPECIFIED. EXAMPLE: LANGPAIR=EN|IT USING 2 LETTER ISO OR RFC3066 LIKE ZH-CN. ALMOST ALL LANGUAGES SUPPORTED BUT SOME MAY HAVE NO CONTENT The Model can also generate information that is not accurate. The Model is used at your own risk, and the developers are not responsible for the information generated by the model.
Модальности:
Генерация текста
Задача: Генерация текста
Автор: jjhsnail0822
Теги: mistral, h2o-danube2, korean, sLLM, llm, ko, en, text-generation-inference
Лайков: 3 | Загрузок: 117
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
