Taiwan LLM is an advanced language model tailored for Traditional Chinese, focusing on the linguistic and cultural contexts of Taiwan. Developed from a large base model, it’s enriched with diverse Taiwanese textual sources and refined through Supervised Fine-Tuning. This model excels in language understanding and generation, aligning closely with Taiwan’s cultural nuances. It demonstrates improved performance on various benchmarks like TC-Eval, showcasing its contextual comprehension and cultural relevance. For detailed insights into Taiwan LLM’s development and features, refer to our technical report. — Model type: A 7B parameter GPT-like model fine-tuned on a mix of publicly available, synthetic datasets. — Language(s) (NLP): Primarily Traditional Chinese (zh-tw) — Finetuned from model: yentinglin/Taiwan-LLM-7B-v2.0-base — Repository: https://github.com/MiuLab/Taiwan-LLaMa — Demo: https://twllm.com/ Here’s how you can run the model using the pipeline() function from 🤗 Transformers: The following hyperparameters were used during training: — learningrate: 5e-05 — distributedtype: multi-GPU — optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 — lrschedulertype: cosine -…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: ZoneTwelve
Теги: gguf, zh, endpoints_compatible, conversational
Лайков: 3 | Загрузок: 651
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
