📈 CFGPT: Chinese Financial Assistant with Large Language Model (CFGPT1-pt-7b) We introduce CFGPT, an open-source language model trained by firstly further pretraining general LLMs on collected and cleaned Chinese finance text data (CFData-pt), including financial domain-specific data (announcement, finance articles, finance exams, finance news, finance research papers) and general data (Wikipedia), and secondly fine-tuning with knowledge-intensive instruction tuning data (CFD As for preliminary evaluation, we use CFBenchmark-Basic. CFGPT outperforms the baselines on objective and subjective tasks compared to several baseline models with similar parameters. In this repository, we will share the further pretrained model. — Pretrained Model: Full model weights after further pretraining with the chinese finance text corpus to comply with the InternLM model license. The CFGPT1-pt-7b is a pre-trained model, which has not undergone supervised fine-tuning with a instruction data. Therefore, it is not advisable to use this model for financial tasks. Please refer to [CFGPT]() Github repo for further usage.…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: TongjiFinLab
Теги: internlm, feature-extraction, custom_code, zh
Лайков: 3 | Загрузок: 24
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
