TongjiFinLab/CFGPT1-sft-7B-LoRA - Каталог нейросетей
Генерация текста

TongjiFinLab/CFGPT1-sft-7B-LoRA

Добавлено:

📈 CFGPT: Chinese Financial Assistant with Large Language Model (CFGPT1-sft-7b-LoRA) We introduce CFGPT, an open-source language model trained by firstly further pretraining general LLMs on collected and cleaned Chinese finance text data (CFData-pt), including financial domain-specific data (announcement, finance articles, finance exams, finance news, finance research papers) and general data (Wikipedia), and secondly fine-tuning with knowledge-intensive instruction tuning dat As for preliminary evaluation, we use CFBenchmark-Basic. CFGPT outperforms the baselines on objective and subjective tasks compared to several baseline models with similar parameters. In this repository, we will share the supervised finetuning LoRA model. — Supervised Finetuned Model (Lora): Adapter model weights trained by PEFT (LoRA). Clone [CFGPT]() repository, create a Python environment, and activate it via the following command CFGPT是一个开源的语言模型,首先通过在收集和清理的中国金融文本数据(CFData-pt)上进行继续预训练,包括金融领域特定数据(公告、金融文章、金融考试、金融新闻、金融研究论文)和通用数据(维基百科),然后使用知识密集的指导调整数据(CFData-sft)进行微调。 我们使用CFBenchmark-Basic进行初步评估。与几个具有相似参数的基线模型相比,CFGPT在识别,分类和生成任务上表现优越。 — Supervised Finetuned Model (Lora):…

Модальности:
Генерация текста


Задача: Генерация текста
Автор: TongjiFinLab
Теги: zh
Лайков: 2  |  Загрузок: 0

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.

Теги: #zh