shpotes/codegen-350M-mono - Каталог нейросетей
Генерация текста

shpotes/codegen-350M-mono

Добавлено:
shpotes/codegen-350M-mono

The CodeGen model was proposed in by Erik Nijkamp, Bo Pang, Hiroaki Hayashi, Lifu Tu, Huan Wang, Yingbo Zhou, Silvio Savarese, and Caiming Xiong. From Salesforce Research. The abstract from the paper is the following: Program synthesis strives to generate a computer program as a solution to a given problem specification. We propose a conversational program synthesis approach via large language models, which addresses the challenges of searching over a vast program space and user intent specification faced in prior approaches. Our new approach casts the process of writing a specification and program as a multi-turn conversation between a user and a system. It treats program synthesis as a sequence prediction problem, in which the specification is expressed in natural language and the desired program is conditionally sampled. We train a family of large language models, called CodeGen, on natural language and programming language data. With weak supervision in the data and the scaling up of data size and model size, conversational capacities emerge from the simple autoregressive language modeling. To study the model behavior on conversational program synthesis, we develop a…

Модальности:
Генерация текста


Задача: Генерация текста
Автор: shpotes
Теги: codegen, endpoints_compatible
Лайков: 3  |  Загрузок: 78

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.