This repository contains the official checkpoint for PixelGPT, as presented in the paper Autoregressive Pre-Training on Pixels and Texts (EMNLP 2024). For detailed instructions on how to use the model, please visit our GitHub page. MonoGPT is an autoregressive language model pre-trained on the dual modality of both pixels and texts without relying on the pixel-text paired data. By processing documents as visual data (pixels), the model learns to predict both the next token and the next image patch in a sequence, enabling it to handle visually complex tasks in different modalities.
Модальности:
Генерация текста
Задача: Генерация текста
Автор: ernie-research
Теги: ernie-pixel, endpoints_compatible
Лайков: 3 | Загрузок: 16
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
