QuantFactory/LLaMA-Mesh-GGUF

This is quantized version of Zhengyi/LLaMA-Mesh created using llama.cpp Pre-trained model weights of LLaMA-Mesh: Unifying 3D Mesh Generation with Language Models Zhengyi Wang, Jonathan Lorraine, Yikai Wang, Hang Su, Jun Zhu, Sanja Fidler, Xiaohui Zeng Abstract: This work explores expanding the capabilities of large language models (LLMs) pretrained on text to generate 3D meshes within a unified model. This offers key advantages of (1) leveraging spatial knowledge already embedded in LLMs, derived from textual sources like 3D tutorials, and (2) enabling conversational 3D generation and mesh understanding. A primary challenge is effectively tokenizing 3D mesh data into discrete tokens that LLMs can process seamlessly. To address this, we introduce LLaMA-Mesh, a novel approach that represents the vertex coordinates and face definitions of 3D meshes as plain text, allowing direct integration with LLMs without expanding the vocabulary. We construct a supervised fine-tuning (SFT) dataset enabling pretrained LLMs to (1) generate 3D meshes from text prompts, (2) produce interleaved text and 3D mesh outputs as required, and (3) understand and interpret 3D meshes. Our work is the first to…

Модальности:
Генерация текста

Области применения:
Диалог / чат

Задача: Генерация текста
Автор: QuantFactory
Теги: gguf, mesh-generation, endpoints_compatible, conversational
Лайков: 3  |  Загрузок: 766

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.