 GGUF is file format used for storing models for inference, particularly in the context of language models like GPT. GGUF models could be run on CPUs, which made them accessible to a wider range of users. 1. Install ollama; 2. Download astrollama.gguf to your PC; 3. Create a file named Modelfile, and add a FROM instruction with the local filepath to AstroLLaMA, e.g.,
Модальности:
Генерация текста
Задача: Генерация текста
Автор: UniverseTBD
Теги: gguf, astronomy, science, LLM, en, endpoints_compatible
Лайков: 3 | Загрузок: 12
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.