This is quantized version of ibm-granite/granite-3.1-3b-a800m-base created using llama.cpp Model Summary: Granite-3.1-3B-A800M-Base extends the context length of Granite-3.0-3B-A800M-Base from 4K to 128K using a progressive training strategy by increasing the supported context length in increments while adjusting RoPE theta until the model has successfully adapted to desired length of 128K. This long-context pre-training stage was performed using approximately 500B tokens. — Developers: Granite Team, IBM — GitHub Repository: ibm-granite/granite-3.1-language-models — Website: Granite Docs — Paper: Granite 3.1 Language Models (coming soon) — Release Date: December 18th, 2024 — License: Apache 2.0 Supported Languages: English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, and Chinese. Users may finetune Granite 3.1 models for languages beyond these 12 languages. Intended Use: Prominent use cases of LLMs in text-to-text generation include summarization, text classification, extraction, question-answering, and more. All Granite Base models are able to handle these tasks as they were trained on a large amount of data from various domains.…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: QuantFactory
Теги: gguf, language, granite-3.1
Лайков: 3 | Загрузок: 265
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
