Kurage is a multipurpose RAG model from Lightblue based on the Qwen 2 model (Qwen/Qwen2-7B-Instruct). This version of the model has been trained to perform RAG in English. Multi-chunk RAG — Performs RAG using multiple contexts at once. Single-chunk RAG — Performs RAG using one context at a time, allowing for parallel computing. Answer extension — Prompts the model to write a longer answer to a given question. Multilingual RAG — Performs RAG using contexts in languages different to the language of the question. Q&A generation** — Generates questions and answers from a reference text in order to pre-index a set of texts. For models in other languages check our Kurage collection. A multilingual model is coming soon! This model was trained using a ml.gu7ef.8xlarge-gu100 instance on Platform For AI from Alibaba Cloud. Note — There is a known issue with the single-chunk RAG mode sometimes saying that it cannot answer a question based on the text when it actually can. This was because our single-chunk training data was 50:50 answers vs cannot answer scenarios, making the model overly conservative. We will address this in a week or two when we re-train using 90:10 data with the coming…
Модальности:
Генерация текста
Области применения:
Диалог / чат RAG (поиск + генерация)
Задача: Генерация текста
Автор: lightblue
Теги: qwen2, RAG, conversational, en
Лайков: 3 | Загрузок: 33
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
