I am introducing the experimental release of Qyrou-1 — a family of Small Language Models (SLMs) designed for practical, efficient parameter sizes. The series includes Vega (65M) and explores Sao (35M) and Aeon (125M) as potential variants. This model represents an experimental checkpoint from the initial pre-training phase. It is provided as-is for custom fine-tuning and further research experiments. > This experimental checkpoint has been trained on a diverse corpus containing mostly English, as well as math, grade-school science, basic coding, and step-by-step reasoning samples. It has not been trained on the full curated dataset. I am working on a newer model as part of my research and plan to use a standard architecture. The Qyrou-1 series is built for researchers and developers exploring Small Language Models (SLMs), novel architecture designs, and practical model integration. Qyrou-Vega models are the mid-sized variants within the Qyrou model family. They are designed to handle a broad range of tasks typically supported by small language models, including summarization, fill-in-the-middle (FIM), basic code completion, text generation, mathematical reasoning, and more. This…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: mithulaartigala
Теги: qyrou_arch, base-model, experimental, custom-architecture, small-language-model, triton, conversational, custom_code
Лайков: 3 | Загрузок: 319
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
