This model was generated using llama.cpp at commit ced765be4. 📃 License • 💻 Code • 📑 Technical Report • 📊 Benchmarks • 🚀 Getting Started • 💡 Highlights Youtu-LLM is a new, small, yet powerful LLM, contains only 1.96B parameters, supports 128k long context, and has native agentic talents. On general evaluations, Youtu-LLM significantly outperforms SOTA LLMs of similar size in terms of Commonsense, STEM, Coding and Long Context capabilities; in agent-related testing, Youtu-LLM surpasses larger-sized leaders and is truly capable of completing multiple end2end agent tasks. Youtu-LLM has the following features: — Type: Autoregressive Causal Language Models with Dense MLA — Release versions: Base and Instruct — Number of Parameters: 1.96B — Number of Layers: 32 — Number of Attention Heads (MLA): 16 for Q/K/V — MLA Rank: 1,536 for Q, 512 for K/V — MLA Dim: 128 for QK Nope, 64 for QK Rope, and 128 for V — Context Length: 131,072 — Vocabulary Size: 128,256 This guide will help you quickly deploy and invoke the Youtu-LLM-2B model. This model supports «Reasoning Mode», enabling it to generate higher-quality responses through Chain of Thought (CoT). The following example demonstrates how to…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: Mungert
Теги: gguf, endpoints_compatible, conversational
Лайков: 3 | Загрузок: 225
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
