Amadeus-Verbo-FI-Qwen2.5-0.5B-PT-BR-Instruct is a Brazilian-Portuguese language model (PT-BR-LLM) developed from the base model Qwen2.5-0.5B-Instruct through fine-tuning, for 2 epochs, with 600k instructions dataset. Read our article here. — Architecture: a Transformer-based model with RoPE, SwiGLU, RMSNorm, and Attention QKV bias pre-trained via Causal Language Modeling — Parameters: 0.49B parameters — Number of Parameters (Non-Embedding): 0.36B — Number of Layers: 24 — Number of Attention Heads (GQA): 14 for Q and 2 for KV — Context length: 32,768 tokens — Number of steps: 78838 — Language: Brazilian Portuguese You can use Amadeus-Verbo-FI-Qwen2.5-0.5B-PT-BR-Instruct with the latest HuggingFace Transformers l Below, we have provided a simple example of how to load the model and generate text: The following code snippet uses pipeline, AutoTokenizer, AutoModelForCausalLM and applychattemplate to show how to load the tokenizer, the model, and how to generate content.
Модальности:
Генерация текста
Области применения:
Диалог / чат Следование инструкциям
Задача: Генерация текста
Автор: amadeusai
Теги: qwen2, text-generation-inference, conversational, pt, endpoints_compatible
Лайков: 4 | Загрузок: 114
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
