Gaperon-1125-8B-SFT is an 8 billion parameter instruction-tuned bilingual (French-English) language model. This model is the supervised fine-tuned (SFT) variant of Gaperon-1125-8B, optimized for chat and instruction-following tasks. Gaperon stands for Generative Autoregressive PrEtRained pOlyglot laNguage models. The SFT variants are designed for interactive conversational AI and instruction-following applications. This 8B version offers an excellent balance between capability and resource requirements. — Model Type: Causal Language Model (Instruction-tuned) — Base Model: Gaperon-1125-8B (Black Pepper) — Architecture: Llama 3 — Parameters: 8 billion — Languages: French, English, and code — License: Fully open license — Developed by: ALMAnaCH team, Inria Paris — Training Stages: Pre-training (4T tokens) → SFT The base model underwent extensive training: — 4 trillion tokens of pre-training — Progressive data mixing: Naive → Drop-in-the-ocean → High-Quality → White Pepper → Bla
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: almanach
Теги: llama, gaperon, conversational, fr, en, text-generation-inference, endpoints_compatible
Лайков: 3 | Загрузок: 9
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
