LFM2.5-350M is a general-purpose text-only model with the following features: — Number of parameters: 350M — Number of layers: 16 (10 double-gated LIV convolution blocks + 6 GQA blocks) — Training budget: 28T tokens — Context length: 32,768 tokens — Vocabulary size: 65,536 — Knowledge cutoff: Mid-2024 — Languages: English, Arabic, Chinese, French, German, Japanese, Korean, Portuguese, Spanish — Generation parameters: — temperature: 0.1 — topk: 50 — repetitionpenalty: 1.05 We It is not recommended for knowledge-intensive tasks and programming. LFM2.5 uses a ChatML-like format. See the Chat Template documentation for details. Example: You can use tokenizer.applychattemplate() to format your messages automatically. 1. Function definition: We recommend providing the list of tools as a JSON object in the system prompt. You can also use the tokenizer.applychattemplate() function with tools. 2. Function call: By default, LFM2.5 writes Pythonic function calls (a Python list between and special tokens), as the assistant answer. You can override this behavior by asking the model to output JSON function calls in the…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: MihaiPopa-1
Теги: lfm2, liquid, lfm2.5, edge, heretic, uncensored, decensored, abliterated
Лайков: 3 | Загрузок: 38
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
