LFM2 is a new generation of hybrid models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency. We’re releasing the weights of our first MoE based on LFM2, with 8.3B total parameters and 1.5B active parameters. — LFM2-8B-A1B is the best on-device MoE in terms of both quality (comparable to 3-4B dense models) and speed (faster than Qwen3-1.7B). — Code and knowledge capabilities are significantly improved compared to LFM2-2.6B. — Quantized variants fit comfortably on high-end phones, tablets, and laptops. Due to their small size, we recommend fine-tuning LFM2 models on narrow use cases to maximize performance. They are particularly suited for agentic tasks, data extraction, RAG, creative writing, and multi-turn conversations. However, we do not recommend using them for tasks that are knowledge-intensive or require programming skills. Supported languages: English, Arabic, Chinese, French, German, Japanese, Korean, and Spanish. Generation parameters: We recommend the following parameters: temperature=0.3 minp=0.15 repetitionpenalty=1.05` Chat template: LFM2 uses a ChatML-like…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: cyankiwi
Теги: lfm2_moe, liquid, lfm2, edge, moe, conversational, en, ar
Лайков: 3 | Загрузок: 297
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
