Calme-4x7B is a Mixture of Experts (MoE) model, integrating four state-of-the-art Calme-7B models. Essentially, Calme-4x7B is composed of four Calme-7B models that have been individually fine-tuned, featuring two experts per token. This configuration brings the total to over 24 billion parameters. Calme-4x7B models are distinguished by their ability to generate text with exceptional clarity, calmness, and coherence. Some extra information to help you pick the right Calme-7B model: > I love how GGUF democratizes the use of Large Language Models (LLMs) on commodity hardware, more specifically, personal computers without any accelerated hardware. Because of this, I am committed to converting and quantizing any models I fine-tune to make them accessible to everyone! — GGUF (2/3/4/5/6/8 bits): MaziyarPanahi/Calme-4x7B-MoE-v0.2-GGUF
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: MaziyarPanahi
Теги: mixtral, generated_from_trainer, mistral, 7b, calme, moe, conversational, text-generation-inference
Лайков: 3 | Загрузок: 8,685
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
