This is quantized version of anthracite-org/magnum-v4-22b created using llama.cpp This is a series of models designed to replicate the prose quality of the Claude 3 models, specifically Sonnet and Opus. This model is fine-tuned on top of Mistral-Small-Instruct-2409. Below are Instruct and Context templates for use within SillyTavern. We’d like to thank Recursal / Featherless for sponsoring the compute for this train, Featherless has been hosting our Magnum models since the first 72 B and has given thousands of people access to our models and helped us grow. We would also like to thank all members of Anthracite who made this finetune possible. — anthracite-org/c2logs32kmistral-v3v1.2nosystem — anthracite-org/kalo-opus-instruct-22k-no-refusal-no-system — anthracite-org/kalo-opus-instruct-3k-filtered-no-system — anthracite-org/nopmclaudewritingfixed — anthracite-org/kaloopusmisc240827nosystem — anthracite-org/kalomiscpart2nosystem The training was done for 2 epochs. We used 8xH100s GPUs graciously provided by Recursal AI / Featherless AI for the full-parameter fine-tuning of the model.
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: QuantFactory
Теги: gguf, chat, en, endpoints_compatible, conversational
Лайков: 3 | Загрузок: 123
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
