Magnum «Diamond» in reference to the intense heat and pressure (generated through matrix multiplications) needed to turn the coal-esque material of dry, assistant-tuned models into creative writing gems! This model is finetuned from a text-only conversion of mistralai/Mistral-Small-3.1-24B-Instruct-2503 as an rsLoRA adapter. It uses the same data mix as Doctor-Shotgun/L3.3-70B-Magnum-v5-SFT-Alpha, however with pre-tokenization and modifications to the custom loss masking. The goal was to re-create the model at a smaller, more consumer-friendly size. This model should perform competently with or without prepending character names, and with or without prefill. The objective, as with the other Magnum models, is to emulate the prose style and quality of the Claude 3 Sonnet/Opus series of models on a local scale, so don’t be surprised to see «Claude-isms» in its output. Here’s the rsLoRA adapter for those merge-makers out there to play with. This model follows the Mistral v7 Tekken prompt format. Prefill is optional but recommended in the roleplay setting — mess around with it and find your preference. A typical input would look like this: Many inference libraries have the option to…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: DS-Archive
Теги: mistral, axolotl, chat, conversational, en, text-generation-inference, endpoints_compatible
Лайков: 4 | Загрузок: 24
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
