01 // Overview Harmony-Bird-12B is a merged model intended for roleplay and storytelling. Built with MergeKit. 02 // Merge Step 1 Vermilion-Sage-12B merges with Impish-Nemo-12B using the harmonyforge method (focus=8.0, blend=0.7). Show YAML mergemethod: harmonyforge models: — model: Vortex5/Vermilion-Sage-12B — model: SicariusSicariiStuff/ImpishNemo_12B parameters: focus: 8.0 blend: 0.7 tokenizer: source: union dtype: bfloat16 03 // Custom merge method It is a custom adaptive merge method that blends models through consensus weighting across both spatial (parameter alignment) and frequency (spectral structure) domains. It is designed for stable, noise-resistant merges that preserve the shared strengths of multiple models while reducing conflicts and outlier effects. It supports standard and task-vector merging (when a basemodel is provided). How it works: The method first centers all model weights (relative to either a basemodel or their median) and normalizes their scales to ensure balance. It then analyzes correlations in parameter space (spatial features) and in the frequency domain (via FFT) to measure similarity and coherence between models. Each model receives…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: Vortex5
Теги: mistral, mergekit, merge, roleplay, conversational, text-generation-inference, endpoints_compatible
Лайков: 4 | Загрузок: 13
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
