This is a model merge between: — nightmedia/Qwen3-4B-Element8-Eva-Heretic — ZeroXClem/Qwen3-4B-Sky-High-Hermes > This model is an advanced evolution of ZeroXClem/Qwen3-4B-Hermes-Axion-Pro, combining multiple state-of-the-art Heretic Abliterated reasoning experts with Claude 4.5, Gemini 3, Opus 3, and Haiku distillations — all under a finely tuned 262,144 token context window. Both models share a lot of common traits, with a few model differences in the merge. There is nothing wrong with Sky-High-Hermes, the merge was sucessful in its own right: intellectually it is between Thinking and Instruct base models, with a lot of good traces from cloud models it can activate on inference. I used different models as baseline for scaffolding: Jan and RA-SFT already have impressive metrics that lift the base model and provide structure. Starting from baseline is hard work to reach long arc, so a few models with good skills help in the merge. The first merge is always for me a 4.3.2.1 ratio of a strong base, a good instruct, and a couple thinking models, one with long reach. This creates the «room», so to speak. On this, successive multislerps form a multidimensional matrix where the models…
Модальности:
Генерация текста
Области применения:
Генерация кода Диалог / чат
Задача: Генерация текста
Автор: nightmedia
Теги: qwen3, coding, research, deep thinking, 1M context, 256k context, Qwen3, All use cases
Лайков: 3 | Загрузок: 27
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
