> NeoHorse-1-4B is a 4-billion-parameter causal language model from TokenRhythm, post-trained from Qwen3.5-4B as an initial prototype on the path toward recursive self-improvement (RSI), targeting text-based agent harnesses, tool use, coding, and instruction following. Like its 9B sibling, its core innovation is a routing harness that assigns tasks to a heterogeneous model pool, records tool interactions and outcomes, estimates capability demand, and feeds that signal back into shaping the next training mixture via routing-guided curriculum SFT and on-policy distillation, backed by rigorous deduplication, decontamination, and six-dimensional semantic data evaluation. This release contains language-model weights only (vision weights excluded, repackaged for text-only inference) and retains a 262,144-token native context window extensible to 1,010,000. Across a ten-benchmark evaluation against Qwen3.5-4B, Gemma-4-E4B-it, Nanbeige-4.2-3B, Agents-A1-4B, and Spark-X2.5-4B, NeoHorse-1-4B posts the best overall macro average (64.87 vs. 58.94 for its Qwen3.5-4B base, a +5.93 gain), with the largest improvements on agentic benchmarks like VitaBench (+10.50), WorkBuddy Bench (+9.79),…
Модальности:
Генерация текста
Области применения:
Генерация кода Диалог / чат Вызов функций (Tool use)
Задача: Генерация текста
Автор: prithivMLmods
Теги: gguf, text-generation-inference, llama-cpp, agentic, tool-use, coding, reasoning — instruction-following, en
Лайков: 3 | Загрузок: 313
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
