GitHub   |    Paper > NextCoder: Robust Adaptation of Code LMs to Diverse Code Edits (ICML’2025) NextCoder is the latest series of Code-Editing large language models developed using the Qwen2.5-Coder Instruct variants as base and trained with novel Selective Knowledge Transfer finetuning methodology as introduced in the paper. NextCoder family model comes in 3 different sizes 7, 14, 32 billion parameters, to meet the needs of different developers. Following are the key improvements: — Significantly improvements in code editing, NextCoder-32B has performing on par with GPT-4o on complex benchmarks like Aider-Polyglot with performance increment of 44% from their base model. — No loss of generalizibility, due to our new finetuning method SeleKT — Long-context Support up to 32K tokens. This repo contains the NextCoder-32B model, which has the following features: — Type: Causal Language Models — Training Stage: Post-training with SeleKT — Architecture: transformers with RoPE, SwiGLU, RMSNorm, and Attention QKV bias — Number of Parameters: 32.5B — Number of Paramaters (Non-Embedding): 31.0B — Number of Layers: 64 — Number of Attention Heads (GQA): 40 for Q and 8 for KV…
Модальности:
Генерация текста
Области применения:
Генерация кода Диалог / чат
Задача: Генерация текста
Автор: gabriellarson
Теги: gguf, code, chat, microsoft, nextcoder, selekt, en, endpoints_compatible
Лайков: 4 | Загрузок: 304
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
