CoderLM is a compact 100.2M-parameter language model purpose-built for multi-language code generation across 13 programming and markup languages — Python, Java, JavaScript, C++, C, Rust, TypeScript, Go, HTML, CSS, Shell, SQL, and Markdown. Built on the custom AnvArc (AnveshAI Architecture) — a 15-layer hybrid architecture combining 10× ParallelMinGRU linear recurrence and 5× Differential Grouped-Query Attention (DifferentialGQA) — CoderLM delivers high-efficiency code generation and fill-in-the-middle infilling with an expanded 2,048-token context window. Small enough to run on any device — including edge devices like smartphones, tablets, Raspberry Pi, and other embedded hardware. At just ~191MB (FP16), CoderLM brings multi-language code generation to devices where larger models simply can’t run. No high-end GPU required — it runs comfortably on CPU or mobile accelerators. CoderLM uses structured special tokens for sequence control, language conditioning, and code infilling: — 100M scale — this is a lightweight edge model; complex multi-file architectural reasoning is beyond its capacity — 2,048 token context window — designed for single files, functions, and FIM completions…
Модальности:
Генерация текста
Области применения:
Генерация кода
Задача: Генерация текста
Автор: AnveshAI
Теги: anveshai_coderlm, code, causal-lm, anveshai, coderlm, anvarc, mingru, differential-attention
Лайков: 3 | Загрузок: 313
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.