Aramis-2B-BitNet (2.41B params / Context Length: Maximum sequence length of 4096 tokens) A compact, agent-oriented small language model focused on contextual reasoning, language understanding and multi-turn instruction following. Built with an iterative post-training recipe: bilingual DPO (FR+EN) + model merging of FR-centric and EN-centric variants. Runs natively as BitNet 1.58-bit (ternary) and is available in GGUF 1.58-bit, lossless from the BF16 checkpoint. Why BitNet (and why this model) — BitNet b1.58 uses ternary weights (−1,0,+1) with abs-mean scaling : very low memory & energy, great CPU/edge throughput, unlike classic FP/INT SLMs. For more details on the underlying architecture and efficiency of BitNet, please refer to the official Microsoft Research publication: BitNet b1.58 2B4T Technical Report — Aramis demonstrates that a 2B BitNet can deliver SOTA language understanding in its class without sacrificing efficiency. — jpacifico/Aramis-2B-BitNet-bf16 (this repo): Contains the retrainable weights in BF16 format — jpacifico/Aramis-2B-BitNet-b1.58-i2s-GGUF : Quantized 1.58-bit GGUF version, you can use with bitnet.cpp Interpretation: Significant gains on language…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: jpacifico
Теги: bitnet, mergekit, merge, conversational, custom_code, en, fr, endpoints_compatible
Лайков: 3 | Загрузок: 34
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
