Метка: custom-transformer

syntropic-clx/Clyx_0.2-115.67M-BASE

Causal language model trained from scratch on ~1.57B tokens. Custom Transformer with RoPE, RMSNorm, SwiGLU. No external pretrained...