Метка: linear-transformer

FWKV/FWKV-ROSA

A 56M‑parameter, from‑scratch recurrent language model that combines a per‑channel leaky integrator (FWKV) with the RWKV‑8 ROSA copy‑signal...