LowOnMind-300k
A decoder-only language model with 296,960 parameters, pretrained from scratch on 200M tokens of HuggingFaceFW/fineweb-edu (sample-10BT). It is...
Метка: pretrained-from-scratch
Cosmos-T-80M
Cosmos-T-80M is the first model in the Cosmos-T series — small, from-scratch, decoder-only Transformers pretrained on chain-of-thought data...