Метка: scaling-limits

DedeProGames/LowOnMind-300k

A decoder-only language model with 296,960 parameters, pretrained from scratch on 200M tokens of HuggingFaceFW/fineweb-edu (sample-10BT). It is...