gibc-v2-lm
A 49.8M-parameter base language model, pretrained from scratch (random initialisation, own tokenizer, no teacher, no distillation) on 20B...
A 49.8M-parameter base language model, pretrained from scratch (random initialisation, own tokenizer, no teacher, no distillation) on 20B...