tinybrainbot-360m-a75m-v5.1-chat
A small chill-friend chatbot. This is the casual-conversation version of TinyBrainBot-360M-A75M-v5.1-Instruct: same 383M-parameter mixture-of-experts model (24 experts per...
Метка: from-scratch
tinybrainbot-360m-a75m-v5.1-instruct
One small model for chat, instructions, reasoning and math, now with line breaks and a name. A 383M-parameter...
tinybrainbot-100m-v5.1-base
A 100M-parameter base model trained from scratch on 29.6B tokens, as a plain Llama (LlamaForCausalLM): no custom code....
tinybrainbot-10m-v2-base
A 9.9M-parameter general-purpose base model trained from scratch on 10.16B tokens, as a plain Llama (LlamaForCausalLM): no custom...
tinybrainbot-3m-v2-base
A 2.94M-parameter general-purpose base model trained from scratch on 6.05B tokens, as a plain Llama (LlamaForCausalLM): no custom...
gibc-v2-lm
A 49.8M-parameter base language model, pretrained from scratch (random initialisation, own tokenizer, no teacher, no distillation) on 20B...
sid-gpt-resume-llm
Sid-GPT takes a weak, responsibility-style resume bullet and rewrites it the way a resume that got selected for...
quipu-moe-1B-A149M
A mixture-of-experts language model trained from scratch: 998,007,552 parameters in total, 148,660,992 active per token (998.0M total /...
Moonfrost-777M-Instruct-v1
A supervised fine-tune of Moonfrost-777M, not a separate model. It starts from that base and trains for 0.42...
GTM-v2-base
A ~120M parameter, decoder-only GPT-style base language model, trained from scratch on a single RTX Pro 6000, on...