moe-expert-precision-4b
Training loss over the run (representative logged steps): 0.9714 -> 0.5867 -> 0.5562. Smooth, monotonic decline consistent with...
Метка: compound-ai
moe-expert-datainfra-4b
Held-out loss: 0.696 (epoch 0.2) -> 0.651 (0.6) -> 0.622 (epoch 2). Training loss ended at about 0.55....