11.
Marin preregistered the loss for a 1e23 FLOPs MoE run
The Marin team preregistered a large MoE training loss before launch and beat it, making scaling-law forecasting auditable instead of retrospective
@percyliang on Backlist
1 appearance on the backlist front page in the last 30 days.