6 appearances on the backlist front page in the last 30 days.
Result #32: @mihai673 has achieved a 30-step improvement over the old 2026/05/09 record by adding a SODA (Pethick et al. 2026)-style anchor towards init. It is unknown whether this technique can also improve the current record. 2/5
Five recent notable Modded-NanoGPT optimization results: Result #31: Kai Lion and Florian Hübler have improved their Muown-based run from 3075 to 2995 steps by adding NorMuon & ContraMuon modifications. 1/5
I created this new speedrun track, which compares results in terms of steps rather than wallclock, specifically to give a fair chance to optimizers other than Muon. Happy to see the resulting accumulation of public knowledge!
Modded-NanoGPT optimization result #29 (2026/05/14): @eliebakouch has achieved a new step-count record of 2930 via the following techniques: - Add Aurora to mlp.proj - Warmup & cooldown Muon mu - Disable SoftMuon & NorMuon - Extend Contra
These techniques were discovered by a Claude-based autoresearch harness developed by @eliebakouch at @PrimeIntellect 2/2
Modded-NanoGPT optimization result #29 (2026/05/11): @nilinabra has achieved a new step-count record of 2990 (40-step improvement) by halving the growth rate of the L2-norm of the hidden matrix parameters. This result is better than the