3 appearances on the backlist front page in the last 30 days.
Are AI agents shape rotators? In this new benchmark, we let the models play campaign puzzles in Opus Magnum, a puzzle game by @zachtronics . Ironically, Claude Opus 4.8 performed poorly, being beaten by GPT-5.5, Gemini 3.5 Flash, and GLM
To succeed at this game, agents must reason about shape rotation, concurrency, and optimizing against competing tradeoffs. To match the human world record on all puzzles would be an insane feat. Agents played the game entirely through a py
fwiw there's pretty heavy overlap in the 90% confidence interval for all of these models and the differences between any of the models would not be considered statistically significant. I've still seen enough other benchmarks to judge the