Happy to share our new ICML oral in Pretraining: OPUS!

Happy to share our new ICML oral in Pretraining: OPUS! It tells: which tokens should the model train on at each step? Instead of static data filtering, OPUS dynamically selects tokens based on the optimizer-shaped updates. Less “more d
Ranked #35 on backlist 2026-05-24 (24 May 2026 UTC) · by (Tianyu Zhang) ·

How it ranks: Backlist reads my Twitter/X timeline, scores every tweet for substance with an LLM rubric (not engagement), and publishes the daily top picks with a one-line takeaway. Curated by Surya Dantuluri.