52.
Two years ago, we built OSWorld 1.0 — the benchmark that became the standard for computer-use agents. Agents now …
Two years ago, we built OSWorld 1.0 — the benchmark that became the standard for computer-use agents. Agents now score 83.5% on it. Problem solved? Not even close. Today we introduce OSWorld 2.0: Benchmarking Computer Use Agents on Long-H