33.
Besides token faithfulness (TITO), there are a few more challenges I noted in long form agent RL, tldr:
Besides token faithfulness (TITO), there are a few more challenges I noted in long form agent RL, tldr: - Rollout takes 80%+ overall time. Long tail (eg. looping errors) rollout are ubiquitous, and so efficient async RL is a must. - Correct