42.
What does it cost to evaluate 100% of our agent runs?
What does it cost to evaluate 100% of our agent runs? If you're running an LLM-as-judge, the number that comes back is high enough that you end up sampling 10% and moving on. But sampling 10% doesn't really make evaluation cheaper. The