21.
Harness Engineering Notes From Shipping Real Agents
Model-task fit matters enough that harness design becomes a first-class engineering discipline
@Vtrivedy10 on Backlist
4 appearances on the backlist front page in the last 30 days.
31.
still true
still true just-in-time harnesses bespokely engineered for your exact task verified with evals this is a recipe for today - models will alter how we build harnesses in the future, but we need to build today :)
57.
nice write up from the HuggingFace folks aggregating works on defining agents, harnesses, environments, RL, etc. …
nice write up from the HuggingFace folks aggregating works on defining agents, harnesses, environments, RL, etc. The more we can roughly have a shared vocabulary the better…I still find it confusing (lolll), but we’re roughly converging on
47.
subtle agent orchestration change that anecdotally works better in pretty much every case I’ve seen (need to run …
subtle agent orchestration change that anecdotally works better in pretty much every case I’ve seen (need to run some evals) bossman supervisor >> external judge >>> self reflection - when verifying agent outputs using a fresh judge (wit