Prompt debt and the case for evals
Prompts are brittle specs; durable AI products need evals that survive model, harness and prompt changes
Here are some principles you can infer from @satyanadella 's paragraph: - There will be a better model tomorrow. - Prompts are great for building POCs, but terrible at specifying system behaviors. - To switch models easily, you need good