#agents

Tribal knowledge encoded as an AI skill is still just text until you evaluate it. Ablation baselines, routing regression tests, trajectory autoraters, the gotchas flywheel: the evaluation infrastructure that keeps encoded knowledge from rotting.

Everyone is worried about AI reading things it shouldn't. That's the wrong threat model. The real problem is what agents do after they read.