Where Evaluation Sets Come From: Historical Work Orders and Real Errors, Not Demo Data
Clean demo sets collapse on real error tickets in production. Build evaluation sets from historical work orders, rejections, and complaints—and add new failures regularly. No pass, no production.