Missing User Warnings
Medium
- Confidence
- 89% confidence
- Finding
- The guidance explicitly recommends using real-world user queries and production data for evaluations without any accompanying privacy, consent, minimization, or de-identification safeguards. In an AI PM playbook, that omission can lead teams to reuse sensitive production data in eval pipelines, exposing personal, confidential, or regulated information to reviewers, vendors, or secondary models.
