Missing User Warnings
Medium
- Confidence
- 93% confidence
- Finding
- The guidance recommends collecting production queries, retrieved chunks, and user feedback for dataset creation, but it omits any privacy, consent, retention, redaction, or access-control considerations. In a RAG system, production queries and feedback commonly contain personal, confidential, or proprietary data, so copying them into evaluation datasets can create unnecessary data exposure and compliance risk.
