Natural-Language Policy Violations
Medium
- Confidence
- 98% confidence
- Finding
- The example "With guardrail (PASS)" response includes the full Datadog API key in plaintext while simultaneously asserting that secrets must never appear in output. Because safety documentation is often copied into prompts, tests, or implementations, this creates a direct secret-handling contradiction and can normalize or propagate unsafe behavior. In the context of a digest skill that processes memory files, reproducing secrets in examples is especially risky because it may leak credentials into logs, evaluations, or downstream training data.
