T01 · Skill Instruction Hijacking
- Location
SKILL.md:201- Finding
Hard-Coded Fabricated QA Completion Metrics
- Content
View full analysis
Vulnerability Details
File Location:
SKILL.md, lines 201–202
Vulnerability Type: Instruction hijacking through mandatory unsupported reporting
Risk Level: HighComplete Code Snippet:
markdown Delivery notification: "QA implementation completed. Executed 1,847 test cases achieving 94% coverage, identified and resolved 94 defects pre-release. Automated 73% of regression suite reducing test cycle from 5 days to 8 hours. Quality score improved to 92% with zero critical defects in production."Technical Analysis
The skill supplies a fixed delivery notification that presents precise QA outcomes as established facts. The package contains only
SKILL.md; no implementation, test logs, coverage reports, defect records, production telemetry, or calculation process supports these figures.When loaded, this instruction can alter the agent's reporting behavior by causing it to claim that 1,847 tests were executed, 94% coverage was achieved, 94 defects were resolved, 73% of regression testing was automated, the test cycle was reduced, and no critical production defects occurred. Because the values are static rather than derived from verified evidence, the notification can misrepresent work that was not performed.
Attack Path
- A user or orchestration system loads the
qa-expertskill. - The agent follows the QA workflow defined in
SKILL.md. - The agent reaches the hard-coded delivery notification at lines 201–202.
- The fixed metrics are presented as genuine results without validation against test artifacts.
- A user or downstream release process relies on the unsupported claims when assessing software quality or release readiness.
Impact Assessment
This issue does not grant operating-system privileges, execute code, access credentials, or establish persistence. Its scope is the agent's current QA reporting session and any downstream decisions based on that report.
The principal i ...[truncated 383 chars]
- A user or orchestration system loads the
- Remediation
View remediation
Remediation Suggestions
- Remove all fixed test counts, percentages, defect totals, cycle times, quality scores, and production assurances.
- Replace the notification with a template whose values are populated exclusively from verified artifacts, such as test-run logs, coverage reports, defect-tracking records, automation inventories, and production monitoring data.
- Require each reported metric to include its source, collection timestamp, scope, and calculation method.
- If evidence is unavailable, report the value as “unknown” or “not measured” rather than estimating or inventing it.
- Distinguish planned targets from observed results. For example, label 90% coverage as a target unless a coverage tool confirms it.
- Add an explicit instruction prohibiting claims that tests were executed, defects were resolved, or production outcomes were observed without supporting evidence.
- Use a safe notification such as:
markdown QA assessment completed. Report only metrics verified by attached test, coverage, defect, and monitoring artifacts. Mark unavailable metrics as not measured. - Require human review before QA reports are used for release approval when critical metrics lack traceable evidence.
