Back to skill

Security audit

Skill Evolver

Security checks for vulnerabilities and agentic risk

Overview

This skill is mostly coherent for self-improving agent skills, but it has high-impact automatic persistence and safety-review weaknesses that users should review before installing.

Review this before installing. Prefer manual mode, disable remote LLM unless needed, use only trusted HTTPS LLM endpoints, and inspect generated Evolution Units before allowing SKILL.md writeback or cron-style background runs. Resolve the missing setup/schedule files and fail-open reviewer behavior before using it in a sensitive environment.

Vulnerability Patterns
  • Agent Memory PoisoningWrites attacker-controlled rules into memory that affect later sessions
  • Insecure Skill Coding PracticesFinds exploitable flaws such as hardcoded secrets or command injection
  • Skill Instruction HijackingAlters the agent's session goals or safety constraints when the skill loads
  • Remote Payload Retrieval and ExecutionFetches external code whose behavior can change after review
  • Embedded Malicious CodeShips malicious scripts inside the skill and executes them locally
Findings (2)

T02 · Agent Memory Poisoning

Error
Location
scripts/reviewer.js:185
Finding

Fail-Open Security Review Allows Unreviewed Instructions to Persist in Other Skills

Content
View full analysis
Remediation
View remediation
/` only after a successful review. - Record an explicit approval status and reviewer version. 3. **Require positive approval during lifecycle loading** - Change `loadAllPatches()` so only units containing an explicit value such as `review_status: approved` are loaded. - Treat missing, unknown, failed, or pending review states as non-deployable. - Do not rely only on excluding `review_status: rejected`. 4. **Do not deploy unreviewed nursery units** - Require successful security review before nursery selection. - Consider requiring deterministic validation and at least one positive evidence event before persistent inlining. 5. **Add local deterministic security checks** - Reject prompt-override language, secret-access instructions, destructive command guidance, unexpected external URLs, and lifecycle marker manipulation. - Apply these checks independently of the LLM reviewer. - Normalize Unicode and Markdown before matching to reduce bypass opportunities. 6. **Use atomic activation** - Review the exact bytes that will be activated. - Atomically rename the approved file into the active directory. - Prevent content changes between review and deployment. 7. **Add regression tests** - Verify that network failures, malformed reviewer responses, missing credentials, timeouts, and file read failures never activate a unit. - Verify that units without explicit approval cannot be selected or written into `SKILL.md`. ]]>

T09 · Insecure Skill Coding Practices

Warning
Location
scripts/reviewer.js:119
Finding

LLM Reviewer Permits Bearer Credentials and Skill Content over Plaintext HTTP

Content
View full analysis
Remediation
View remediation
Vulnerability Patterns
  • MCP Tool PoisoningHidden Instructions, Unicode Deception, Parameter Description Injection
  • Prompt InjectionInstruction Override, Hidden Instructions, Exfiltration Commands
  • Data ExfiltrationExternal Transmission, Env Variable Harvesting, File System Enumeration
  • Privilege EscalationExcessive Permissions, Sudo/Root Execution, Credential Access
  • Supply ChainUnpinned Dependencies, External Script Fetching, Obfuscated Code
Findings (79)

Tp4

High
Category
MCP Tool Poisoning
Confidence
98% confidence
Finding

The skill description does not adequately disclose that it performs outbound LLM-based evaluation on traces and existing units rather than only local evolution/deployment tasks. Because traces may contain user content, tool outputs, and skill text, this omission creates a meaningful privacy and exfiltration risk under false expectations.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
99% confidence
Finding

The skill description does not adequately disclose that it performs outbound LLM-based evaluation on traces and existing units rather than only local evolution/deployment tasks. Because traces may contain user content, tool outputs, and skill text, this omission creates a meaningful privacy and exfiltration risk under false expectations.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
98% confidence
Finding

The skill description does not adequately disclose that it performs outbound LLM-based evaluation on traces and existing units rather than only local evolution/deployment tasks. Because traces may contain user content, tool outputs, and skill text, this omission creates a meaningful privacy and exfiltration risk under false expectations.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
97% confidence
Finding

The skill description does not adequately disclose that it performs outbound LLM-based evaluation on traces and existing units rather than only local evolution/deployment tasks. Because traces may contain user content, tool outputs, and skill text, this omission creates a meaningful privacy and exfiltration risk under false expectations.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
96% confidence
Finding

The skill description does not adequately disclose that it performs outbound LLM-based evaluation on traces and existing units rather than only local evolution/deployment tasks. Because traces may contain user content, tool outputs, and skill text, this omission creates a meaningful privacy and exfiltration risk under false expectations.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
97% confidence
Finding

The skill description does not adequately disclose that it performs outbound LLM-based evaluation on traces and existing units rather than only local evolution/deployment tasks. Because traces may contain user content, tool outputs, and skill text, this omission creates a meaningful privacy and exfiltration risk under false expectations.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
98% confidence
Finding

The skill description does not adequately disclose that it performs outbound LLM-based evaluation on traces and existing units rather than only local evolution/deployment tasks. Because traces may contain user content, tool outputs, and skill text, this omission creates a meaningful privacy and exfiltration risk under false expectations.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
95% confidence
Finding

The skill description does not adequately disclose that it performs outbound LLM-based evaluation on traces and existing units rather than only local evolution/deployment tasks. Because traces may contain user content, tool outputs, and skill text, this omission creates a meaningful privacy and exfiltration risk under false expectations.

Content

No source excerpt is available for this finding.

Ae1

High
Category
analysis-evasion
Confidence
100% confidence
Finding

Referenced artifact was not completely inspected

Content

Scanner excerpt · SKILL.md (reported line 26)May include surrounding context.

md
**CLI**: `node scripts/evolver-cli.js <command>`

Ae1

High
Category
analysis-evasion
Confidence
100% confidence
Finding

Referenced artifact was not completely inspected

Content

Scanner excerpt · SKILL.md (reported line 148)May include surrounding context.

md
**CLI**: `node scripts/evolver-cli.js <command>`

Ae1

High
Category
analysis-evasion
Confidence
100% confidence
Finding

Referenced artifact was not completely inspected

Content

Scanner excerpt · SKILL.md (reported line 157)May include surrounding context.

md
**CLI**: `node scripts/evolver-cli.js <command>`

Ae1

High
Category
analysis-evasion
Confidence
100% confidence
Finding

Referenced artifact was not completely inspected

Content

Scanner excerpt · SKILL.md (reported line 158)May include surrounding context.

md
**CLI**: `node scripts/evolver-cli.js <command>`

Ae1

High
Category
analysis-evasion
Confidence
100% confidence
Finding

Referenced artifact was not completely inspected

Content

Scanner excerpt · SKILL.md (reported line 166)May include surrounding context.

md
**CLI**: `node scripts/evolver-cli.js <command>`

Ae1

High
Category
analysis-evasion
Confidence
100% confidence
Finding

Referenced artifact was not completely inspected

Content

Scanner excerpt · SKILL.md (reported line 167)May include surrounding context.

md
**CLI**: `node scripts/evolver-cli.js <command>`

Ae1

High
Category
analysis-evasion
Confidence
100% confidence
Finding

Referenced artifact was not completely inspected

Content

Scanner excerpt · SKILL.md (reported line 168)May include surrounding context.

md
**CLI**: `node scripts/evolver-cli.js <command>`

Ae1

High
Category
analysis-evasion
Confidence
100% confidence
Finding

Referenced artifact was not completely inspected

Content

Scanner excerpt · SKILL.md (reported line 179)May include surrounding context.

md
**CLI**: `node scripts/evolver-cli.js <command>`

Ae1

High
Category
analysis-evasion
Confidence
100% confidence
Finding

Referenced artifact was not completely inspected

Content

Scanner excerpt · SKILL.md (reported line 189)May include surrounding context.

md
**CLI**: `node scripts/evolver-cli.js <command>`

Ae1

High
Category
analysis-evasion
Confidence
100% confidence
Finding

Referenced artifact was not completely inspected

Content

Scanner excerpt · SKILL.md (reported line 192)May include surrounding context.

md
**CLI**: `node scripts/evolver-cli.js <command>`

Ae1

High
Category
analysis-evasion
Confidence
100% confidence
Finding

Referenced artifact was not completely inspected

Content

Scanner excerpt · SKILL.md (reported line 195)May include surrounding context.

md
**CLI**: `node scripts/evolver-cli.js <command>`

Ae1

High
Category
analysis-evasion
Confidence
100% confidence
Finding

Referenced artifact was not completely inspected

Content

Scanner excerpt · SKILL.md (reported line 198)May include surrounding context.

md
**CLI**: `node scripts/evolver-cli.js <command>`

Ae1

High
Category
analysis-evasion
Confidence
100% confidence
Finding

Referenced artifact was not completely inspected

Content

Scanner excerpt · SKILL.md (reported line 201)May include surrounding context.

md
**CLI**: `node scripts/evolver-cli.js <command>`

Ae1

High
Category
analysis-evasion
Confidence
100% confidence
Finding

Referenced artifact was not completely inspected

Content

Scanner excerpt · SKILL.md (reported line 204)May include surrounding context.

md
**CLI**: `node scripts/evolver-cli.js <command>`

Ae1

High
Category
analysis-evasion
Confidence
100% confidence
Finding

Referenced artifact was not completely inspected

Content

Scanner excerpt · SKILL.md (reported line 212)May include surrounding context.

md
**CLI**: `node scripts/evolver-cli.js <command>`

Ae1

High
Category
analysis-evasion
Confidence
100% confidence
Finding

Referenced artifact was not completely inspected

Content

Scanner excerpt · SKILL.md (reported line 213)May include surrounding context.

md
**CLI**: `node scripts/evolver-cli.js <command>`

Ae1

High
Category
analysis-evasion
Confidence
100% confidence
Finding

Referenced artifact was not completely inspected

Content

Scanner excerpt · SKILL.md (reported line 214)May include surrounding context.

md
**CLI**: `node scripts/evolver-cli.js <command>`

Static analysis

Detected: suspicious.dangerous_exec, suspicious.env_credential_access, suspicious.exposed_secret_literal

Shell command execution detected (child_process).

Critical
Code
suspicious.dangerous_exec
Location
scripts/lib/llm-client.js:471

Shell command execution detected (child_process).

Critical
Code
suspicious.dangerous_exec
Location
scripts/monitor.js:209

Shell command execution detected (child_process).

Critical
Code
suspicious.dangerous_exec
Location
scripts/preflight.js:230

Environment variable access combined with network send.

Critical
Code
suspicious.env_credential_access
Location
scripts/reviewer.js:125

File appears to expose a hardcoded API secret or token.

Critical
Code
suspicious.exposed_secret_literal
Location
scripts/preflight.js:285