Back to skill

Security audit

Supervised Agentic Loop

Security checks for vulnerabilities and agentic risk

Overview

This is a real autonomous code-improvement skill, but it overstates its safety boundaries and can affect more repository data than its one-file framing implies.

Install or run this only in a disposable, clean Git worktree or clone with no uncommitted, untracked, or secret files. Use only repository-relative target paths, and assume target file content may be provided to the configured agent. Telegram alerts are opt-in, but setting those environment variables sends alert data to Telegram.

Vulnerability Patterns
  • Unauthorized Access and Privilege EscalationObtains permissions beyond the task's legitimate needs
  • Insecure Skill Coding PracticesFinds exploitable flaws such as hardcoded secrets or command injection
  • Skill Instruction HijackingAlters the agent's session goals or safety constraints when the skill loads
  • Agent Memory PoisoningWrites attacker-controlled rules into memory that affect later sessions
  • Remote Payload Retrieval and ExecutionFetches external code whose behavior can change after review
Findings (3)

T09 · Insecure Skill Coding Practices

Error
Location
sal/git_isolation.py:77
Finding

Repository-Wide Git Operations Can Commit or Destroy Files Outside the Declared Target Scope

Content
View full analysis
str: """Stage all changes and commit. Args: message: Commit message. Returns: Short SHA of the new commit. """ self._run("add", "-A") self._run("commit", "-m", message, "--allow-empty") sha = self.current_short_sha() self._last_good_commit = sha return sha def rollback(self) -> None: """Reset to last known good commit. Discards all uncommitted changes and resets to the last commit that passed verification. """ if self._last_good_commit: self._run("reset", "--hard", self._last_good_commit) else: self._run("reset", "--hard", "HEAD") # Clean untracked files self._run("clean", "-fd") ``` The repository-wide commit is invoked after a successful metric comparison: ```python if improved: # KEEP — commit changes sha = self.git.commit( f"sal: {hypothesis['description']} " f"(metric: {metric_value:.6f})" ) ``` ### Technical Analysis The Skill declares that the agent modifies exactly one configured `target_file`. However, the implementation neither checks the Git diff against that target nor restricts staging to the target. `git add -A` stages every tracked, modified, deleted, and newly created file in the repository. Consequently, unrelated user changes or unauthorized agent changes can be included in an accepted experiment commit. The rollback path is also repository-wide: - `git reset --hard` discards all tracked working-tree modifications. - `git clean -fd` recursively deletes untracked files and directories. - The implementation does not require a clean working tree before starting. - It does not snapshot or distinguish pre-existing user changes from changes prod ...[truncated 1631 chars]
Remediation
View remediation

T05 · Unauthorized Access and Privilege Escalation

Warning
Location
sal/config.py:47
Finding

Unrestricted Target Paths Allow Reading Files Outside the Working Repository

Content
View full analysis
Remediation
View remediation
``` 6. Avoid sending full source contents to an agent unless necessary. Clearly disclose that target content is supplied to the configured agent and may leave the host if that agent is network-backed. 7. Add tests for absolute paths, `../` traversal, symlink escapes, directories, special files, and valid repository-relative targets. ]]>

T09 · Insecure Skill Coding Practices

Warning
Location
sal/evolve_loop.py:317
Finding

Declared Test and Lint Verification Gates Are Omitted from the Evolution Workflow

Content
View full analysis
Remediation
View remediation
Vulnerability Patterns
  • Tool MisuseTool Parameter Abuse, Chaining Abuse, Unsafe Defaults
  • Taint TrackingDirect Taint Flow, Variable-Mediated Taint Flow, Credential Exfiltration Chain
  • MCP Tool PoisoningHidden Instructions, Unicode Deception, Parameter Description Injection
  • Prompt InjectionInstruction Override, Hidden Instructions, Exfiltration Commands
  • Data ExfiltrationExternal Transmission, Env Variable Harvesting, File System Enumeration
Findings (125)

Tainted flow: 'req' from os.environ.get (line 114, credential/environment) → urllib.request.urlopen (network output)

Critical
Category
Data Flow
Confidence
90% confidence
Finding

Credentials or environment variables flow to a network sink. This is a high-confidence indicator of credential exfiltration.

Content

Scanner excerpt · sal/monitor/alerter.py (reported line 122)May include surrounding context.

python
)

    try:
        with urllib.request.urlopen(req, timeout=10) as resp:
            _recent_alerts.append(time.time())
            logger.info("Alert sent to Telegram (status: %d)", resp.status)
            return resp.status == 200

Tool Parameter Abuse

High
Category
Tool Misuse
Confidence
97% confidence
Finding

Documenting rollback as git reset --hard to a last known good commit describes a destructive command that can irreversibly remove uncommitted work. In an autonomous loop that repeatedly modifies a repository, misuse, scope mistakes, or execution in the wrong directory can amplify damage and wipe user data beyond the experiment changes.

Content

Scanner excerpt · AUTOEVOLVE_CONCEPT.md (reported line 261)May include surrounding context.

md
- `create_evolve_branch(tag)` — creates `cal/{tag}` from current HEAD
- `commit_experiment(message)` — commits current changes
- `rollback()` — `git reset --hard` to last known good commit
- `get_diff()` — returns the code diff for review phase

---

Tp4

High
Category
MCP Tool Poisoning
Confidence
98% confidence
Finding

The skill description makes strong safety claims—destructive-command blocking, misalignment detection, local-by-default operation, and autonomous self-improvement—while the analyzed material does not provide evidence sufficient to validate those protections. Security-significant overclaiming is dangerous because users may trust the skill to safely execute autonomous code-modifying and shell-running workflows under assumptions that are not actually enforced.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
98% confidence
Finding

The skill description makes strong safety claims—destructive-command blocking, misalignment detection, local-by-default operation, and autonomous self-improvement—while the analyzed material does not provide evidence sufficient to validate those protections. Security-significant overclaiming is dangerous because users may trust the skill to safely execute autonomous code-modifying and shell-running workflows under assumptions that are not actually enforced.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
92% confidence
Finding

The skill description makes strong safety claims—destructive-command blocking, misalignment detection, local-by-default operation, and autonomous self-improvement—while the analyzed material does not provide evidence sufficient to validate those protections. Security-significant overclaiming is dangerous because users may trust the skill to safely execute autonomous code-modifying and shell-running workflows under assumptions that are not actually enforced.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
92% confidence
Finding

The skill description makes strong safety claims—destructive-command blocking, misalignment detection, local-by-default operation, and autonomous self-improvement—while the analyzed material does not provide evidence sufficient to validate those protections. Security-significant overclaiming is dangerous because users may trust the skill to safely execute autonomous code-modifying and shell-running workflows under assumptions that are not actually enforced.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
97% confidence
Finding

The skill description makes strong safety claims—destructive-command blocking, misalignment detection, local-by-default operation, and autonomous self-improvement—while the analyzed material does not provide evidence sufficient to validate those protections. Security-significant overclaiming is dangerous because users may trust the skill to safely execute autonomous code-modifying and shell-running workflows under assumptions that are not actually enforced.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
98% confidence
Finding

The skill description makes strong safety claims—destructive-command blocking, misalignment detection, local-by-default operation, and autonomous self-improvement—while the analyzed material does not provide evidence sufficient to validate those protections. Security-significant overclaiming is dangerous because users may trust the skill to safely execute autonomous code-modifying and shell-running workflows under assumptions that are not actually enforced.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
92% confidence
Finding

The skill description makes strong safety claims—destructive-command blocking, misalignment detection, local-by-default operation, and autonomous self-improvement—while the analyzed material does not provide evidence sufficient to validate those protections. Security-significant overclaiming is dangerous because users may trust the skill to safely execute autonomous code-modifying and shell-running workflows under assumptions that are not actually enforced.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
98% confidence
Finding

The skill description makes strong safety claims—destructive-command blocking, misalignment detection, local-by-default operation, and autonomous self-improvement—while the analyzed material does not provide evidence sufficient to validate those protections. Security-significant overclaiming is dangerous because users may trust the skill to safely execute autonomous code-modifying and shell-running workflows under assumptions that are not actually enforced.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
95% confidence
Finding

The skill description makes strong safety claims—destructive-command blocking, misalignment detection, local-by-default operation, and autonomous self-improvement—while the analyzed material does not provide evidence sufficient to validate those protections. Security-significant overclaiming is dangerous because users may trust the skill to safely execute autonomous code-modifying and shell-running workflows under assumptions that are not actually enforced.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
99% confidence
Finding

The skill description makes strong safety claims—destructive-command blocking, misalignment detection, local-by-default operation, and autonomous self-improvement—while the analyzed material does not provide evidence sufficient to validate those protections. Security-significant overclaiming is dangerous because users may trust the skill to safely execute autonomous code-modifying and shell-running workflows under assumptions that are not actually enforced.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
99% confidence
Finding

The skill description makes strong safety claims—destructive-command blocking, misalignment detection, local-by-default operation, and autonomous self-improvement—while the analyzed material does not provide evidence sufficient to validate those protections. Security-significant overclaiming is dangerous because users may trust the skill to safely execute autonomous code-modifying and shell-running workflows under assumptions that are not actually enforced.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
98% confidence
Finding

The skill description makes strong safety claims—destructive-command blocking, misalignment detection, local-by-default operation, and autonomous self-improvement—while the analyzed material does not provide evidence sufficient to validate those protections. Security-significant overclaiming is dangerous because users may trust the skill to safely execute autonomous code-modifying and shell-running workflows under assumptions that are not actually enforced.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
98% confidence
Finding

The skill description makes strong safety claims—destructive-command blocking, misalignment detection, local-by-default operation, and autonomous self-improvement—while the analyzed material does not provide evidence sufficient to validate those protections. Security-significant overclaiming is dangerous because users may trust the skill to safely execute autonomous code-modifying and shell-running workflows under assumptions that are not actually enforced.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
98% confidence
Finding

The skill description makes strong safety claims—destructive-command blocking, misalignment detection, local-by-default operation, and autonomous self-improvement—while the analyzed material does not provide evidence sufficient to validate those protections. Security-significant overclaiming is dangerous because users may trust the skill to safely execute autonomous code-modifying and shell-running workflows under assumptions that are not actually enforced.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
98% confidence
Finding

The skill description makes strong safety claims—destructive-command blocking, misalignment detection, local-by-default operation, and autonomous self-improvement—while the analyzed material does not provide evidence sufficient to validate those protections. Security-significant overclaiming is dangerous because users may trust the skill to safely execute autonomous code-modifying and shell-running workflows under assumptions that are not actually enforced.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
92% confidence
Finding

The skill description makes strong safety claims—destructive-command blocking, misalignment detection, local-by-default operation, and autonomous self-improvement—while the analyzed material does not provide evidence sufficient to validate those protections. Security-significant overclaiming is dangerous because users may trust the skill to safely execute autonomous code-modifying and shell-running workflows under assumptions that are not actually enforced.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
99% confidence
Finding

The skill description makes strong safety claims—destructive-command blocking, misalignment detection, local-by-default operation, and autonomous self-improvement—while the analyzed material does not provide evidence sufficient to validate those protections. Security-significant overclaiming is dangerous because users may trust the skill to safely execute autonomous code-modifying and shell-running workflows under assumptions that are not actually enforced.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
99% confidence
Finding

The skill description makes strong safety claims—destructive-command blocking, misalignment detection, local-by-default operation, and autonomous self-improvement—while the analyzed material does not provide evidence sufficient to validate those protections. Security-significant overclaiming is dangerous because users may trust the skill to safely execute autonomous code-modifying and shell-running workflows under assumptions that are not actually enforced.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
99% confidence
Finding

The skill description makes strong safety claims—destructive-command blocking, misalignment detection, local-by-default operation, and autonomous self-improvement—while the analyzed material does not provide evidence sufficient to validate those protections. Security-significant overclaiming is dangerous because users may trust the skill to safely execute autonomous code-modifying and shell-running workflows under assumptions that are not actually enforced.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
98% confidence
Finding

The skill description makes strong safety claims—destructive-command blocking, misalignment detection, local-by-default operation, and autonomous self-improvement—while the analyzed material does not provide evidence sufficient to validate those protections. Security-significant overclaiming is dangerous because users may trust the skill to safely execute autonomous code-modifying and shell-running workflows under assumptions that are not actually enforced.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
98% confidence
Finding

The skill description makes strong safety claims—destructive-command blocking, misalignment detection, local-by-default operation, and autonomous self-improvement—while the analyzed material does not provide evidence sufficient to validate those protections. Security-significant overclaiming is dangerous because users may trust the skill to safely execute autonomous code-modifying and shell-running workflows under assumptions that are not actually enforced.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
99% confidence
Finding

The skill description makes strong safety claims—destructive-command blocking, misalignment detection, local-by-default operation, and autonomous self-improvement—while the analyzed material does not provide evidence sufficient to validate those protections. Security-significant overclaiming is dangerous because users may trust the skill to safely execute autonomous code-modifying and shell-running workflows under assumptions that are not actually enforced.

Content

No source excerpt is available for this finding.

Tp4

High
Category
MCP Tool Poisoning
Confidence
92% confidence
Finding

The skill description makes strong safety claims—destructive-command blocking, misalignment detection, local-by-default operation, and autonomous self-improvement—while the analyzed material does not provide evidence sufficient to validate those protections. Security-significant overclaiming is dangerous because users may trust the skill to safely execute autonomous code-modifying and shell-running workflows under assumptions that are not actually enforced.

Content

No source excerpt is available for this finding.

Static analysis

No suspicious patterns detected.