Back to skill

Security audit

Webapp Testing Anthropic

Security checks for vulnerabilities and agentic risk

Overview

The skill is mainly a local web app testing helper, but its server helper can run unbounded shell commands and should be reviewed before installation.

Install only if you are comfortable with the agent running local dev-server commands from trusted project context. Review commands passed to --server, avoid using it on pages containing secrets unless needed, and treat saved screenshots or logs as potentially sensitive.

Vulnerability Patterns
  • Skill Instruction HijackingAlters the agent's session goals or safety constraints when the skill loads
  • Agent Memory PoisoningWrites attacker-controlled rules into memory that affect later sessions
  • Remote Payload Retrieval and ExecutionFetches external code whose behavior can change after review
  • Embedded Malicious CodeShips malicious scripts inside the skill and executes them locally
  • Unauthorized Access and Privilege EscalationObtains permissions beyond the task's legitimate needs
Vulnerability Patterns
  • Data ExfiltrationExternal Transmission, Env Variable Harvesting, File System Enumeration
  • Tool MisuseTool Parameter Abuse, Chaining Abuse, Unsafe Defaults
  • Trigger AbuseOverly Broad Trigger, Shadow Command Trigger, Keyword Baiting Trigger
  • Behavioral ASTexec() Call, eval() Call, Dynamic Import
  • MCP Least PrivilegeUnderdeclared Capability, Wildcard Permission, Missing Permission Declaration
Findings (9)

Tp4

High
Category
MCP Tool Poisoning
Confidence
98% confidence
Finding

The documented purpose emphasizes Playwright-based webapp testing, but the skill also directs the agent to run arbitrary server commands and a follow-up command through a helper script. That mismatch can conceal materially more dangerous behavior than the description suggests, enabling unexpected process creation and command execution on the host.

Content

No source excerpt is available for this finding.

Tool Parameter Abuse

High
Category
Tool Misuse
Confidence
98% confidence
Finding

The finding is valid because raw server command strings are passed directly into a shell, enabling chaining, substitution, redirection, and other shell features. In an agent skill context, this increases abuse potential because a malicious task, repository artifact, or prompt could cause the tool to run unintended OS commands while appearing to merely start a local dev server.

Content

Scanner excerpt · scripts/with_server.py (reported line 69)May include surrounding context.

python
print(f"Starting server {i+1}/{len(servers)}: {server['cmd']}")

            # Use shell=True to support commands with cd and &&
            process = subprocess.Popen(
                server['cmd'],
                shell=True,
                stdout=subprocess.PIPE,

Tool Parameter Abuse

High
Category
Tool Misuse
Confidence
98% confidence
Finding

The finding is valid because raw server command strings are passed directly into a shell, enabling chaining, substitution, redirection, and other shell features. In an agent skill context, this increases abuse potential because a malicious task, repository artifact, or prompt could cause the tool to run unintended OS commands while appearing to merely start a local dev server.

Content

Scanner excerpt · scripts/with_server.py (reported line 69)May include surrounding context.

python
print(f"Starting server {i+1}/{len(servers)}: {server['cmd']}")

            # Use shell=True to support commands with cd and &&
            process = subprocess.Popen(
                server['cmd'],
                shell=True,
                stdout=subprocess.PIPE,

Undeclared Tool Scope

Medium
Category
MCP Least Privilege
Confidence
88% confidence
Finding

The skill instructs use of shell commands and implies file/script creation, but it does not declare any tool restrictions or allowed tools. That increases the chance an agent will execute broader-than-necessary local commands, making the skill harder to sandbox and review safely.

Content

No source excerpt is available for this finding.

subprocess module call

Medium
Category
Dangerous Code Execution
Confidence
97% confidence
Finding

The script launches server commands with subprocess.Popen(..., shell=True), causing each --server value to be interpreted by a shell. If any part of the server command is attacker-controlled or derived from untrusted input, shell metacharacters can inject arbitrary commands, leading to code execution under the user's account.

Content

Scanner excerpt · scripts/with_server.py (reported line 69)May include surrounding context.

python
print(f"Starting server {i+1}/{len(servers)}: {server['cmd']}")

            # Use shell=True to support commands with cd and &&
            process = subprocess.Popen(
                server['cmd'],
                shell=True,
                stdout=subprocess.PIPE,

subprocess module call

Medium
Category
Dangerous Code Execution
Confidence
70% confidence
Finding

subprocess module calls execute external commands. Without careful input validation, this enables command injection.

Content

Scanner excerpt · scripts/with_server.py (reported line 88)May include surrounding context.

python
# Run the command
        print(f"Running: {' '.join(args.command)}\n")
        result = subprocess.run(args.command)
        sys.exit(result.returncode)

    finally:

Missing User Warnings

Low
Category
Not specified by scanner
Confidence
86% confidence
Finding

The skill encourages screenshots, DOM capture, and page-content inspection of local applications without warning that these artifacts may contain secrets, tokens, PII, or proprietary internal data. In a local webapp-testing context, this raises the likelihood of accidental sensitive data exposure through saved files or logs.

Content

No source excerpt is available for this finding.

Missing User Warnings

Low
Category
Not specified by scanner
Confidence
84% confidence
Finding

The script writes a full-page screenshot to /tmp/page_discovery.png, which is a file write that can capture page contents, but there is no prior confirmation prompt or explicit warning beyond the inline code comment. The comment describes the action for developers, yet the script itself provides no user disclosure before saving potentially sensitive visual data.

Content

No source excerpt is available for this finding.

Missing User Warnings

Low
Category
Not specified by scanner
Confidence
81% confidence
Finding

This code fills form fields and clicks a submit button, which can alter application state or trigger side effects, but there is no user-facing warning beyond generic comments and a completion message. For code files, safety-relevant actions should have some disclosure such as a clearer comment, prompt, or documented warning unless the action is clearly framed as the skill's purpose.

Content

No source excerpt is available for this finding.