Back to skill

Security audit

A/B Test Plan Designer

Security checks for vulnerabilities and agentic risk

Overview

The skill performs limited local document work, but its advertised sample-size calculator is incomplete and needs independent checking.

Use this as a planning aid and calculate sample sizes independently before committing advertising spend. Check rate units and the mismatched baseline field. The output overwrites calculation.md in the selected folder. Treat the optional Windows app as a separate software decision; the benign verdict does not validate that executable.

Vulnerability Patterns
  • Skill Instruction HijackingAlters the agent's session goals or safety constraints when the skill loads
  • Agent Memory PoisoningWrites attacker-controlled rules into memory that affect later sessions
  • Remote Payload Retrieval and ExecutionFetches external code whose behavior can change after review
  • Embedded Malicious CodeShips malicious scripts inside the skill and executes them locally
  • Unauthorized Access and Privilege EscalationObtains permissions beyond the task's legitimate needs
Vulnerability Patterns
  • MCP Least PrivilegeUnderdeclared Capability, Wildcard Permission, Missing Permission Declaration
  • MCP Tool PoisoningHidden Instructions, Unicode Deception, Parameter Description Injection
  • Prompt InjectionInstruction Override, Hidden Instructions, Exfiltration Commands
  • Data ExfiltrationExternal Transmission, Env Variable Harvesting, File System Enumeration
  • Privilege EscalationExcessive Permissions, Sudo/Root Execution, Credential Access
Findings (3)

Description-Behavior Mismatch

High
Category
MCP Tool Poisoning
Confidence
99% confidence
Finding

The code is related to A/B testing, but its implemented behavior is materially narrower than the declared purpose: it produces a static report rather than a calculated test plan. In particular, the sample-size formula is only printed, never executed. The local input reading and report writing are ordinary supporting operations; no unrelated access or hidden external activity is evident.

Content

No source excerpt is available for this finding.

Skill declares no tool scope ('permissions' or 'allowed-tools') but code capabilities were detected: file_write.

Medium
Category
MCP Least Privilege
Confidence
70% confidence
Finding

Without declared permissions the skill's intent is opaque and cannot be validated.

Content

No source excerpt is available for this finding.

The script claims to compute sample size but only echoes inputs and the formula.

Medium
Category
Excessive Agency
Confidence
99% confidence
Finding

The script promises a sample-size calculation but only writes the supplied inputs and a formula to calculation.md, without calculating or reporting the required sample size. This is an output-integrity flaw rather than a code-execution vulnerability: an agent or user could mistake successful report generation for a completed calculation and proceed with an underpowered test. The skill's advertising and conversion-testing context makes this consequential because invalid test plans can lead to wasted spending and unsupported business decisions.

Content

No source excerpt is available for this finding.

Static analysis

No suspicious patterns detected.