Back to skill

Security audit

Ab Test Runner

Security checks for vulnerabilities and agentic risk

Overview

This is a coherent A/B testing workflow skill with disclosed local experiment archiving, but users should be aware it can persist experiment details in memory files.

Install only if you want a structured A/B testing workflow that may save experiment summaries and findings under memory/experiments. Avoid using sensitive, confidential, or proprietary prompts and outputs unless you are comfortable with those details being retained, and ask the agent not to archive or to redact details when needed.

Vulnerability Patterns
  • Skill Instruction HijackingAlters the agent's session goals or safety constraints when the skill loads
  • Agent Memory PoisoningWrites attacker-controlled rules into memory that affect later sessions
  • Remote Payload Retrieval and ExecutionFetches external code whose behavior can change after review
  • Embedded Malicious CodeShips malicious scripts inside the skill and executes them locally
  • Unauthorized Access and Privilege EscalationObtains permissions beyond the task's legitimate needs
Vulnerability Patterns
  • Data ExfiltrationExternal Transmission, Env Variable Harvesting, File System Enumeration
  • Trigger AbuseOverly Broad Trigger, Shadow Command Trigger, Keyword Baiting Trigger
  • Prompt InjectionInstruction Override, Hidden Instructions, Exfiltration Commands
  • Privilege EscalationExcessive Permissions, Sudo/Root Execution, Credential Access
  • Supply ChainUnpinned Dependencies, External Script Fetching, Obfuscated Code
Findings (4)

Vague Triggers

Medium
Category
Not specified by scanner
Confidence
94% confidence
Finding

The manifest says to activate when the user says phrases like "design an experiment" or "compare X vs Y," and also when the user merely "wants to validate a hypothesis via controlled comparison." These conditions are broad, overlap with ordinary analytical requests, and do not provide exclusion criteria or negative examples, which could cause unintended invocation.

Content

No source excerpt is available for this finding.

Missing User Warnings

Medium
Category
Not specified by scanner
Confidence
95% confidence
Finding

The skill directs the agent to persist experiment outputs and summaries to memory files without requiring user consent, disclosure, or data minimization. If prompts, outputs, or task samples contain sensitive user data, this can create unintended long-term retention and secondary exposure through later reads or reuse.

Content

No source excerpt is available for this finding.

Missing User Warnings

Medium
Category
Not specified by scanner
Confidence
97% confidence
Finding

Archiving hypotheses, detailed analyses, and template updates to persistent files compounds privacy risk because it stores richer derived artifacts that may include user intent, proprietary prompts, evaluation data, and conclusions. The absence of retention boundaries or disclosure makes accidental leakage, overcollection, and inappropriate cross-session reuse more likely.

Content

No source excerpt is available for this finding.

Natural-Language Policy Violations

Low
Category
Not specified by scanner
Confidence
83% confidence
Finding

Large portions of the workflow, prompts, examples, and reporting format are written in Chinese, but the skill does not state that it is Chinese-only or allow the user to choose their preferred language. This can amount to an implicit language policy constraint without opt-in.

Content

No source excerpt is available for this finding.

Static analysis

No suspicious patterns detected.