Back to skill

Security audit

AB Test Framework

Security checks for vulnerabilities and agentic risk

Overview

Review recommended because this skill can store submitted test prompts in logs and has a weak, malformed dependency setup.

Install only after reviewing whether prompt contents may enter logs in your environment. The publisher should remove or pin the unused dependency with a lockfile, fix package.json, redact logged inputs, and implement the documented A/B testing behavior before relying on this skill for real model evaluation.

Vulnerability Patterns
  • Insecure DependenciesIntroduces malicious components through unsafe dependency sources
  • Insecure Skill Coding PracticesFinds exploitable flaws such as hardcoded secrets or command injection
  • Skill Instruction HijackingAlters the agent's session goals or safety constraints when the skill loads
  • Agent Memory PoisoningWrites attacker-controlled rules into memory that affect later sessions
  • Remote Payload Retrieval and ExecutionFetches external code whose behavior can change after review
Findings (2)

T09 · Insecure Skill Coding Practices

Warning
Location
index.js:28
Finding

Unsanitized User-Controlled Parameters Written to Logs

Content
View full analysis
Remediation
View remediation

T08 · Insecure Dependencies

Warning
Location
package.json:6
Finding

Unnecessary Mutable Third-Party Dependency Without an Integrity Lock

Content
View full analysis
Remediation
View remediation
Vulnerability Patterns
  • Supply ChainUnpinned Dependencies, External Script Fetching, Obfuscated Code
  • Prompt InjectionInstruction Override, Hidden Instructions, Exfiltration Commands
  • Data ExfiltrationExternal Transmission, Env Variable Harvesting, File System Enumeration
  • Privilege EscalationExcessive Permissions, Sudo/Root Execution, Credential Access
  • Excessive AgencyUnrestricted Tool Access, Autonomous Decision Making, Scope Creep
Findings (1)

Unpinned Dependencies

Low
Category
Supply Chain
Confidence
93% confidence
Finding

The dependency uses a caret range (^1.0.0), which permits automatic installation of newer compatible releases rather than an exact vetted version. This can introduce supply-chain risk if a later published package version is compromised, vulnerable, or behaviorally incompatible, though the impact here is limited because this file alone does not show privileged install hooks or especially sensitive dependency usage.

Content

Scanner excerpt · package.json (reported line 7)May include surrounding context.

json
"description": "Compare models with A/B testing for selection",
  "main": "index.js",
  "dependencies": {
    "stats-library": "^1.0.0"
  }}
}

Static analysis

No suspicious patterns detected.