Back to skill

Security audit

research-first

Security checks for vulnerabilities and agentic risk

Overview

This research helper needs review because its instructions reject stop orders and its completion checks can give misleading results.

Before installing, require cancellation and time or spending limits to override the research criteria. Treat validator results as advisory: nonconsecutive zero-yield rounds incorrectly pass convergence, and declared unresearched directions fail despite documentation saying they are accepted.

Vulnerability Patterns
  • Skill Instruction HijackingAlters the agent's session goals or safety constraints when the skill loads
  • Agent Memory PoisoningWrites attacker-controlled rules into memory that affect later sessions
  • Remote Payload Retrieval and ExecutionFetches external code whose behavior can change after review
  • Embedded Malicious CodeShips malicious scripts inside the skill and executes them locally
  • Unauthorized Access and Privilege EscalationObtains permissions beyond the task's legitimate needs
Findings (1)

T01 · Skill Instruction Hijacking

Warning
Location
references/判据详解.md:56
Finding

Research instructions prohibit honoring an explicit stop order

Content
View full analysis

Impact

An agent following this instruction could continue unwanted research and tool use after authorization is withdrawn, consuming resources beyond the user's request.

Vulnerability Patterns
  • Behavioral ASTexec() Call, eval() Call, Dynamic Import
  • MCP Least PrivilegeUnderdeclared Capability, Wildcard Permission, Missing Permission Declaration
  • MCP Tool PoisoningHidden Instructions, Unicode Deception, Parameter Description Injection
  • Prompt InjectionInstruction Override, Hidden Instructions, Exfiltration Commands
  • Data ExfiltrationExternal Transmission, Env Variable Harvesting, File System Enumeration
Findings (8)

Description-Behavior Mismatch

High
Category
MCP Tool Poisoning
Confidence
99% confidence
Finding

The supplied script has a materially different primary purpose from the declared research tooling. It checks frontmatter name and description, directory-name consistency, SKILL.md length, allowed subdirectories, context: fork, and license presence. These are skill-package compliance checks, not the described research-journal checks. Its filesystem access is local and read-only, with no evident network activity or code execution. This assessment is limited to the supplied chunk; other skill components may implement the declared research features.

Content

No source excerpt is available for this finding.

Description-Behavior Mismatch

High
Category
MCP Tool Poisoning
Confidence
97% confidence
Finding

The script broadly matches the declared research-journal validation purpose, but the description explicitly advertises five criteria, S1–S5. S6 introduces an additional mandatory research-completion requirement rather than merely implementing those five checks. It can reject a journal independently of S1–S5, making the discrepancy material. The supplied code only reads the specified local file and reports findings; no network access, exfiltration, or unrelated execution is evident. Other advertised skill components cannot be assessed from this single code chunk.

Content

No source excerpt is available for this finding.

Skill declares no tool scope ('permissions' or 'allowed-tools') but code capabilities were detected: file_read, shell.

Medium
Category
MCP Least Privilege
Confidence
70% confidence
Finding

Without declared permissions the skill's intent is opaque and cannot be validated.

Content

No source excerpt is available for this finding.

Explicitly marking a direction as unresearched causes failure despite the documented acceptance policy.

Medium
Category
Excessive Agency
Confidence
99% confidence
Finding

L016–L017 explicitly state that exit code 0 includes directions marked as unresearched and that only missing declarations must be fixed. However, L138 counts every 'notdone' entry as a failure, and L146 returns exit code 1 even when all nine directions are declared with valid statuses. This changes the checker's documented policy from verifying disclosure of research coverage to requiring research completion.

Content

No source excerpt is available for this finding.

S3 reports consecutive zero-yield rounds even when the zero-yield rounds are separated by new discoveries.

Medium
Category
Excessive Agency
Confidence
100% confidence
Finding

The checker counts zero-yield rounds globally instead of checking consecutive rounds, so a sequence such as 0, 4, 0 incorrectly receives a convergence PASS. Because preventing false confidence is the skill's central purpose, an adversarial or ordinary nonconverged journal can obtain misleading validation and encourage premature reliance on its conclusions.

Content

No source excerpt is available for this finding.

The checker enforces an additional mandatory S6 stopping criterion beyond the manifest's five criteria.

Medium
Category
Excessive Agency
Confidence
99% confidence
Finding

The manifest describes five stopping criteria, S1–S5, but L220–L248 introduce a mandatory exploration-output section requiring at least three discoveries and one capability-related discovery. S6 failures contribute to the overall failure count and exit status at L258–L266, so a journal satisfying the advertised criteria can still be rejected under an undeclared requirement.

Content

No source excerpt is available for this finding.

subprocess module call

Medium
Category
Dangerous Code Execution
Confidence
70% confidence
Finding

subprocess module calls execute external commands. Without careful input validation, this enables command injection.

Content

Scanner excerpt · scripts/run_all.py (reported line 22)May include surrounding context.

python
def run(script, journal):
    p = subprocess.run([sys.executable, os.path.join(HERE, script), journal],
                       capture_output=True, text=True, encoding='utf-8', errors='replace')
    return p.returncode, (p.stdout or '') + (p.stderr or '')

MCP server referenced without pinned version: 'uvx skills-ref'.

Medium
Category
MCP Rug Pull
Confidence
65% confidence
Finding

uvx/uv tool run commands without ==version create a rug-pull risk.

Content

No source excerpt is available for this finding.