Back to skill

Security audit

投研Skill面试官

Security checks for vulnerabilities and agentic risk

Overview

This skill is a coherent Chinese-language evaluator for investment-research skills, but it tells the agent to actually run evaluated skills without specifying sandboxing, approval, or capability limits.

Install only if you intend to evaluate China/A-share-oriented investment research skills, and run any target skill being evaluated inside a disposable, least-privilege sandbox with no host secrets or broad filesystem access. Treat dynamic validation as optional unless you explicitly approve the target skill's requested capabilities.

Vulnerability Patterns
  • Insecure Skill Coding PracticesFinds exploitable flaws such as hardcoded secrets or command injection
  • Skill Instruction HijackingAlters the agent's session goals or safety constraints when the skill loads
  • Agent Memory PoisoningWrites attacker-controlled rules into memory that affect later sessions
  • Remote Payload Retrieval and ExecutionFetches external code whose behavior can change after review
  • Embedded Malicious CodeShips malicious scripts inside the skill and executes them locally
Findings (1)

T09 · Insecure Skill Coding Practices

Warning
Location
SKILL.md:96
Finding

Unrestricted Execution of Potentially Untrusted Evaluated Skills

Content
View full analysis

Vulnerability Details

File Location: SKILL.md:96 and SKILL.md:267
Vulnerability Type: Unsafe execution of untrusted Skill content
Risk Level: Medium

Relevant snippets:

markdown
#### Dimension Five: Practical Validation (Weight: 15%)

> Actually run the Skill to validate its functionality
markdown
2. **Prioritize practical validation**: Dimension Five (Practical Validation) requires actually running the Skill; reviewing documentation alone is insufficient.

The snippets above are faithful English translations of the original instructions at the cited locations.

Technical Analysis

The Skill requires an agent to execute a target Skill during evaluation, even though the target may be untrusted. It does not require a sandbox, network restrictions, filesystem boundaries, a capability review, resource limits, dependency validation, or explicit user approval before execution.

Consequently, dynamic validation may cause attacker-controlled instructions or code from the evaluated Skill to run with the reviewing agent's ambient tool permissions. The audited package does not itself contain a malicious payload, but its prescribed validation process creates an unsafe execution boundary.

Attack Path

  1. An attacker submits a crafted investment-research Skill for evaluation.
  2. The evaluator loads its instructions and linked files.
  3. Following SKILL.md:96 and SKILL.md:267, the evaluator performs actual execution rather than limiting the review to static analysis.
  4. The crafted Skill requests or triggers dangerous tool operations, such as command execution, filesystem access, dependency installation, or outbound network requests.
  5. In the absence of isolation and capability restrictions, those operations run with whatever permissions are available to the reviewing agent.

Impact Assessment

The resulting privileges depend on the evaluator's runtime permissions. A malicious ...[truncated 557 chars]

Remediation
View remediation

Remediation Suggestions

  1. Make static inspection the default and require explicit user approval before any dynamic execution.
  2. Run evaluated Skills only in a disposable sandbox or isolated container with no host secrets.
  3. Mount only a dedicated temporary working directory and deny access to unrelated host files.
  4. Disable outbound networking by default; where necessary, enforce destination and protocol allowlists.
  5. Expose only the minimum tools required for the test and prohibit shell execution, package installation, persistence mechanisms, and credential access unless specifically approved.
  6. Apply CPU, memory, process, storage, and execution-time limits.
  7. Review all linked scripts, dependencies, and requested capabilities before execution; pin approved dependencies to trusted versions and sources.
  8. Log tool calls, filesystem changes, network attempts, and subprocess activity for auditability.
  9. Abort validation when a target Skill requests capabilities outside the declared investment-research use case.
  10. Replace the unsafe requirement with language such as: “Perform static review first. Dynamic validation is optional and may occur only in an isolated, least-privilege environment after capability review and explicit authorization.”
Vulnerability Patterns
  • Trigger AbuseOverly Broad Trigger, Shadow Command Trigger, Keyword Baiting Trigger
  • Prompt InjectionInstruction Override, Hidden Instructions, Exfiltration Commands
  • Data ExfiltrationExternal Transmission, Env Variable Harvesting, File System Enumeration
  • Privilege EscalationExcessive Permissions, Sudo/Root Execution, Credential Access
  • Supply ChainUnpinned Dependencies, External Script Fetching, Obfuscated Code
Findings (2)

Natural-Language Policy Violations

Medium
Category
Not specified by scanner
Confidence
95% confidence
Finding

The manifest description and core instructions are written as mandatory Chinese-language behavior for the skill, and no opt-in or alternative language handling is provided. Under the policy, forcing a specific language without user choice is a natural-language locale violation unless the constraint is explicitly justified as region-specific.

Content

No source excerpt is available for this finding.

Natural-Language Policy Violations

Low
Category
Not specified by scanner
Confidence
76% confidence
Finding

The note says evaluations should use the China A-share research context as the main scenario, which imposes a locale/market-specific default. Because the file does not clearly present this as an opt-in regional specialization in activation/usage, it can conflict with the language/locale policy requirement for explicit choice or justification.

Content

No source excerpt is available for this finding.

Static analysis

No suspicious patterns detected.