Back to skill

Security audit

meta-autonomous-research-scale

Security checks for vulnerabilities and agentic risk

Overview

This skill needs Review because it asks agents to keep persistent learning data and potentially update its own instructions, while its claimed research safeguards are not actually present in the artifact.

Install only after reviewing the learner behavior. Do not allow it to store sensitive task content or automatically rewrite SKILL.md, and treat its self-verification, orchestration, and self-evolution claims as unimplemented unless those referenced tools are separately supplied and reviewed.

Vulnerability Patterns
  • Agent Memory PoisoningWrites attacker-controlled rules into memory that affect later sessions
  • Insecure Skill Coding PracticesFinds exploitable flaws such as hardcoded secrets or command injection
  • Skill Instruction HijackingAlters the agent's session goals or safety constraints when the skill loads
  • Remote Payload Retrieval and ExecutionFetches external code whose behavior can change after review
  • Embedded Malicious CodeShips malicious scripts inside the skill and executes them locally
Findings (2)

T02 · Agent Memory Poisoning

Warning
Location
scripts/learner.py:5
Finding

Persistent Agent Memory Poisoning Through Unvalidated Notes and Preferences

Content
View full analysis
Remediation
View remediation

T09 · Insecure Skill Coding Practices

Note
Location
scripts/learner.py:20
Finding

Documented Learner Commands Are Silently Misparsed and Corrupt Persistent State

Content
View full analysis
--capability 简历优化 # 记录一次失败/异常 python scripts/learner.py record <本技能目录> --capability 简历优化 --fail --error 格式识别失败 --note "用户上传了非标准文件" # 记录用户偏好(下次直接使用) python scripts/learner.py prefer <本技能目录> --key 输出语言 --val 中文 # 查看累计洞察(高频能力 / 反复错误) python scripts/learner.py insight <本技能目录> # 自动复盘(错误≥3次 或 操作≥10次 时给出改进建议) python scripts/learner.py reflect <本技能目录> ``` ``` From `scripts/learner.py:20-22`: ```python if __name__ == "__main__": ok = (sys.argv[1] != "fail") if len(sys.argv) > 1 else True rec = (sys.argv[2] if len(sys.argv) > 2 else "") print(json.dumps(record(ok, rec), ensure_ascii=False)) ``` ### Technical Analysis The documented interface advertises `record`, `prefer`, `insight`, and `reflect` subcommands, along with options such as `--capability`, `--fail`, `--error`, `--note`, `--key`, and `--val`. The implementation parses none of these. Only a first argument equal to the literal string `fail` creates a failure record. Every documented command starts with another value and is therefore recorded as successful. The second argument—normally the Skill directory—is stored as the note, while all remaining options are silently ignored. Consequently: - Documented failure commands are recorded as successful operations. - Preference commands do not save the requested key or value. - Insight and reflection commands mutate state instead of performing their advertised read or analysis operations. - The Skill directory argument is repeatedly inserted into the `patterns` array. - Unknown or malformed arguments are accepted without warning. This causes silent integrity corruption in the ...[truncated 1538 chars]
Remediation
View remediation
Vulnerability Patterns
  • Excessive AgencyUnrestricted Tool Access, Autonomous Decision Making, Scope Creep
  • MCP Least PrivilegeUnderdeclared Capability, Wildcard Permission, Missing Permission Declaration
  • MCP Tool PoisoningHidden Instructions, Unicode Deception, Parameter Description Injection
  • Prompt InjectionInstruction Override, Hidden Instructions, Exfiltration Commands
  • Data ExfiltrationExternal Transmission, Env Variable Harvesting, File System Enumeration
Findings (10)

Tp4

High
Category
MCP Tool Poisoning
Confidence
98% confidence
Finding

The skill claims advanced self-verification, self-reflection, orchestration, and continuous self-evolution, but the documented behavior is largely limited to local logging and preference storage. This mismatch is security-relevant because operators may overtrust outputs, assume safeguards exist when they do not, and permit broader autonomy or lower human review based on inaccurate capability claims.

Content

No source excerpt is available for this finding.

Undeclared Tool Scope

Medium
Category
MCP Least Privilege
Confidence
88% confidence
Finding

The skill documents file-writing behavior via scripts/learner.py and persistent memory files, but it does not declare any permissions or allowed-tools scope. This creates an authorization/transparency gap: a caller or platform may not realize the skill persists data, increasing the chance of unintended writes and policy bypass in environments that rely on manifest-declared capability boundaries.

Content

No source excerpt is available for this finding.

Description-Behavior Mismatch

Medium
Category
Not specified by scanner
Confidence
89% confidence
Finding

The skill is presented as a research enhancement tool, but the documentation adds automatic persistent personalization and behavior shaping across sessions. This scope expansion can mislead users about what data is being retained and how future behavior is influenced, undermining informed consent and increasing the likelihood of covert profile building.

Content

No source excerpt is available for this finding.

Context-Inappropriate Capability

Medium
Category
Not specified by scanner
Confidence
91% confidence
Finding

The skill introduces persistent storage of user preferences, usage counts, and error patterns beyond the stated research/orchestration purpose. This is a data minimization issue: collecting generalized behavioral telemetry without necessity expands the privacy and security attack surface and can retain sensitive user information unrelated to the task.

Content

No source excerpt is available for this finding.

Missing User Warnings

Medium
Category
Not specified by scanner
Confidence
95% confidence
Finding

The skill describes automatic storage of user preferences and usage history but provides no clear privacy notice, consent flow, or retention/deletion guidance. In practice, users may disclose sensitive information in notes, errors, or preferences that then persist locally without their awareness, creating avoidable privacy and compliance risk.

Content

No source excerpt is available for this finding.

Ssd 3

Medium
Category
Not specified by scanner
Confidence
93% confidence
Finding

The skill explicitly establishes a persistent retention mechanism for user preferences, error history, and usage patterns in learned_patterns.json across uses. Persistent natural-language memory is risky because free-form notes can accumulate personal, proprietary, or sensitive operational details, and long-lived local storage broadens exposure in case of later compromise or unintended reuse.

Content

No source excerpt is available for this finding.

Natural-Language Policy Violations

Medium
Category
Not specified by scanner
Confidence
91% confidence
Finding

The example command stores 输出语言 --val 中文 as a direct preference, and the document does not offer alternative language choices or say this is only an example requiring user opt-in. This can be read as a default locale/language constraint, which violates the policy against forcing a specific language without user choice.

Content

No source excerpt is available for this finding.

Natural-Language Policy Violations

Medium
Category
Not specified by scanner
Confidence
73% confidence
Finding

The only natural-language description in the file is written in Chinese, which can indicate a fixed language expectation without user opt-in or multilingual accommodation. The policy requires flagging language or locale constraints when the skill does not explicitly offer a choice or justify the restriction.

Content

No source excerpt is available for this finding.

Natural-Language Policy Violations

Low
Category
Not specified by scanner
Confidence
91% confidence
Finding

The entire document is written in Chinese, including headings and operational descriptions, with no indication that language choice is optional or that the skill is intentionally limited to a Chinese-speaking context. Under the stated policy, forcing a specific language without user opt-in is a natural-language policy concern.

Content

No source excerpt is available for this finding.

Missing User Warnings

Low
Category
Not specified by scanner
Confidence
84% confidence
Finding

This code writes persisted data to a local JSON file via json.dump, but there is no confirmation prompt, print/log disclosure before the write, or inline comment/docstring explaining that invocation notes will be stored on disk. For a code file, persistent file writes should have some visible disclosure unless clearly covered elsewhere.

Content

No source excerpt is available for this finding.