Back to skill

Security audit

Academic Paper Analysis

Security checks for vulnerabilities and agentic risk

Overview

This skill is for academic paper analysis, but it also mandates automatic local database writes from every analyzed paper without user consent or retention controls.

Install only if you are comfortable with every analyzed paper having table-layout information retained in a hardcoded local database path. Avoid using it for confidential, unpublished, proprietary, or copyrighted papers unless the persistence behavior is removed or made explicit, optional, and deletable.

Vulnerability Patterns
  • Insecure Skill Coding PracticesFinds exploitable flaws such as hardcoded secrets or command injection
  • Skill Instruction HijackingAlters the agent's session goals or safety constraints when the skill loads
  • Agent Memory PoisoningWrites attacker-controlled rules into memory that affect later sessions
  • Remote Payload Retrieval and ExecutionFetches external code whose behavior can change after review
  • Embedded Malicious CodeShips malicious scripts inside the skill and executes them locally
Findings (1)

T09 · Insecure Skill Coding Practices

Warning
Location
SKILL.md:116
Finding

Automatic Unconsented Persistence of Document-Derived Metadata

Content
View full analysis

Vulnerability Details

File Location: SKILL.md, lines 116-132 and 160-171
Vulnerability Type: Unrequested persistent local database write
Risk Level: Medium

Evidence

The following is an English rendering of the complete relevant Skill directives:

markdown
### Supplement to Section Four: Extract table layouts and automatically store them in a database

When analyzing a paper, proactively identify every table and extract the following formatting logic for each table:

1. Table name: Table 1, Table 2, and so on
2. Row structure: how variables are arranged in rows, including nesting and grouping
3. Column structure: relationships among columns, such as different models or exposure groups
4. Variable order: ordering rules within rows, such as demographics, lifestyle, and metabolic indicators
5. Formatting conventions:
   - Continuous variables: mean ± SD or median (IQR)
   - Categorical variables: n (%) format and decimal precision
   - HR/CI: decimal precision and reference-group notation
6. Statistical methods: tests and models used
7. Footnote and annotation conventions

Storage path: `D:\autoclaw\results\medical-research-methods-library\methods.db`
Database table: `table_layouts`
markdown
## Section Eight: Table Layout Conventions (Automatically Stored in the Database)

- Table-layout extraction is performed automatically.
- User authorization is not required.
- During paper analysis, the extracted information must be written to the database.

Technical Analysis

The Skill mandates a persistent filesystem side effect that is not necessary to provide the requested paper analysis. It automatically stores document-derived metadata in a hardcoded absolute SQLite database path without requiring informed user consent.

The instructions do not define:

  • Whether the submitted paper is confidential or contains sensitive research information.
  • Which precise values ma ...[truncated 2562 chars]
Remediation
View remediation

Remediation Suggestions

  1. Remove mandatory automatic database writes from the default analysis workflow.
  2. Require explicit, informed, per-request user consent before retaining any document-derived information.
  3. Present the exact destination, fields, retention period, and deletion procedure before requesting consent.
  4. Default to returning table-layout information in the response without persistent storage.
  5. Use a user-selected or application-managed sandbox directory instead of a hardcoded absolute path.
  6. Validate that the destination database is owned by the expected application and has the expected schema before writing.
  7. Use parameterized SQL statements, explicit transactions, rollback handling, and restrictive file permissions.
  8. Minimize stored data and avoid retaining paper titles, authors, unpublished results, or other identifying information unless specifically authorized.
  9. Add record provenance, retention limits, user inspection controls, and a reliable deletion mechanism.
  10. Clearly report whether persistence succeeded and never silently fall back to another path.
Vulnerability Patterns
  • Excessive AgencyUnrestricted Tool Access, Autonomous Decision Making, Scope Creep
  • Trigger AbuseOverly Broad Trigger, Shadow Command Trigger, Keyword Baiting Trigger
  • MCP Tool PoisoningHidden Instructions, Unicode Deception, Parameter Description Injection
  • Prompt InjectionInstruction Override, Hidden Instructions, Exfiltration Commands
  • Data ExfiltrationExternal Transmission, Env Variable Harvesting, File System Enumeration
Findings (9)

Vague Triggers

High
Category
Not specified by scanner
Confidence
97% confidence
Finding

The manifest description and invocation cues are broad enough that the skill may auto-activate for loosely related requests, increasing the chance of unintended execution. In this skill, unintended activation is more dangerous because activation can trigger hidden file processing and local database writes without a clear consent step.

Content

No source excerpt is available for this finding.

Vague Triggers

High
Category
Not specified by scanner
Confidence
96% confidence
Finding

The trigger section includes broad catch-all patterns such as analysis of any 'xxx' related literature and PDF upload plus a request to analyze, which can match many benign or ambiguous user intents. Over-broad triggering raises the risk of processing documents and invoking side effects without the user understanding the scope of the skill's behavior.

Content

No source excerpt is available for this finding.

Natural-Language Policy Violations

Medium
Category
Not specified by scanner
Confidence
95% confidence
Finding

The output format requires English abstract and discussion sections to be accompanied by full Chinese translations, making Chinese the mandatory output locale for this behavior. Because the file does not offer the user a language choice or opt-in, this is a natural-language policy issue under the language/locale rule.

Content

No source excerpt is available for this finding.

Description-Behavior Mismatch

Medium
Category
Not specified by scanner
Confidence
96% confidence
Finding

The skill expands from paper analysis into automatic persistence of extracted table-layout data in a local database, which is a capability beyond the user-visible purpose stated in the manifest. Hidden or non-essential stateful writes are risky because they create undisclosed side effects, may retain data from copyrighted or sensitive documents, and can be abused as a covert collection channel.

Content

No source excerpt is available for this finding.

Context-Inappropriate Capability

Medium
Category
Not specified by scanner
Confidence
96% confidence
Finding

Automatically writing extracted table-layout information into a local database is not necessary for answering a one-off paper-analysis request and introduces undisclosed persistence. This broadens the trust boundary from transient analysis to local data storage, increasing privacy, compliance, and integrity risks if the database accumulates user-supplied document structure over time.

Content

No source excerpt is available for this finding.

Missing User Warnings

Medium
Category
Not specified by scanner
Confidence
97% confidence
Finding

The skill specifies automatic writes to a local database but does not warn the user that local data will be modified or retained. Undisclosed persistence undermines informed consent and can create security and privacy issues, especially if users believe the action is a transient document analysis only.

Content

No source excerpt is available for this finding.

Natural-Language Policy Violations

Medium
Category
Not specified by scanner
Confidence
94% confidence
Finding

These instructions mandate providing original text plus Chinese translation and Chinese explanations when the PDF is in English. This imposes a specific locale/language behavior by default rather than offering a user-selected language preference.

Content

No source excerpt is available for this finding.

Missing User Warnings

Medium
Category
Not specified by scanner
Confidence
98% confidence
Finding

The note that table-layout extraction is always auto-executed and written to a database confirms persistence is mandatory and non-optional. Mandatory hidden writes are particularly dangerous because they eliminate user choice and can silently accumulate structured data from every processed paper.

Content

No source excerpt is available for this finding.

Context-Inappropriate Capability

Low
Category
Not specified by scanner
Confidence
84% confidence
Finding

Requiring full reproduction and translation of the Abstract and Discussion goes beyond narrow analytical summarization and can result in large-scale extraction of copyrighted text. While not a system-compromise issue, it is a policy and data-handling concern because the skill is instructed to emit substantial verbatim content by default rather than minimizing reproduced source material.

Content

No source excerpt is available for this finding.