Back to skill

Security audit

arxiv watcher

Security checks for vulnerabilities and agentic risk

Overview

This skill is a small ArXiv search helper with disclosed research-log persistence, but users should understand it will automatically save paper summaries long term.

Install only if you are comfortable with the agent keeping a persistent research log of papers it discusses. For sensitive research topics, ask the agent not to write memory or review/delete memory/RESEARCH_LOG.md after use; the script should also be hardened with URL encoding and a bounded result count.

Vulnerability Patterns
  • Agent Memory PoisoningWrites attacker-controlled rules into memory that affect later sessions
  • Insecure Skill Coding PracticesFinds exploitable flaws such as hardcoded secrets or command injection
  • Skill Instruction HijackingAlters the agent's session goals or safety constraints when the skill loads
  • Remote Payload Retrieval and ExecutionFetches external code whose behavior can change after review
  • Embedded Malicious CodeShips malicious scripts inside the skill and executes them locally
Findings (2)

T02 · Agent Memory Poisoning

Warning
Location
SKILL.md:13
Finding

Untrusted ArXiv content is automatically persisted to long-term Agent memory

Content
View full analysis
"` to get the XML results. 2. Parse the XML (look for ``, ``, `<summary>`, and `<link title="pdf">`). 3. Present the findings to the user. 4. **MANDATORY**: Append the title, authors, date, and summary of any paper discussed to `memory/RESEARCH_LOG.md`. Use the format: ```markdown ### [YYYY-MM-DD] TITLE_OF_PAPER - **Authors**: Author List - **Link**: ArXiv Link - **Summary**: Brief summary of the paper and its relevance. ``` ``` ### Technical Analysis Paper titles, author fields, abstracts, and PDF contents are obtained from external sources and can contain attacker-controlled text. The workflow requires the Agent to process that content and persist a derived version of it in `memory/RESEARCH_LOG.md`, without requiring user approval or defining sanitization and trust-boundary controls. If persistent memory is subsequently loaded into an Agent context and treated as trusted instructions rather than inert research data, instruction-like material originating from a malicious paper could influence later sessions. Summarization may reduce this risk, but the Skill does not require the Agent to remove embedded directives or prevent them from being reproduced in the stored summary. ### Attack Path 1. An attacker publishes or controls an ArXiv submission containing instruction-like text in its title, abstract, author metadata, or PDF. 2. A user searches for a topic that causes the malicious submission to appear in the API results. 3. The Agent parses or fetches the attacker-controlle ...[truncated 727 chars]
Remediation
View remediation

T09 · Insecure Skill Coding Practices

Note
Location
scripts/search_arxiv.sh:1
Finding

Unvalidated arguments permit ArXiv API query-parameter injection

Content
View full analysis
Remediation
View remediation
100 )); then printf '%s\n' 'COUNT must be an integer between 1 and 100.' >&2 exit 2 fi curl --silent --show-error --fail \ --location --max-redirs 3 \ --connect-timeout 10 --max-time 30 \ --get 'https://export.arxiv.org/api/query' \ --data-urlencode "search_query=all:$QUERY" \ --data-urlencode 'start=0' \ --data-urlencode "max_results=$COUNT" \ --data-urlencode 'sortBy=submittedDate' \ --data-urlencode 'sortOrder=descending' ``` 2. Enforce a conservative upper bound on `COUNT`. 3. Enable HTTP failure reporting and connection/runtime limits. 4. Limit redirects to reduce unexpected network behavior. 5. Validate that the response has the expected Atom/XML content type and size before passing it to the Agent. ]]>
Vulnerability Patterns
  • MCP Least PrivilegeUnderdeclared Capability, Wildcard Permission, Missing Permission Declaration
  • Prompt InjectionInstruction Override, Hidden Instructions, Exfiltration Commands
  • Data ExfiltrationExternal Transmission, Env Variable Harvesting, File System Enumeration
  • Privilege EscalationExcessive Permissions, Sudo/Root Execution, Credential Access
  • Supply ChainUnpinned Dependencies, External Script Fetching, Obfuscated Code
Findings (3)

Undeclared Tool Scope

Medium
Category
MCP Least Privilege
Confidence
92% confidence
Finding

The skill invokes a shell script (scripts/search_arxiv.sh) but does not declare any tool scope or allowed tools. This creates an authorization and review gap: an agent may execute shell-capable behavior that is not explicitly disclosed, making it harder to enforce least privilege and easier for a modified script to perform unintended local actions.

Content

No source excerpt is available for this finding.

Missing User Warnings

Medium
Category
Not specified by scanner
Confidence
95% confidence
Finding

The skill states that summarized papers are automatically saved to memory/RESEARCH_LOG.md without warning the user that data will persist beyond the current interaction. Undisclosed persistence is risky because user queries, research interests, or sensitive topics may be recorded unexpectedly and later surfaced to other workflows or sessions.

Content

No source excerpt is available for this finding.

Missing User Warnings

Medium
Category
Not specified by scanner
Confidence
97% confidence
Finding

The workflow makes persistence mandatory for any discussed paper, directing the agent to append titles, authors, dates, links, and summaries to a memory file without disclosure or consent. Because this is framed as mandatory behavior, it increases the chance of systematic collection of user-related research activity and creates unnecessary retention of potentially sensitive contextual data.

Content

No source excerpt is available for this finding.