Back to skill

Security audit

Astroph Arxiv Skill Repo

Security checks for vulnerabilities and agentic risk

Overview

This skill performs a disclosed arXiv astronomy paper search using a small local Python parser, with no evidence of credential access, persistence, exfiltration, or destructive behavior.

Install only if you are comfortable with the agent sending your search topic to arXiv and creating/running a small local Python helper for formatting results; the skill would be clearer if it limited activation to astro-ph searches and cleaned up its helper file.

Vulnerability Patterns
  • Skill Instruction HijackingAlters the agent's session goals or safety constraints when the skill loads
  • Agent Memory PoisoningWrites attacker-controlled rules into memory that affect later sessions
  • Remote Payload Retrieval and ExecutionFetches external code whose behavior can change after review
  • Embedded Malicious CodeShips malicious scripts inside the skill and executes them locally
  • Unauthorized Access and Privilege EscalationObtains permissions beyond the task's legitimate needs
Vulnerability Patterns
  • Excessive AgencyUnrestricted Tool Access, Autonomous Decision Making, Scope Creep
  • Trigger AbuseOverly Broad Trigger, Shadow Command Trigger, Keyword Baiting Trigger
  • MCP Tool PoisoningHidden Instructions, Unicode Deception, Parameter Description Injection
  • Prompt InjectionInstruction Override, Hidden Instructions, Exfiltration Commands
  • Data ExfiltrationExternal Transmission, Env Variable Harvesting, File System Enumeration
Findings (3)

Description-Behavior Mismatch

Medium
Category
Not specified by scanner
Confidence
96% confidence
Finding

The manifest describes the skill as only embedding a Python XML parser, but the runbook also performs live outbound network access to arXiv and retrieves remote content. This mismatch weakens transparency and policy enforcement because reviewers or users may approve a seemingly narrow parsing skill without realizing it has data-fetching capability.

Content

No source excerpt is available for this finding.

Vague Triggers

Medium
Category
Not specified by scanner
Confidence
95% confidence
Finding

The instruction says to run the skill 'when the user requests a literature search for a specific topic,' which is a very broad activation condition that could overlap with many ordinary research-related requests. It does not define narrower trigger phrases, scope limits, or exclusion cases, making unintended invocation more likely.

Content

No source excerpt is available for this finding.

Context-Inappropriate Capability

Medium
Category
Not specified by scanner
Confidence
95% confidence
Finding

The runbook instructs the agent to create and execute a standalone Python script, introducing arbitrary code-execution behavior beyond the narrowly declared purpose. Even though the embedded script is simple, enabling file creation and code execution expands the attack surface and could be repurposed if the skill content is modified or combined with untrusted input.

Content

No source excerpt is available for this finding.