Back to skill

Security audit

RAG Pipeline Starter

Security checks for vulnerabilities and agentic risk

Overview

This skill is a local RAG helper toolkit whose file access and writes are user-directed and purpose-aligned, with some reliability and data-handling caveats.

Install only if you are comfortable with a local tool reading your chosen document folders and writing derived chunks, results, and index files. Use dedicated working directories, do not point outputs at important folders, and treat any future use of real hosted embedding APIs as a separate privacy decision because document chunks or queries could be sent to those providers.

Vulnerability Patterns
  • Skill Instruction HijackingAlters the agent's session goals or safety constraints when the skill loads
  • Agent Memory PoisoningWrites attacker-controlled rules into memory that affect later sessions
  • Remote Payload Retrieval and ExecutionFetches external code whose behavior can change after review
  • Embedded Malicious CodeShips malicious scripts inside the skill and executes them locally
  • Unauthorized Access and Privilege EscalationObtains permissions beyond the task's legitimate needs
Vulnerability Patterns
  • Data ExfiltrationExternal Transmission, Env Variable Harvesting, File System Enumeration
  • Trigger AbuseOverly Broad Trigger, Shadow Command Trigger, Keyword Baiting Trigger
  • MCP Tool PoisoningHidden Instructions, Unicode Deception, Parameter Description Injection
  • Prompt InjectionInstruction Override, Hidden Instructions, Exfiltration Commands
  • Privilege EscalationExcessive Permissions, Sudo/Root Execution, Credential Access
Findings (6)

Missing User Warnings

High
Category
Not specified by scanner
Confidence
96% confidence
Finding

The skill recommends paid embedding providers without warning that document chunks or query text may be sent to third-party APIs for processing. Because RAG inputs often contain proprietary or regulated data, this omission can lead users to unknowingly exfiltrate sensitive dataset contents outside their trust boundary.

Content

No source excerpt is available for this finding.

Missing User Warnings

Medium
Category
Not specified by scanner
Confidence
92% confidence
Finding

The skill instructs users to write chunk outputs to arbitrary user-specified directories but does not warn that running these commands can create or overwrite files in those paths. In an agent or automation context, this increases the chance of unintended filesystem modification, data clobbering, or writing sensitive derived data into insecure locations.

Content

No source excerpt is available for this finding.

Intent-Code Divergence

Medium
Category
Not specified by scanner
Confidence
95% confidence
Finding

The module and function documentation present this as an embedding benchmark, but the implementation uses a mock similarity routine based on token overlap rather than generating embeddings or invoking the listed models. This is an active contradiction about what the code actually evaluates, which can mislead users about the skill's real behavior.

Content

No source excerpt is available for this finding.

Missing User Warnings

Medium
Category
Not specified by scanner
Confidence
96% confidence
Finding

The --delete operation performs a persistent file-backed deletion through store.delete_document() without any confirmation prompt, warning comment, or prior disclosure beyond the terse CLI help text. Unlike --clear, which asks for confirmation, this destructive action can remove indexed data immediately and silently except for the post-action print.

Content

No source excerpt is available for this finding.

Missing User Warnings

Low
Category
Not specified by scanner
Confidence
83% confidence
Finding

This code writes benchmark results to a user-specified path, which modifies the local filesystem. Although it prints after saving, there is no prior warning, confirmation, or explicit disclosure that an existing file may be overwritten when --output is used.

Content

No source excerpt is available for this finding.

Vague Triggers

Low
Category
Not specified by scanner
Confidence
88% confidence
Finding

This is a manifest file, so vague-trigger review applies. The description explains the skill's domain and capabilities but does not define when it should be invoked, what exact requests should trigger it, or any exclusions, which can lead to overly broad matching for general RAG-related requests.

Content

No source excerpt is available for this finding.

Static analysis

No suspicious patterns detected.