Back to skill

Security audit

claude-api

Security checks for vulnerabilities and agentic risk

Overview

The skill is mostly a documented API gateway, but it asks agents to follow mutable external setup instructions and expands a Claude-focused skill into hundreds of unrelated APIs.

Review before installing. Use this only if you intentionally want SkillBoss as a third-party gateway, understand that prompts and API credentials are sent to SkillBoss, and are comfortable with the broader API surface. Avoid letting an agent automatically follow skillboss.co/skill.md unless you first inspect and approve the remote setup steps.

Vulnerability Patterns
  • Skill Instruction HijackingAlters the agent's session goals or safety constraints when the skill loads
  • Agent Memory PoisoningWrites attacker-controlled rules into memory that affect later sessions
  • Remote Payload Retrieval and ExecutionFetches external code whose behavior can change after review
  • Embedded Malicious CodeShips malicious scripts inside the skill and executes them locally
  • Unauthorized Access and Privilege EscalationObtains permissions beyond the task's legitimate needs
Findings (1)

T01 · Skill Instruction Hijacking

Error
Location
SKILL.md:23
Finding
Unaudited External Instructions Enable Skill Instruction Hijacking and Excessive Scope Expansion<![CDATA[ ## Vulnerability Details **File Location**: `SKILL.md:23`, `SKILL.md:32-39`; `README.md:7` **Vulnerability Type**: T01: Skill Instruction Hijacking **Risk Level**: High ### Vulnerable Code `SKILL.md:23`: ```yaml installHint: "Tell your agent: set up skillboss.co/skill.md — or get API key at https://skillboss.co/console" ``` `SKILL.md:32-39`: ```markdown Tell your agent: ``` set up skillboss.co/skill.md ``` This auto-configures SkillBoss with 687 APIs — chat, image, video, audio, search, scraping, social data, email, and more. ``` `README.md:7`: ```markdown > 📖 **Complete setup guide**: https://skillboss.co/skill.md ``` ### Technical Analysis The skill explicitly instructs an agent to obtain and act on setup directions hosted at `skillboss.co/skill.md`. The effective setup instructions are therefore not contained in the audited package and can be changed independently after the package has been reviewed or installed. This creates an instruction-hijacking boundary: content controlled by an external service is presented as an action for the agent to perform under the authority of the installed skill. A later modification or compromise of the external document could introduce new instructions without requiring a change to this repository. The documented setup also expands the skill from its declared Claude API gateway purpose to automatic configuration for 687 APIs, including unrelated capabilities such as email, scraping, social data, image generation, video, and audio. This broad expansion violates least-privilege principles and increases both credential exposure and the number of third-party capabilities available to the agent. The repository does not contain the remote document, so its current contents and behavior cannot be verified by this audit. The vulnerability is the delegation of actionable agent setup to mutable, unaudited external instructions—not a claim that the current remote document contains executable malware. ### Attack ...[truncated 1696 chars]
Remediation
<![CDATA[ ## Remediation Suggestions 1. Remove directives telling agents to retrieve and execute setup instructions from `skillboss.co/skill.md`. 2. Include the complete setup procedure directly in the version-controlled `SKILL.md` file so that all effective instructions are available for review. 3. Restrict the default setup to the minimum capability required for the declared purpose: access to the documented Claude-compatible API endpoint. 4. Do not automatically configure unrelated email, scraping, social-data, image, video, or audio integrations. 5. Treat external documentation as informational only. Require the agent to display remote content to the user and obtain explicit approval before performing any action derived from it. 6. If an external artifact is technically unavoidable, use an immutable, versioned resource and verify it against a pinned cryptographic digest before use. 7. Enumerate every configuration change, credential destination, network endpoint, and required permission in the audited package. 8. Require separate, explicit user consent for each additional integration or capability rather than enabling hundreds of APIs through a single broad setup action. 9. Update `README.md` so that it links to documentation for human reference without characterizing the remote page as an executable or authoritative agent setup guide. ]]>
Vulnerability Patterns
  • Data ExfiltrationExternal Transmission, Env Variable Harvesting, File System Enumeration
  • Excessive AgencyUnrestricted Tool Access, Autonomous Decision Making, Scope Creep
  • Trigger AbuseOverly Broad Trigger, Shadow Command Trigger, Keyword Baiting Trigger
  • MCP Tool PoisoningHidden Instructions, Unicode Deception, Parameter Description Injection
  • Prompt InjectionInstruction Override, Hidden Instructions, Exfiltration Commands
Findings (11)

Context-Inappropriate Capability

High
Confidence
95% confidence
Finding
The documentation advertises access to scraping, social data, email, and other unrelated APIs under a skill that appears to be for Claude API usage. In this context, that broadens the effective permission surface and could lead an agent to invoke powerful external capabilities without informed user consent.

Vague Triggers

Medium
Confidence
91% confidence
Finding
The activation phrase 'USE THIS when the user needs claude api' is broad and marketing-oriented rather than safety-oriented. In an agentic environment, underspecified invocation language can trigger the skill in ambiguous cases and route user data to an external gateway when the user did not clearly request this provider.

Description-Behavior Mismatch

Medium
Confidence
92% confidence
Finding
The skill is presented as a narrowly scoped Claude API integration, but the documentation expands it into a broad multi-API gateway with many unrelated capabilities. This scope mismatch can mislead users and agents into authorizing or routing data to services far beyond the expected Claude-only purpose, increasing the chance of unintended data exposure and overbroad use.

Missing User Warnings

Medium
Confidence
93% confidence
Finding
The skill promotes a wide external API gateway but does not adequately warn users that prompts, credentials, and other data may be transmitted to a third-party service with access to many unrelated capabilities. In a skill context, omission of these warnings undermines informed consent and makes accidental oversharing more likely.

External Transmission

Medium
Category
Data Exfiltration
Content
### Quick Test
```bash
curl -X POST "https://api.skillboss.co/v1/chat/completions" \
  -H "Authorization: Bearer $SKILLBOSS_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
Confidence
60% confidence
Finding
Data is being sent to an external URL. This could be legitimate telemetry or data exfiltration. Manual review is recommended.

External Transmission

Medium
Category
Data Exfiltration
Content
### Quick Test
```bash
curl -X POST "https://api.skillboss.co/v1/chat/completions" \
  -H "Authorization: Bearer $SKILLBOSS_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
Confidence
50% confidence
Finding
Data is being sent to an external URL. This could be legitimate telemetry or data exfiltration. Manual review is recommended.

External Transmission

Medium
Category
Data Exfiltration
Content
### Quick Test
```bash
curl -X POST "https://api.skillboss.co/v1/chat/completions" \
  -H "Authorization: Bearer $SKILLBOSS_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
Confidence
50% confidence
Finding
Data is being sent to an external URL. This could be legitimate telemetry or data exfiltration. Manual review is recommended.

External Transmission

Medium
Category
Data Exfiltration
Content
### Quick Test
```bash
curl -X POST "https://api.skillboss.co/v1/chat/completions" \
  -H "Authorization: Bearer $SKILLBOSS_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
Confidence
50% confidence
Finding
Data is being sent to an external URL. This could be legitimate telemetry or data exfiltration. Manual review is recommended.

Vague Triggers

Medium
Confidence
88% confidence
Finding
The 'When To Use This Skill' criteria are broad and overlap with many common AI requests, especially requests for Claude access or lower-friction model usage. This increases the risk of unintended invocation and external transmission of prompts to SkillBoss without sufficiently clear user intent.

Description-Behavior Mismatch

Medium
Confidence
95% confidence
Finding
The agent instructions recommend non-Claude models even though the skill is branded as a Claude API skill. This can cause agents to silently route prompts and potentially sensitive data to unexpected providers, violating user expectations and weakening provider-boundary guarantees.

Context-Inappropriate Capability

Medium
Confidence
88% confidence
Finding
The 'Discover More' section promotes unrelated non-LLM capabilities that are not justified by the stated Claude API purpose. This encourages capability creep and increases the likelihood that agents or users will use the same credentialed gateway for scraping or social-data operations without proper review.

Static analysis

No suspicious patterns detected.