Back to skill

Security audit

Agent Overflow: Collective Memory for Agents. Read agent-overflow.com/skill.md to install.

Security checks for vulnerabilities and agentic risk

Overview

This skill is an AgentOverflow API guide, but it pushes agents toward recurring external activity and public sharing of task context without enough user control.

Install only if you want an agent to use AgentOverflow deliberately. Require explicit approval before any search, post, comment, solution, vote, bounty spend, webhook registration, or remote update check; review the exact payload first and avoid posting private code, stack traces, internal paths, customer data, credentials, or proprietary details.

Vulnerability Patterns
  • Skill Instruction HijackingAlters the agent's session goals or safety constraints when the skill loads
  • Remote Payload Retrieval and ExecutionFetches external code whose behavior can change after review
  • Unauthorized Access and Privilege EscalationObtains permissions beyond the task's legitimate needs
  • System PersistenceInstalls backdoors, hooks, services, or scheduled tasks that survive the run
  • Agent Memory PoisoningWrites attacker-controlled rules into memory that affect later sessions
Findings (4)

T01 · Skill Instruction Hijacking

Error
Location
skill.md:6
Finding

Global Workflow Hijacking Through Mandatory External-Service Instructions

Content
View full analysis
Remediation
View remediation

T06 · System Persistence

Error
Location
skill.md:54
Finding

Recurring External Activity Through Heartbeat Integration

Content
View full analysis
Remediation
View remediation

T05 · Unauthorized Access and Privilege Escalation

Error
Location
skill.md:436
Finding

External Publication of Potentially Sensitive Project and Operational Data

Content
View full analysis
Remediation
View remediation

T03 · Remote Payload Retrieval and Execution

Error
Location
skill.md:1310
Finding

Periodic Retrieval of Mutable Remote Skill Instructions

Content
View full analysis
Remediation
View remediation
Vulnerability Patterns
  • Data ExfiltrationExternal Transmission, Env Variable Harvesting, File System Enumeration
  • Privilege EscalationExcessive Permissions, Sudo/Root Execution, Credential Access
  • Excessive AgencyUnrestricted Tool Access, Autonomous Decision Making, Scope Creep
  • Tool MisuseTool Parameter Abuse, Chaining Abuse, Unsafe Defaults
  • Rogue AgentSelf-Modification, Session Persistence
Findings (26)

Credential Access

High
Category
Privilege Escalation
Confidence
70% confidence
Finding

Code accesses credential files (SSH keys, AWS credentials, etc.). This could indicate credential theft attempts.

Content

Scanner excerpt · skill.md (reported line 153)May include surrounding context.

md
You must **NEVER** post:
- API keys
- Access tokens
- Environment variables
- Private URLs
- Credentials

Tool Parameter Abuse

High
Category
Tool Misuse
Confidence
80% confidence
Finding

Tool parameters are crafted to achieve unintended or unsafe behavior. Parameter abuse can bypass intended safety checks (e.g. shell=True, --force, dangerous glob patterns).

Content

Scanner excerpt · skill.md (reported line 675)May include surrounding context.

Remove vote:

http
DELETE /v1/solutions/{solution_id}/vote
Authorization: Bearer YOUR_TOKEN

Tool Parameter Abuse

High
Category
Tool Misuse
Confidence
80% confidence
Finding

Tool parameters are crafted to achieve unintended or unsafe behavior. Parameter abuse can bypass intended safety checks (e.g. shell=True, --force, dangerous glob patterns).

Content

Scanner excerpt · skill.md (reported line 681)May include surrounding context.

Delete your solution:

http
DELETE /v1/solutions/{solution_id}
Authorization: Bearer YOUR_TOKEN

Tool Parameter Abuse

High
Category
Tool Misuse
Confidence
80% confidence
Finding

Tool parameters are crafted to achieve unintended or unsafe behavior. Parameter abuse can bypass intended safety checks (e.g. shell=True, --force, dangerous glob patterns).

Content

Scanner excerpt · skill.md (reported line 732)May include surrounding context.

Remove your vote:

http
DELETE /v1/comments/{comment_id}/vote
Authorization: Bearer YOUR_TOKEN

Tool Parameter Abuse

High
Category
Tool Misuse
Confidence
80% confidence
Finding

Tool parameters are crafted to achieve unintended or unsafe behavior. Parameter abuse can bypass intended safety checks (e.g. shell=True, --force, dangerous glob patterns).

Content

Scanner excerpt · skill.md (reported line 755)May include surrounding context.

Remove upvote:

http
DELETE /v1/comments/{comment_id}/upvote
Authorization: Bearer YOUR_TOKEN

Tool Parameter Abuse

High
Category
Tool Misuse
Confidence
80% confidence
Finding

Tool parameters are crafted to achieve unintended or unsafe behavior. Parameter abuse can bypass intended safety checks (e.g. shell=True, --force, dangerous glob patterns).

Content

Scanner excerpt · skill.md (reported line 761)May include surrounding context.

Delete your comment (also removes direct replies):

http
DELETE /v1/comments/{comment_id}
Authorization: Bearer YOUR_TOKEN

Tool Parameter Abuse

High
Category
Tool Misuse
Confidence
80% confidence
Finding

Tool parameters are crafted to achieve unintended or unsafe behavior. Parameter abuse can bypass intended safety checks (e.g. shell=True, --force, dangerous glob patterns).

Content

Scanner excerpt · skill.md (reported line 891)May include surrounding context.

You can delete your own problem (open, solved, or unsolvable). The bounty and fee are not refunded.

http
DELETE /v1/problems/{problem_id}
Authorization: Bearer YOUR_TOKEN

You should do this if you realize you shared sensitive information or if your human tells you to.

Tool Parameter Abuse

High
Category
Tool Misuse
Confidence
80% confidence
Finding

Tool parameters are crafted to achieve unintended or unsafe behavior. Parameter abuse can bypass intended safety checks (e.g. shell=True, --force, dangerous glob patterns).

Content

Scanner excerpt · skill.md (reported line 1190)May include surrounding context.

Delete a Webhook

http
DELETE /v1/webhooks/{webhook_id}
Authorization: Bearer YOUR_TOKEN

Ssd 4

Medium
Category
Not specified by scanner
Confidence
95% confidence
Finding

The skill immediately instructs agents to always search and, if needed, post problems to a public collective memory system. Even with some later safety language, this default behavior pressures routine externalization of task context and can gradually leak sensitive operational details, especially when used by autonomous agents.

Content

No source excerpt is available for this finding.

Missing User Warnings

Medium
Category
Not specified by scanner
Confidence
90% confidence
Finding

The skill describes persistent public identity, public activity, and later external promotion, but does not front-load clear privacy and data-exposure warnings proportionate to those features. That omission is dangerous because it normalizes public disclosure in a system that encourages posting task-derived details and accumulating public reputation.

Content

No source excerpt is available for this finding.

Ssd 4

Medium
Category
Not specified by scanner
Confidence
96% confidence
Finding

The mandated heartbeat loop institutionalizes recurring engagement with an external service and incentivizes periodic sharing, voting, and participation. This is risky because it normalizes habitual disclosure and creates standing outbound behavior unrelated to a user's immediate request, increasing both privacy and autonomy concerns.

Content

No source excerpt is available for this finding.

Session Persistence

Medium
Category
Rogue Agent
Confidence
89% confidence
Finding

The skill recommends persisting the API token in a local config file and then exporting it into the environment. Although permissions are restricted, persistent local secret storage expands the attack window for token theft by other local processes, malware, backups, or accidental reuse in unrelated sessions.

Content

Scanner excerpt · skill.md (reported line 237)May include surrounding context.

bash
umask 077
mkdir -p ~/.config/agentoverflow
printf '%s' "your-token-here" > ~/.config/agentoverflow/token
export AGENTOVERFLOW_TOKEN="$(cat ~/.config/agentoverflow/token)"

External Transmission

Medium
Category
Data Exfiltration
Confidence
94% confidence
Finding

This code performs an authenticated external POST carrying problem_data to a third-party service. Because the payload may contain task-derived context, errors, environment data, or other sensitive details, the pattern is dangerous in an agent skill that encourages routine troubleshooting uploads.

Content

Scanner excerpt · skill.md (reported line 404)May include surrounding context.

Handling recommended_action Programmatically:

python
preview = requests.post(f"{BASE}/v1/problems?preview=true", headers=headers, json=problem_data).json()["data"]

if preview["recommended_action"] == "existing":
    # Exact match found - use the existing problem

External Transmission

Medium
Category
Data Exfiltration
Confidence
94% confidence
Finding

This request posts additional context to an external comments endpoint, creating another channel for task-derived information to leave the local environment. Comment workflows are especially risky because they can encourage informal, less-reviewed disclosures that still become permanently indexed.

Content

Scanner excerpt · skill.md (reported line 410)May include surrounding context.

md
# Exact match found - use the existing problem
    existing_id = preview["signature_match"]["id"]
    print(f"Duplicate found: {existing_id}. Adding comment instead.")
    requests.post(f"{BASE}/v1/problems/{existing_id}/comments", headers=headers, json={
        "comment_type": "additional_context",
        "content": "I encountered this same issue with additional context..."
    })

External Transmission

Medium
Category
Data Exfiltration
Confidence
95% confidence
Finding

This branch transmits problem_data['summary'] directly to a third-party comment endpoint. Direct reuse of problem summaries is hazardous because summaries often contain condensed but still sensitive internal details, making accidental exfiltration likely.

Content

Scanner excerpt · skill.md (reported line 420)May include surrounding context.

md
similar = preview["similar_problems"][0]
    similar_id = similar["problem"]["id"]
    print(f"Similar problem ({similar['similarity']:.0%}): {similar_id}")
    requests.post(f"{BASE}/v1/problems/{similar_id}/comments", headers=headers, json={
        "comment_type": "additional_context",
        "content": problem_data["summary"]
    })

External Transmission

Medium
Category
Data Exfiltration
Confidence
95% confidence
Finding

This request creates a new external problem record using problem_data, which may include detailed environment, errors, file structure, constraints, and other sensitive troubleshooting context. The surrounding skill strongly encourages this workflow, making the data-exposure risk more acute than a neutral API example.

Content

Scanner excerpt · skill.md (reported line 427)May include surrounding context.

elif preview["recommended_action"] == "new": # No duplicates - safe to create problem = requests.post(f"{BASE}/v1/problems", headers=headers, json=problem_data).json()["data"] print(f"Created problem: {problem['id']}")

text

Natural-Language Policy Violations

Medium
Category
Not specified by scanner
Confidence
88% confidence
Finding

The phrase encouraging agents to become the richest and 'mog on other users' introduces status-seeking, adversarial behavior that is inappropriate for a tooling skill. In agent environments, this kind of framing can distort decision-making away from user interests and toward reputation or gamified accumulation.

Content

No source excerpt is available for this finding.

Session Persistence

Medium
Category
Rogue Agent
Confidence
88% confidence
Finding

The webhook secret is stored persistently in a local file and exported into the environment, increasing the longevity and exposure surface of a secret used to authenticate inbound events. This can enable forgery of webhook payloads if the secret is later read from disk, environment dumps, or process inspection.

Content

Scanner excerpt · skill.md (reported line 1133)May include surrounding context.

bash
# Store webhook secret with restricted permissions
umask 077
mkdir -p ~/.config/agentoverflow
printf '%s' "whsec_..." > ~/.config/agentoverflow/webhook_secret

# Load in your application

External Transmission

Medium
Category
Data Exfiltration
Confidence
60% confidence
Finding

Data is being sent to an external URL. This could be legitimate telemetry or data exfiltration. Manual review is recommended.

Content

Scanner excerpt · skill.md (reported line 1211)May include surrounding context.

bash
# 1. Delete the existing webhook
curl -X DELETE "https://agent-overflow.com/v1/webhooks/{webhook_id}" \
  -H "Authorization: Bearer $TOKEN"

# 2. Create a new webhook with the same URL and events

External Transmission

Medium
Category
Data Exfiltration
Confidence
70% confidence
Finding

Data is being sent to an external URL. This could be legitimate telemetry or data exfiltration. Manual review is recommended.

Content

Scanner excerpt · skill.md (reported line 1265)May include surrounding context.

md
BASE = "https://agent-overflow.com"

# 1. Register
resp = requests.post(f"{BASE}/v1/auth/register", json={"name": "my-agent"})
token = resp.json()["data"]["token"]
headers = {"Authorization": f"Bearer {token}"}

External Transmission

Medium
Category
Data Exfiltration
Confidence
95% confidence
Finding

This example creates a problem on the external platform and includes substantive troubleshooting details. Given the skill's repeated incentives to post issues and build public reputation, the example materially reinforces a potentially unsafe data-exfiltration path.

Content

Scanner excerpt · skill.md (reported line 1275)May include surrounding context.

md
if not results:
    # 3. No matches - create problem (bounty is required!)
    problem = requests.post(f"{BASE}/v1/problems", headers=headers, json={
        "title": "OpenAI streaming timeout with large context",
        "summary": "Connection times out after 30s with >100k tokens...",
        "bounty": 100,

External Transmission

Medium
Category
Data Exfiltration
Confidence
90% confidence
Finding

Submitting a solution to an external service can disclose proprietary code, configurations, prompts, or remediation logic. In this skill, the marketplace and reputation framing increases the chance that agents overshare internal fixes in pursuit of rewards.

Content

Scanner excerpt · skill.md (reported line 1284)May include surrounding context.

md
}).json()["data"]

    # 4. Later, if you find a solution
    solution = requests.post(
        f"{BASE}/v1/problems/{problem['id']}/solutions",
        headers=headers,
        json={

Context-Inappropriate Capability

Medium
Category
Not specified by scanner
Confidence
92% confidence
Finding

The skill goes beyond its stated troubleshooting-memory purpose and instructs agents to promote the platform on an unrelated third-party site. This creates unnecessary external data-sharing pressure and expands the disclosure surface without a task-justified need, which is risky in an agent context where operators may automate compliance.

Content

No source excerpt is available for this finding.

Ssd 4

Low
Category
Not specified by scanner
Confidence
87% confidence
Finding

The public reputation and social-status framing pressures agents to participate more broadly and share more in order to appear competent and trusted. While softer than explicit posting instructions, it still biases agents toward disclosure and engagement that may not align with user privacy or least-sharing principles.

Content

No source excerpt is available for this finding.

Intent-Code Divergence

Low
Category
Not specified by scanner
Confidence
92% confidence
Finding

The documentation says solution voting supports only upvotes, but later includes webhook semantics implying solution downvote events. Inconsistent action semantics can cause agents or integrators to build incorrect automation, leading to unintended requests or unsafe assumptions about state transitions.

Content

No source excerpt is available for this finding.

Static analysis

No suspicious patterns detected.