Back to skill

Security audit

reviews-to-github-issues

Security checks for vulnerabilities and agentic risk

Overview

ClawScan rates this skill suspicious with medium confidence because scanners report app monitoring beyond its stated review-to-issue purpose and incomplete analysis of one workflow expression.

Consider holding off on installation until you understand why the skill creates broader app-monitoring watches, confirm what the AppGoat requests transmit, and resolve the command-line API-key exposure. The scan was partial: one workflow expression was not fully analyzed, so the evidence is incomplete.

Vulnerability Patterns
  • Skill Instruction HijackingAlters the agent's session goals or safety constraints when the skill loads
  • Agent Memory PoisoningWrites attacker-controlled rules into memory that affect later sessions
  • Remote Payload Retrieval and ExecutionFetches external code whose behavior can change after review
  • Embedded Malicious CodeShips malicious scripts inside the skill and executes them locally
  • Unauthorized Access and Privilege EscalationObtains permissions beyond the task's legitimate needs
Vulnerability Patterns
  • Data ExfiltrationExternal Transmission, Env Variable Harvesting, File System Enumeration
  • MCP Least PrivilegeUnderdeclared Capability, Wildcard Permission, Missing Permission Declaration
  • MCP Tool PoisoningHidden Instructions, Unicode Deception, Parameter Description Injection
  • Prompt InjectionInstruction Override, Hidden Instructions, Exfiltration Commands
  • Privilege EscalationExcessive Permissions, Sudo/Root Execution, Credential Access
Findings (20)

Description-Behavior Mismatch

High
Category
MCP Tool Poisoning
Confidence
90% confidence
Finding

Using AppGoat is consistent with the description, but creating a configured monitoring watch is a distinct state-changing operation beyond retrieving reviews for issue triage. Daily review triage could use monitoring, but the description does not disclose creating these watches or tracking the broader event types. The supplied chunk does not retrieve review content or create, deduplicate, or comment on GitHub issues.

Content

No source excerpt is available for this finding.

Incomplete referenced artifact analysis

High
Category
analysis-evasion
Confidence
100% confidence
Finding

Referenced artifact was not completely inspected

Content

Scanner excerpt · SKILL.md (reported line 167)May include surrounding context.

md
starts [events/appgoat-events.yml](events/appgoat-events.yml) through `repository_dispatch` (paid

Skill declares no tool scope ('permissions' or 'allowed-tools') but code capabilities were detected: shell.

Medium
Category
MCP Least Privilege
Confidence
70% confidence
Finding

Without declared permissions the skill's intent is opaque and cannot be validated.

Content

No source excerpt is available for this finding.

External Transmission

Medium
Category
Data Exfiltration
Confidence
50% confidence
Finding

Data is being sent to an external URL. This could be legitimate telemetry or data exfiltration. Manual review is recommended.

Content

Scanner excerpt · SKILL.md (reported line 151)May include surrounding context.

md
cp -r /tmp/appgoat-skills/skills/* .claude/skills/
          # Hosted AppGoat MCP server; the key goes into a file, not the command line.
          jq -n --arg key "$APPGOAT_API_KEY" \
            '{mcpServers: {appgoat: {type: "http", url: "https://api.appgoat.ai/mcp", headers: {"x-api-key": $key}}}}' \
            > "$RUNNER_TEMP/appgoat-mcp.json"
      - uses: anthropics/claude-code-action@v1
        env:

External Transmission

Medium
Category
Data Exfiltration
Confidence
50% confidence
Finding

Data is being sent to an external URL. This could be legitimate telemetry or data exfiltration. Manual review is recommended.

Content

Scanner excerpt · events/README.md (reported line 75)May include surrounding context.

  1. Send a test (event type appgoat.test; GitHub answers 204):

    bash
    curl -s -X POST https://api.appgoat.ai/v1/webhooks/<id>/test -H "x-api-key: $APPGOAT_API_KEY" \
      | jq '.data | {ok, response_status, error}'
    gh run list --workflow appgoat-events.yml --limit 1     # the "test" job logs the event
    

External Transmission

Medium
Category
Data Exfiltration
Confidence
50% confidence
Finding

Data is being sent to an external URL. This could be legitimate telemetry or data exfiltration. Manual review is recommended.

Content

Scanner excerpt · events/README.md (reported line 118)May include surrounding context.

bash
STATE=.appgoat/events-state.json; mkdir -p .appgoat; [ -f $STATE ] || echo '{}' > $STATE
SINCE=$(jq -r '.since // (now - 86400 | strftime("%Y-%m-%dT%H:%M:%SZ"))' $STATE)
curl -s -G https://api.appgoat.ai/v1/events -H "x-api-key: $APPGOAT_API_KEY" \
  --data-urlencode "type=negative_review_spike,review_spike,rating_drop" \
  --data-urlencode "since=$SINCE" -d limit=200 \
  | jq --slurpfile st $STATE '($st[0].seen // []) as $seen

External Transmission

Medium
Category
Data Exfiltration
Confidence
50% confidence
Finding

Data is being sent to an external URL. This could be legitimate telemetry or data exfiltration. Manual review is recommended.

Content

Scanner excerpt · events/appgoat-events.yml (reported line 96)May include surrounding context.

yaml
cp -r /tmp/appgoat-skills/skills/* .claude/skills/
          # Hosted AppGoat MCP server; the key goes into a file, not the command line.
          jq -n --arg key "$APPGOAT_API_KEY" \
            '{mcpServers: {appgoat: {type: "http", url: "https://api.appgoat.ai/mcp", headers: {"x-api-key": $key}}}}' \
            > "$RUNNER_TEMP/appgoat-mcp.json"

      - uses: anthropics/claude-code-action@v1

External Transmission

Medium
Category
Data Exfiltration
Confidence
60% confidence
Finding

Data is being sent to an external URL. This could be legitimate telemetry or data exfiltration. Manual review is recommended.

Content

Scanner excerpt · events/README.md (reported line 26)May include surrounding context.

1. Watch the app

bash
curl -s https://api.appgoat.ai/v1/watches \
  -H "x-api-key: $APPGOAT_API_KEY" -H 'content-type: application/json' \
  -d '{
    "kind": "app",

External Transmission

Medium
Category
Data Exfiltration
Confidence
50% confidence
Finding

Data is being sent to an external URL. This could be legitimate telemetry or data exfiltration. Manual review is recommended.

Content

Scanner excerpt · events/README.md (reported line 26)May include surrounding context.

1. Watch the app

bash
curl -s https://api.appgoat.ai/v1/watches \
  -H "x-api-key: $APPGOAT_API_KEY" -H 'content-type: application/json' \
  -d '{
    "kind": "app",

External Transmission

Medium
Category
Data Exfiltration
Confidence
60% confidence
Finding

Data is being sent to an external URL. This could be legitimate telemetry or data exfiltration. Manual review is recommended.

Content

Scanner excerpt · events/README.md (reported line 61)May include surrounding context.

  1. Register the webhook (kind: github, url = owner/repo):

    bash
    curl -s https://api.appgoat.ai/v1/webhooks \
      -H "x-api-key: $APPGOAT_API_KEY" -H 'content-type: application/json' \
      -d "$(jq -n --arg repo acme/my-app --arg token "$GITHUB_DISPATCH_TOKEN" '{
        kind: "github", url: $repo, github_token: $token,
    

External Transmission

Medium
Category
Data Exfiltration
Confidence
50% confidence
Finding

Data is being sent to an external URL. This could be legitimate telemetry or data exfiltration. Manual review is recommended.

Content

Scanner excerpt · events/README.md (reported line 61)May include surrounding context.

  1. Register the webhook (kind: github, url = owner/repo):

    bash
    curl -s https://api.appgoat.ai/v1/webhooks \
      -H "x-api-key: $APPGOAT_API_KEY" -H 'content-type: application/json' \
      -d "$(jq -n --arg repo acme/my-app --arg token "$GITHUB_DISPATCH_TOKEN" '{
        kind: "github", url: $repo, github_token: $token,
    

External Transmission

Medium
Category
Data Exfiltration
Confidence
60% confidence
Finding

Data is being sent to an external URL. This could be legitimate telemetry or data exfiltration. Manual review is recommended.

Content

Scanner excerpt · events/README.md (reported line 118)May include surrounding context.

bash
STATE=.appgoat/events-state.json; mkdir -p .appgoat; [ -f $STATE ] || echo '{}' > $STATE
SINCE=$(jq -r '.since // (now - 86400 | strftime("%Y-%m-%dT%H:%M:%SZ"))' $STATE)
curl -s -G https://api.appgoat.ai/v1/events -H "x-api-key: $APPGOAT_API_KEY" \
  --data-urlencode "type=negative_review_spike,review_spike,rating_drop" \
  --data-urlencode "since=$SINCE" -d limit=200 \
  | jq --slurpfile st $STATE '($st[0].seen // []) as $seen

External Transmission

Medium
Category
Data Exfiltration
Confidence
60% confidence
Finding

Data is being sent to an external URL. This could be legitimate telemetry or data exfiltration. Manual review is recommended.

Content

Scanner excerpt · reference/api.md (reported line 15)May include surrounding context.

bash
APP=com.spotify.music
curl -s -G -H "x-api-key: $APPGOAT_API_KEY" "https://api.appgoat.ai/v1/apps/$APP/reviews" \
  -d country=us -d rating=1-3 -d since=2026-10-15 -d limit=100 \
  | jq -r '.data[] | "\(.rating)★ v\(.version) \(.created_at) review:\(.review_id) \(.body[0:200])"'

External Transmission

Medium
Category
Data Exfiltration
Confidence
60% confidence
Finding

Data is being sent to an external URL. This could be legitimate telemetry or data exfiltration. Manual review is recommended.

Content

Scanner excerpt · events/README.md (reported line 20)May include surrounding context.

md
run reads reviews: **2–10 credits** (1 app lookup + 1–3 review pages + refreshes), plus Claude
tokens and, for the Action, GitHub Actions minutes. Polling that finds no event costs no credits.

All calls below use `https://api.appgoat.ai/v1` with `x-api-key: $APPGOAT_API_KEY` (create a key at
[dash.appgoat.ai](https://dash.appgoat.ai)).

## 1. Watch the app

External Transmission

Medium
Category
Data Exfiltration
Confidence
60% confidence
Finding

Data is being sent to an external URL. This could be legitimate telemetry or data exfiltration. Manual review is recommended.

Content

Scanner excerpt · reference/api.md (reported line 3)May include surrounding context.

md
# REST fallback

Without the AppGoat MCP server, call the API directly. Base URL `https://api.appgoat.ai/v1`,
header `x-api-key: $APPGOAT_API_KEY` (create a key at https://dash.appgoat.ai). Responses are
`{ "data": …, "meta": { "credits_used", "credits_remaining", "next_cursor", … } }`; errors carry `error.hint`.

External Transmission

Medium
Category
Data Exfiltration
Confidence
60% confidence
Finding

Data is being sent to an external URL. This could be legitimate telemetry or data exfiltration. Manual review is recommended.

Content

Scanner excerpt · reference/api.md (reported line 15)May include surrounding context.

bash
APP=com.spotify.music
curl -s -G -H "x-api-key: $APPGOAT_API_KEY" "https://api.appgoat.ai/v1/apps/$APP/reviews" \
  -d country=us -d rating=1-3 -d since=2026-10-15 -d limit=100 \
  | jq -r '.data[] | "\(.rating)★ v\(.version) \(.created_at) review:\(.review_id) \(.body[0:200])"'

External Transmission

Medium
Category
Data Exfiltration
Confidence
60% confidence
Finding

Data is being sent to an external URL. This could be legitimate telemetry or data exfiltration. Manual review is recommended.

Content

Scanner excerpt · scripts/poll_events.sh (reported line 18)May include surrounding context.

sh
set -euo pipefail

CURL=${CURL:-curl}
API=${APPGOAT_API_URL:-https://api.appgoat.ai/v1}

cmd=${1:-}
shift || true

External Transmission

Medium
Category
Data Exfiltration
Confidence
70% confidence
Finding

Data is being sent to an external URL. This could be legitimate telemetry or data exfiltration. Manual review is recommended.

Content

Scanner excerpt · scripts/poll_events.sh (reported line 52)May include surrounding context.

sh
trap 'rm -f "$pages"' EXIT
    cursor=
    while :; do
      page=$($CURL -sS -f -G -H "x-api-key: $APPGOAT_API_KEY" "$API/events" \
        --data-urlencode "since=$since" --data-urlencode "type=$types" -d limit=200 \
        ${app:+--data-urlencode "app=$app"} ${cursor:+--data-urlencode "cursor=$cursor"})
      printf '%s\n' "$page" | jq -c '.data[]' >>"$pages"

A matching closed issue causes a duplicate topic issue by default, contrary to the manifest's one-issue-per-topic behavior.

Medium
Category
Excessive Agency
Confidence
96% confidence
Finding

The manifest promises that new reviews are added as comments to an existing issue instead of creating duplicates. At L088–L109, a matching closed issue is reused only when --reopen is supplied; otherwise, the script creates another issue with the same topic marker and merely references the closed issue. Although the file header documents this behavior, it contradicts the manifest's deduplication promise.

Content

No source excerpt is available for this finding.

The MCP setup passes the API key as a command-line argument despite explicitly claiming otherwise.

Low
Category
Excessive Agency
Confidence
99% confidence
Finding

Shell expansion places the API key in jq's argument vector through --arg, contradicting the assertion that the key is not passed on the command line. A process with sufficient visibility into the runner's processes or process telemetry could capture the credential, although the short-lived hosted-runner context limits exposure.

Content

No source excerpt is available for this finding.