Back to skill

Security audit

Zzz4ai Search Engine

Security checks for vulnerabilities and agentic risk

Overview

This is a coherent Chinese search skill, but its very broad trigger terms can cause ordinary questions to be sent to third-party search providers without clear user intent.

Install only if you want a China-focused web search skill and are comfortable with search terms being sent to Bing CN, 360, Toutiao, or Bilibili. Avoid using it for private, proprietary, legal, employment, credential, or otherwise sensitive topics unless you explicitly review the query and provider first.

Vulnerability Patterns
  • Insecure Skill Coding PracticesFinds exploitable flaws such as hardcoded secrets or command injection
  • Skill Instruction HijackingAlters the agent's session goals or safety constraints when the skill loads
  • Agent Memory PoisoningWrites attacker-controlled rules into memory that affect later sessions
  • Remote Payload Retrieval and ExecutionFetches external code whose behavior can change after review
  • Embedded Malicious CodeShips malicious scripts inside the skill and executes them locally
Findings (1)

T09 · Insecure Skill Coding Practices

Warning
Location
SKILL.md:3
Finding
Overbroad Activation Can Transmit Unintended User Queries to External Search Providers## Vulnerability Details **File Location**: `SKILL.md`, lines 3 and 32-37 **Vulnerability Type**: Overbroad automatic activation and unintended third-party data disclosure **Risk Level**: Medium ### Relevant Code The following is a faithful English rendering of the relevant activation and workflow instructions: ```yaml description: > Trigger terms include: search, find, look up, domestic search, Chinese search, which company, which one, ranking, comparison, latest, how is it, is it good, how much, what, how, why, learn about, investigate, review, recommend, and evaluation. ``` ```text Phase 1: Query preprocessing 1. Read engine names and URL templates from config.json. 2. Validate that the query is not empty. 3. Classify the request as general, academic, video, news, or bilingual. 4. Select one to three preferred engines and one fallback. 5. For privacy, political, medical, or financial keywords, explain the planned search scope and ask whether to continue. 6. URL-encode the keywords and substitute them into the {keyword} URL. ``` The resulting query can be transmitted through templates such as: ```text https://cn.bing.com/search?q={keyword}&ensearch=0 https://www.so.com/s?q={keyword} https://www.toutiao.com/search/?keyword={keyword} https://search.bilibili.com/all?keyword={keyword} ``` ### Technical Analysis The Skill legitimately requires outbound network access because its declared purpose is search aggregation. However, its activation description includes generic terms equivalent to “what,” “how,” “why,” “latest,” and “recommend.” These terms occur in many ordinary questions that do not clearly request an external search. Once activated, the workflow converts the request into a query and sends it to one or more third-party providers. The confirmation checkpoint applies only when the Skill recognizes privacy, political, medical, or financial keywords. Other confidential or ...[truncated 2455 chars]
Remediation
## Remediation Suggestions 1. Restrict activation to explicit search intent, such as “search the web,” “look this up online,” or a direct request to use a named search provider. 2. Remove generic activation terms equivalent to “what,” “how,” “why,” “latest,” and “recommend.” 3. Before an outbound request, display the exact query and intended provider whenever the query was inferred from conversational context or may contain non-public information. 4. Expand sensitive-data checks beyond the current four categories. Detect personal identifiers, credentials, private URLs, internal project names, source-code fragments, legal matters, employment information, and proprietary data. 5. Minimize transmitted content by constructing a concise query rather than forwarding full user messages or surrounding conversation. 6. Use only the minimum number of providers needed for the request. Do not send the same potentially sensitive query to multiple engines unless the user requests aggregation. 7. Allow users to select or exclude providers before transmission. 8. Preserve the documented in-memory-only cookie behavior, clear cookies after each search, and avoid reusing search sessions across users or conversations. 9. Add tests confirming that ordinary informational questions do not activate the Skill without explicit external-search intent.
Vulnerability Patterns
  • Data ExfiltrationExternal Transmission, Env Variable Harvesting, File System Enumeration
  • Trigger AbuseOverly Broad Trigger, Shadow Command Trigger, Keyword Baiting Trigger
  • Prompt InjectionInstruction Override, Hidden Instructions, Exfiltration Commands
  • Privilege EscalationExcessive Permissions, Sudo/Root Execution, Credential Access
  • Supply ChainUnpinned Dependencies, External Script Fetching, Obfuscated Code
Findings (8)

Vague Triggers

High
Confidence
98% confidence
Finding
The trigger list is extremely broad and includes common conversational terms like “什么/如何/为什么/推荐/最新/怎么样,” which can cause the skill to activate for many unrelated user requests. Because this skill performs external web searches, unintended activation can leak user prompts to third-party search engines and cause the agent to take actions the user did not explicitly intend.

Vague Triggers

Medium
Confidence
97% confidence
Finding
The changelog explicitly states that the skill's trigger list was expanded to include many broad, everyday Chinese phrases such as '什么', '如何', '为什么', '推荐', and '最新'. For a search skill, this materially increases the chance of accidental or overly broad activation across unrelated conversations, causing the agent to invoke an external-search capability when the user did not clearly intend it.

Natural-Language Policy Violations

Medium
Confidence
81% confidence
Finding
The skill is explicitly optimized for Chinese content and domestic search sources, but it does not offer a language or region choice before routing user queries. This can bias results, reduce relevance for non-Chinese queries, and unexpectedly send user searches to region-specific providers, which is a privacy and expectation-management issue rather than a direct exploit path.

Natural-Language Policy Violations

Medium
Confidence
94% confidence
Finding
The configuration hard-codes all search engines to Chinese-region endpoints and behavior, including cn.bing.com and region values of "cn", without presenting user choice or documenting consent. This can route user queries through region-specific services with different censorship, logging, privacy, and legal regimes, creating a real security/privacy concern when users may not expect their searches to be sent to China-focused providers.

Natural-Language Policy Violations

Medium
Confidence
95% confidence
Finding
The title and the entire guide are written as a China-specific, Chinese-language search guide, and it presents Chinese-language/localized engine usage as the default behavior. Under the policy, a skill should not force a specific language or locale unless it is clearly justified as region-specific or gives the user a choice.

Vague Triggers

Medium
Confidence
89% confidence
Finding
The test prompts rely on very broad everyday phrases such as '搜索', '帮我找一下', and topic queries that overlap heavily with normal conversation. In a trigger-based skill system, this can cause over-activation or unintended invocation of the search skill in contexts where the user did not explicitly intend to use this tool, increasing the chance of incorrect routing, privacy leakage in queries, or policy-bypassing behavior through overly eager tool selection.

Natural-Language Policy Violations

Low
Confidence
88% confidence
Finding
The metadata describes the skill entirely in Chinese and explicitly constrains it to the China region via `"region": "cn"`. This indicates a locale-specific behavior without any visible opt-in, language choice, or justification in the file itself, which may conflict with the policy against forcing a specific language or locale.

Natural-Language Policy Violations

Low
Confidence
75% confidence
Finding
All prompts and expected behaviors are written only in Chinese and direct use of China-specific search providers, which may indicate a language/locale assumption. There is no natural-language indication that users can choose another language or locale, nor documentation that this constraint is intentionally region-specific.

Static analysis

No suspicious patterns detected.