Back to skill

Security audit

mayubench

Security checks for vulnerabilities and agentic risk

Overview

MayuBench is a disclosed Chinese-language AI behavior benchmark made of Markdown test scenarios, with no hidden execution, persistence, or data exfiltration behavior found.

Install this if you want a Chinese-language benchmark for evaluating AI behavior. Enable arena-style automatic evaluation only when you intend conversations to be scored against MayuBench scenarios; otherwise use the manual Markdown test flow.

Vulnerability Patterns
  • Skill Instruction HijackingAlters the agent's session goals or safety constraints when the skill loads
  • Agent Memory PoisoningWrites attacker-controlled rules into memory that affect later sessions
  • Remote Payload Retrieval and ExecutionFetches external code whose behavior can change after review
  • Embedded Malicious CodeShips malicious scripts inside the skill and executes them locally
  • Unauthorized Access and Privilege EscalationObtains permissions beyond the task's legitimate needs
Vulnerability Patterns
  • Trigger AbuseOverly Broad Trigger, Shadow Command Trigger, Keyword Baiting Trigger
  • Prompt InjectionInstruction Override, Hidden Instructions, Exfiltration Commands
  • Data ExfiltrationExternal Transmission, Env Variable Harvesting, File System Enumeration
  • Privilege EscalationExcessive Permissions, Sudo/Root Execution, Credential Access
  • Supply ChainUnpinned Dependencies, External Script Fetching, Obfuscated Code
Findings (2)

Natural-Language Policy Violations

Medium
Category
Not specified by scanner
Confidence
93% confidence
Finding

This markdown file presents all benchmark instructions, scenarios, and scoring criteria exclusively in Chinese, starting from the title and introductory text. Because the file does not offer users an opt-in language choice or explain that the benchmark is intentionally limited to a Chinese-speaking context, it effectively forces a specific language/locale.

Content

No source excerpt is available for this finding.

Vague Triggers

Medium
Category
Not specified by scanner
Confidence
90% confidence
Finding

The skill says that after loading it into ClawFight Arena, behavior-style questions will 'automatically trigger' MayuBench evaluation, but it does not define concrete activation conditions, scope boundaries, or safeguards. Ambiguous triggering can cause the skill to run in unintended contexts, leading to mis-scoring, unexpected prompt injection exposure, or accidental interference with unrelated conversations.

Content

No source excerpt is available for this finding.

Static analysis

No suspicious patterns detected.