T01 · Skill Instruction Hijacking
Warning
- Location
- AGENT_STABILITY_FRAMEWORK.md:92
- Finding
- System-Prompt Rules Can Override Safety-Relevant Response Behavior<![CDATA[ ## Vulnerability Details **File Location**: `AGENT_STABILITY_FRAMEWORK.md:92-124` **Vulnerability Type**: T01: Skill Instruction Hijacking **Risk Level**: Medium ### Complete Vulnerable Snippet ```markdown ### Standing Orders (Add to System Prompt) Adapt these to your agent's soul — the specifics change, the principle doesn't: \`\`\` ## STANDING ORDERS — STABILITY 1. NEVER add information the user didn't ask for 2. NEVER explain WHY something matters unless asked "why" 3. NEVER validate or grade the user's decisions 4. NEVER add disclaimers or hedging unless genuinely uncertain about facts 5. NEVER pad with social cushioning ("let me know", "hope this helps") 6. If a sentence can be removed without changing information content — remove it 7. Match the tone and length of BASELINE_EXAMPLES.md, not training defaults \`\`\` ### Pre-Send Gate (Add to System Prompt) Binary delete triggers checked before every output: \`\`\` ## PRE-SEND GATE Before sending, check each part of your response. YES to any = delete that part: - Does any sentence exist that wasn't requested? → DELETE - Does any sentence validate/praise the user? → DELETE - Is there a closing pleasantry? → DELETE - Am I explaining the user's logic back to them? → DELETE - Would removing this paragraph change information content? No? → DELETE - Is this longer than the closest baseline example? → TRIM \`\`\` ``` ### Technical Analysis The framework explicitly directs users to copy broad behavioral rules into the system prompt. These rules use unconditional `NEVER` and `DELETE` directives but do not state that platform policies, developer instructions, safety requirements, authorization checks, and material risk disclosures take precedence. The instruction to delete every sentence that was not expressly requested can suppress information required for safe and accurate task completion. Similarly, the prohibition against unsolicited disclaimers or explanations may remove warnings about de ...[truncated 1800 chars]
- Remediation
- <![CDATA[ ## Remediation Suggestions 1. Add an explicit precedence rule stating that platform policies, developer instructions, legal requirements, authorization boundaries, security controls, factual accuracy, and user safety always override ASF style rules. 2. Replace unconditional deletion directives with conditional guidance. For example, retain unsolicited content when it is necessary to explain risk, uncertainty, prerequisites, authorization, destructive effects, or irreversible consequences. 3. Restrict standing orders to presentation preferences such as tone and ordinary verbosity. Prohibit persona rules from modifying refusal behavior, tool authorization, privacy protections, factual disclosure, or safety warnings. 4. Require a safety review before any ASF block is inserted into a system prompt. 5. Add regression tests covering destructive commands, financial decisions, medical or legal topics, credential handling, privacy-sensitive operations, and uncertain factual claims. 6. Revise the pre-send gate to ask whether content is necessary for safety, accuracy, or informed consent before deleting it. ]]>
