Self-Modification
- Category
- Rogue Agent
- Confidence
- 85% confidence
- Finding
The instruction to 'Update skill/workflow' after recurring errors encourages self-modification of agent behavior based on runtime events. In agent environments, autonomous prompt or workflow mutation can persist mistakes, encode adversarial conditions into future behavior, or bypass normal review and change-control safeguards.
- Content
md □ Could this happen again? → Add guard for this case → Update skill/workflow □ Is there a systemic issue? → Suggest process improvement
