Autonomous Decision Making
Medium
- Category
- Excessive Agency
- Confidence
- 75% confidence
- Finding
Skill enables autonomous high-impact decisions without human-in-the-loop verification. Critical operations (destructive commands, financial transactions, data deletion) should require explicit user confirmation.
- Content
md probe. Write the 8-item DO-CONFIRM gate now — evals-on-this-version, injection probe, least-privilege tools, spend cap, rollback, human gate on irreversible actions, PII check, incident owner — and make the promoting engineer own it. It costs 10 minutes a ship and is the cheapest "enterprise-ready" signal you can build. **Founder takeaway (SMB):** Same discipline, smaller surface: before turning on any AI tool that talks to customers or touches money, a 6-item READ-DO — what can it send/spend without asking me? · did I test the 5 questions customers actually ask? · is there a human handoff? · a daily cost cap? · do I know how to turn it off? · who checks its output the first week? A restaurant's reservation bot and a Fortune-500 agent fail the same way: a known step, skipped. *Sources: NIST (2023). Artificial Intelligence Risk Management Framework (AI RMF 1.0), January 2023. https://www.nist.gov/itl/ai-risk-management-framework — the institutional codification of pre-deployment AI c
