T09 · Insecure Skill Coding Practices
- Location
scripts/agent.py:91- Finding
Default Security Group Check Can Falsely Report CIS Compliance
- Content
View full analysis
- Remediation
View remediation
Security audit
Security checks for vulnerabilities and agentic risk
The skill is broadly aligned with cloud CIS auditing, but it includes under-scoped remediation commands that can change live cloud resources across an account.
Install only if you will treat it as guidance for experienced cloud operators, not as a safe automatic remediation runbook. Use read-only credentials for audits, verify provider and benchmark coverage separately, review every remediation command before use, target only confirmed resources, preserve existing encryption and logging settings, and require normal change approval for production accounts.
scripts/agent.py:91Default Security Group Check Can Falsely Report CIS Compliance
scripts/agent.py:27AWS API Errors Are Misclassified as Confirmed Compliance Failures
SKILL.md:137Bulk S3 Remediation Can Overwrite Stronger Encryption Configuration
There is a clear description-behavior mismatch. The declared purpose presents a broad instructional or operational capability for CIS-based cloud security auditing across AWS, Azure, and GCP, including remediation and continuous compliance workflows. The supplied code only implements a narrow AWS-specific command-line auditor using boto3 for a handful of CIS AWS Foundations controls. While the AWS CIS auditing portion partially aligns, the primary scope and capabilities are materially narrower than declared, especially regarding Azure/GCP support, third-party tool usage, remediation, and continuous monitoring.
The skill states read-only audit prerequisites but later provides commands that delete access keys, enable encryption, create trails, and configure monitoring. This can mislead users or agents into performing privileged, state-changing actions in production under the guise of an audit, creating risk of unintended outages, policy violations, or destructive changes.
Without declared permissions the skill's intent is opaque and cannot be validated.
The remediation examples include destructive and configuration-changing commands, such as deleting access keys and bulk-modifying bucket encryption, without an explicit safety warning or guardrails. In a cloud operations context, users may copy-paste these commands into live environments, causing service disruption, loss of emergency access, or unreviewed security changes.
The skill metadata and module docstring imply broader CIS benchmark coverage than the code actually provides, but the implementation is AWS-only via boto3. In a security auditing skill, this can mislead operators into believing Azure and GCP were assessed when they were not, creating dangerous gaps in compliance and detection coverage.
The docstring broadly states the agent audits against CIS Benchmarks, while the implementation only covers a limited set of AWS CIS controls. In a security context, overstated audit coverage can cause users to over-trust results and miss unassessed services, accounts, or cloud platforms.
The manifest says the skill covers running automated assessments with tools like Prowler and ScoutSuite, which implies integration or operational handling of those assessment tools. The implementation instead runs a small set of handwritten boto3 checks and generates its own JSON report, which is materially narrower than the described behavior.
No suspicious patterns detected.