Skill Quality Auditor
v1.0.0Evaluate and score AgentSkills on design, content, security, and usability, producing a detailed numeric scorecard with improvement suggestions.
Like a lobster shell, security has layers — review code before you run it.
License
SKILL.md
Skill Reviewer
Four-dimension quality auditor for AgentSkills.
Review Process
Step 1: Inventory & Classify
find /path/to/skill -type f— list all files. If path doesn't exist or is empty, abort with error.- Read
_meta.jsonor.clawhub/origin.jsonif present (source, version, author info). - Read SKILL.md in full.
- Classify skill type per
references/weight-adjustment.md→ determine weights.
Step 2: Scan
- SKILL.md (full read)
- scripts/ (full read, do NOT execute)
- references/ (full read if ≤10 files or ≤50KB total; spot-check otherwise)
- assets/ (list filenames, flag non-asset file types: .sh/.py/.exe/.bat/.ps1 in assets/ = suspicious)
- Other files (.json, dotfiles, symlinks) — inspect each
Step 3: Score Each Dimension
Load reference files: references/design-quality.md, references/content-quality.md, references/security.md, references/usability.md.
For each dimension, walk the checklist and score per the rubric. Cite [file:line] for each finding.
Security shortcut: Run grep sweeps for CRITICAL patterns first (see security.md C1-C11). If any CRITICAL found → D3=1, note it, but still score remaining dimensions — don't skip them.
Orphan file check (security.md): After reading SKILL.md, cross-reference all mentioned files against the actual file list. Flag orphans.
Step 4: Calculate & Verdict
Weighted total = Σ(dim_score × adjusted_weight)
| Verdict | Condition |
|---|---|
| ✅ PASS | Total ≥ 8 AND every dimension ≥ 6 AND no CRITICAL findings |
| 🔧 REVISE | Total < 8 OR any dimension < 6 OR any CRITICAL finding |
CRITICAL auto-revise: Even if total ≥ 8, any security CRITICAL finding forces REVISE.
Report Format
Use list format (not tables — compatible with all platforms):
PASS:
【技能审校通过】
技能:{name}
路径:{path}
类型:{type}
综合得分:{score}/10
审校日期:{date}
• 设计质量({w1}%):{d1}/10 — {简要说明}
• 内容质量({w2}%):{d2}/10 — {简要说明}
• 安全性({w3}%):{d3}/10 — {简要说明}
• 实用性({w4}%):{d4}/10 — {简要说明}
亮点:
- {亮点1}
- {亮点2}
REVISE:
【技能审校打回】
技能:{name}
路径:{path}
类型:{type}
综合得分:{score}/10
审校日期:{date}
⚠️ 判定维度:
• 设计质量({w1}%):{d1}/10
• 内容质量({w2}%):{d2}/10
• 安全性({w3}%):{d3}/10
• 实用性({w4}%):{d4}/10
具体问题:
- [D1] {issue} — {file}:{line}
- [D3] 🔴 CRITICAL: {issue} — {file}:{line}
改进方向:
- {方向1}
- {方向2}
达标标准:
- {标准1}
- {标准2}
References
references/weight-adjustment.md— type classification + weight matrixreferences/design-quality.md— D1 checklist + rubric + scoring rulesreferences/content-quality.md— D2 checklist + rubric + scoring rulesreferences/security.md— D3 pattern table + detection commandsreferences/usability.md— D4 checklist + rubric + scoring rules
Files
6 totalComments
Loading comments…
