AgentBench

This skill is plausibly what it says — a local benchmarking suite that runs 40 tasks using bundled setup scripts — but take these precautions before running it: - Review and run in isolation: The skill executes the included setup.sh and Python scripts on your machine. Inspect those scripts (they are present under tasks/...) and run the benchmark only in a sandboxed environment (container, VM, or isolated development machine) to avoid unintended side effects. - Ensure required tools are present: The skill declares jq, bash, python3 but many setup scripts call git. Install git or otherwise expect setup scripts that call git to fail. Also check for other utilities (awk/sed/printf) your environment might need. - Network activity: SKILL.md allows the agent to use web_search/web_fetch and README references submitting results to https://www.agentbench.app. If you want to avoid network calls, restrict the agent's outbound network access or verify whether you (or the agent runtime) will actually perform uploads. There is no signing key included for the claimed HMAC-signed results — the signing likely happens server-side or is missing from the bundle. - Data writes: The skill creates /tmp/agentbench-* workspaces and may initialize git repositories and write files. Confirm you are comfortable with those writes and that /tmp is acceptable. - If you lack time to audit: prefer running a single task in a disposable environment first (e.g., /benchmark --task <id>) instead of the full suite. Given these mismatches (missing 'git' in declared requirements, open-ended web operations, and code executed locally), proceed but only after the above checks; if you need high assurance, run it in an isolated VM or container and examine setup scripts for anything beyond the expected file and repo setup.