ClawHub

Claw Web Fetch

v0.1.7

Web page → Markdown scraper skill that wraps the clawfetch Node CLI to fetch articles, GitHub READMEs, and Reddit threads into normalized markdown with metad...

⭐ 0· 262·1 current·1 all-time
by@ernestyu
MIT-0
Download zip
LicenseMIT-0 · Free to use, modify, and redistribute. No attribution required.
Security Scan
VirusTotalVirusTotal
Pending
View report →
OpenClawOpenClaw
Benign
high confidence
ℹ
Purpose & Capability
The skill's stated purpose (wrap the clawfetch npm CLI to convert web pages to markdown) aligns with its files and instructions. One inconsistency: the top-level registry metadata lists no required binaries, while SKILL.md and the runtime instructions expect node and npm to be available. This is a documentation mismatch but not a functional red flag.
ℹ
Instruction Scope
SKILL.md limits runtime behavior to invoking the local clawfetch CLI on a URL and documents optional env vars (FLARESOLVERR_URL, PLAYWRIGHT_BROWSERS_PATH, CLAWFETCH_*). The skill allows fetching arbitrary URLs (expected for a scraper), which means it can access external hosts and potentially internal services if the agent/container network permits (SSRF/internal access risk inherent to any URL fetcher). The instructions do not direct data to unexpected external endpoints beyond optional use of a FlareSolverr endpoint supplied via FLARESOLVERR_URL.
✓
Install Mechanism
Install is a single, explicit bootstrap script that runs npm install clawfetch@0.1.7 inside the skill directory. This pulls from the npm registry (no shorteners or personal servers) and does not auto-run at skill install time. Note: the clawfetch package and its dependencies (e.g., Playwright) may download additional browser artifacts during install/run.
ℹ
Credentials
The skill declares no required env vars, but SKILL.md and ENV_EXAMPLE.md document several optional env vars the CLI reads (FLARESOLVERR_URL, PLAYWRIGHT_BROWSERS_PATH, CLAWFETCH_*, NODE_OPTIONS). These are optional and expected for a browser-based scraper, but users should be aware the CLI will read process.env and that setting FLARESOLVERR_URL delegates fetching to that external service.
✓
Persistence & Privilege
The skill does not request permanent presence (always is false), does not modify other skills or global agent config, and requires an explicit manual bootstrap step. Autonomous invocation by agents is allowed by default but is normal for skills.
Assessment
This skill is a small wrapper that installs and runs the public 'clawfetch' npm CLI. Before installing: (1) confirm your OpenClaw environment has node and npm available; (2) review the upstream clawfetch package/source (version 0.1.7) so you trust the code you're pulling from npm; (3) be aware the skill will perform network requests to arbitrary URLs (so it can access internal services if the agent/container network allows), and may optionally call a FlareSolverr endpoint if you set FLARESOLVERR_URL — don't point that to an untrusted host; (4) understand Playwright and browser artifacts can be large and may download additional binaries during install/run; (5) run the provided bootstrap_deps.sh manually (it does npm install in the skill folder) rather than allowing any automated action. These precautions will keep behavior consistent with the skill's documented purpose.

Like a lobster shell, security has layers — review code before you run it.

latestvk975dk3j5ctyns86f93amf56fh83y220

License

MIT-0
Free to use, modify, and redistribute. No attribution required.
Termshttps://spdx.org/licenses/MIT-0.html

Comments