Security audit
Security checks for vulnerabilities and agentic risk
This is a disclosed web-scraping skill with powerful browser and anti-bot features, but the artifacts are coherent with that purpose and I found no hidden or malicious behavior.
Install this only if you intentionally need a powerful scraping/browser automation tool. Pin package or Docker versions where possible, scrape only sites you are authorized to access, avoid passing real cookies or proxy credentials unless necessary, clear local state/caches when done, and do not expose the MCP HTTP server without authentication and TLS.
The skill clearly enables network-capable scraping, browser automation, and crawling, but it does not declare an explicit tool scope such as permissions or allowed-tools. In an agent environment, missing scope boundaries can cause over-broad invocation and allow the skill to perform network actions without clear policy constraints or user awareness.
The description says to use the skill whenever asked to scrape, crawl, extract data, when web_fetch fails, for anti-bot protected sites, or to write Python scraping code. That broad routing can cause the agent to invoke a powerful network/browser automation skill for common coding requests, increasing the chance of unnecessary external access or misuse.
The Docker reference docker pull pyd4vinci/scrapling omits a fixed tag or digest, so users may pull a different image over time than the one reviewed. This weakens supply-chain integrity and reproducibility, and could expose users to a malicious or compromised image if the upstream tag changes.
Using the latest tag for ghcr.io/d4vinci/scrapling:latest makes the deployed artifact mutable and unpredictable. If the upstream image is replaced or compromised, users may execute unreviewed code with network and browser automation capabilities.
The skill instructs saving fetched content to files and even recommends temp-file workflows, but it does not warn about path safety, overwrites, or sensitive local file destinations. In an agent setting, this can lead to unintended overwriting of user files or writing untrusted remote content to unsafe locations.
Large whitespace padding was detected (a block of blank lines or a long run of spaces). This can push injected instructions below or to the right of the visible area so a human reviewer never sees them while the agent still reads them. Manual review of the hidden content is recommended.
Those options are shared between the 4 HTTP request commands:
| Option | Input type | Description |
|:-------------------------------------------|:----------:|:-----------------------------------------------------------------------------------------------------------------------------------------------|
| -H, --headers | TEXT | HTTP headers in format "Key: Value" (can be used multiple times) |
| --cookies | TEXT | Cookies string in format "name1=value1; name2=value2" |
Large whitespace padding was detected (a block of blank lines or a long run of spaces). This can push injected instructions below or to the right of the visible area so a human reviewer never sees them while the agent still reads them. Manual review of the hidden content is recommended.
| -s, --css-selector | TEXT | CSS selector to extract specific content from the page. It returns all matches. |
| -p, --params | TEXT | Query parameters in format "key=value" (can be used multiple times) |
| --follow-redirects / --no-follow-redirects | None | Whether to follow redirects (default: "safe", rejects redirects to internal/private IPs) |
| --verify / --no-verify | None | Whether to verify SSL certificates (default: True) |
| --impersonate | TEXT | Browser to impersonate. Can be a single browser (e.g., Chrome) or a comma-separated list for random selection (e.g., Chrome, Firefox, Safari). |
| --stealthy-headers / --no-stealthy-headers | None | Use stealthy browser headers (default: True) |
| --ai-targeted | None | Select body content and filter common hidden elements for AI consumption (default: False) |
Large whitespace padding was detected (a block of blank lines or a long run of spaces). This can push injected instructions below or to the right of the visible area so a human reviewer never sees them while the agent still reads them. Manual review of the hidden content is recommended.
| --follow-redirects / --no-follow-redirects | None | Whether to follow redirects (default: "safe", rejects redirects to internal/private IPs) |
| --verify / --no-verify | None | Whether to verify SSL certificates (default: True) |
| --impersonate | TEXT | Browser to impersonate. Can be a single browser (e.g., Chrome) or a comma-separated list for random selection (e.g., Chrome, Firefox, Safari). |
| --stealthy-headers / --no-stealthy-headers | None | Use stealthy browser headers (default: True) |
| --ai-targeted | None | Select body content and filter common hidden elements for AI consumption (default: False) |
Options shared between `post` and `put` only:
Large whitespace padding was detected (a block of blank lines or a long run of spaces). This can push injected instructions below or to the right of the visible area so a human reviewer never sees them while the agent still reads them. Manual review of the hidden content is recommended.
The `fetch` command accepts these options:
| Option | Input type | Description |
|:-----------------------------------------|:----------:|:---------------------------------------------------------------------------------------------------------------------------------------------------------|
| --headless / --no-headless | None | Run browser in headless mode (default: True) |
| --disable-resources / --enable-resources | None | Drop unnecessary resources for speed boost (default: False) |
Large whitespace padding was detected (a block of blank lines or a long run of spaces). This can push injected instructions below or to the right of the visible area so a human reviewer never sees them while the agent still reads them. Manual review of the hidden content is recommended.
| Option | Input type | Description |
|:-----------------------------------------|:----------:|:---------------------------------------------------------------------------------------------------------------------------------------------------------|
| --headless / --no-headless | None | Run browser in headless mode (default: True) |
| --disable-resources / --enable-resources | None | Drop unnecessary resources for speed boost (default: False) |
| --pierce-shadow / --no-pierce-shadow | None | Include open Shadow DOM content (default: False). |
| --network-idle / --no-network-idle | None | Wait for network idle (default: False) |
Large whitespace padding was detected (a block of blank lines or a long run of spaces). This can push injected instructions below or to the right of the visible area so a human reviewer never sees them while the agent still reads them. Manual review of the hidden content is recommended.
|:-----------------------------------------|:----------:|:---------------------------------------------------------------------------------------------------------------------------------------------------------|
| --headless / --no-headless | None | Run browser in headless mode (default: True) |
| --disable-resources / --enable-resources | None | Drop unnecessary resources for speed boost (default: False) |
| --pierce-shadow / --no-pierce-shadow | None | Include open Shadow DOM content (default: False). |
| --network-idle / --no-network-idle | None | Wait for network idle (default: False) |
| --real-chrome / --no-real-chrome | None | If you have a Chrome browser installed on your device, enable this, and the Fetcher will launch an instance of your browser and use it. (default: False) |
| --timeout | INTEGER | Timeout in milliseconds (default: 30000) |
Large whitespace padding was detected (a block of blank lines or a long run of spaces). This can push injected instructions below or to the right of the visible area so a human reviewer never sees them while the agent still reads them. Manual review of the hidden content is recommended.
| --headless / --no-headless | None | Run browser in headless mode (default: True) |
| --disable-resources / --enable-resources | None | Drop unnecessary resources for speed boost (default: False) |
| --pierce-shadow / --no-pierce-shadow | None | Include open Shadow DOM content (default: False). |
| --network-idle / --no-network-idle | None | Wait for network idle (default: False) |
| --real-chrome / --no-real-chrome | None | If you have a Chrome browser installed on your device, enable this, and the Fetcher will launch an instance of your browser and use it. (default: False) |
| --timeout | INTEGER | Timeout in milliseconds (default: 30000) |
| --wait | INTEGER | Additional wait time in milliseconds after page load (default: 0) |
Large whitespace padding was detected (a block of blank lines or a long run of spaces). This can push injected instructions below or to the right of the visible area so a human reviewer never sees them while the agent still reads them. Manual review of the hidden content is recommended.
| --pierce-shadow / --no-pierce-shadow | None | Include open Shadow DOM content (default: False). |
| --network-idle / --no-network-idle | None | Wait for network idle (default: False) |
| --real-chrome / --no-real-chrome | None | If you have a Chrome browser installed on your device, enable this, and the Fetcher will launch an instance of your browser and use it. (default: False) |
| --timeout | INTEGER | Timeout in milliseconds (default: 30000) |
| --wait | INTEGER | Additional wait time in milliseconds after page load (default: 0) |
| -s, --css-selector | TEXT | CSS selector to extract specific content from the page. It returns all matches. |
| --wait-selector | TEXT | CSS selector to wait for before proceeding |
Large whitespace padding was detected (a block of blank lines or a long run of spaces). This can push injected instructions below or to the right of the visible area so a human reviewer never sees them while the agent still reads them. Manual review of the hidden content is recommended.
| --timeout | INTEGER | Timeout in milliseconds (default: 30000) |
| --wait | INTEGER | Additional wait time in milliseconds after page load (default: 0) |
| -s, --css-selector | TEXT | CSS selector to extract specific content from the page. It returns all matches. |
| --wait-selector | TEXT | CSS selector to wait for before proceeding |
| --proxy | TEXT | Proxy URL in format "http://username:password@host:port" |
| -H, --extra-headers | TEXT | Extra headers in format "Key: Value" (can be used multiple times) |
| --dns-over-https / --no-dns-over-https | None | Route DNS through Cloudflare's DoH to prevent DNS leaks when using proxies (default: False) |
Large whitespace padding was detected (a block of blank lines or a long run of spaces). This can push injected instructions below or to the right of the visible area so a human reviewer never sees them while the agent still reads them. Manual review of the hidden content is recommended.
| --proxy | TEXT | Proxy URL in format "http://username:password@host:port" |
| -H, --extra-headers | TEXT | Extra headers in format "Key: Value" (can be used multiple times) |
| --dns-over-https / --no-dns-over-https | None | Route DNS through Cloudflare's DoH to prevent DNS leaks when using proxies (default: False) |
| --block-ads / --no-block-ads | None | Block requests to ~3,500 known ad and tracker domains (default: False) |
| --executable-path | TEXT | Path to a custom Chromium-compatible browser executable. Falls back to the SCRAPLING_EXECUTABLE_PATH environment variable when not set. |
| --ai-targeted | None | Select body content and filter common hidden elements for AI consumption (default: False). Also enables ad blocking automatically. |
| --locale | TEXT | Specify user locale. Defaults to the system default locale. |
The documentation recommends enabling development_mode = True, which caches fetched responses to disk for later replay. In a scraping skill that handles arbitrary remote content, this can persist sensitive pages, session-derived content, or regulated data locally if users forget to disable it or do not control the cache location properly.
Press Ctrl+C to pause gracefully - pending requests and seen URLs are saved automatically. Later, when you start the spider again, pass the same `crawldir`, and it will resume from where it stopped.
While iterating on a spider's `parse()` logic, set `development_mode = True` on the spider class to cache responses to disk on the first run and replay them on subsequent runs - so you can re-run the spider as many times as you want without re-hitting the target servers. The cache lives in `.scrapling_cache/{spider.name}/` by default and can be overridden with `development_cache_dir`. Don't ship a spider with this enabled.
For rules-based crawls (follow links matching a regex), use `CrawlSpider` instead of writing the link-extraction loop yourself:
```python
The example explicitly promotes anti-bot bypass capabilities such as stealth browsing, Cloudflare challenge solving, and fingerprinting evasion without any warning about legal, ethical, or authorization requirements. In a scraping-focused skill, this lowers the barrier to misuse against protected sites and encourages network activity designed to evade operator defenses.
Large whitespace padding was detected (a block of blank lines or a long run of spaces). This can push injected instructions below or to the right of the visible area so a human reviewer never sees them while the agent still reads them. Manual review of the hidden content is recommended.
| Feature | Fetcher | StealthyFetcher |
|--------------------|---------------------------------------------------|--------------------------------------------------------------------------------------------|
| Relative speed | 🐇🐇🐇🐇🐇 | 🐇🐇🐇 |
| Stealth | ⭐⭐ | ⭐⭐⭐⭐⭐ |
| Anti-Bot options | ⭐⭐ | ⭐⭐⭐⭐⭐ |
| JavaScript loading | ❌ | ✅ |
Large whitespace padding was detected (a block of blank lines or a long run of spaces). This can push injected instructions below or to the right of the visible area so a human reviewer never sees them while the agent still reads them. Manual review of the hidden content is recommended.
| Feature | Fetcher | StealthyFetcher |
|--------------------|---------------------------------------------------|--------------------------------------------------------------------------------------------|
| Relative speed | 🐇🐇🐇🐇🐇 | 🐇🐇🐇 |
| Stealth | ⭐⭐ | ⭐⭐⭐⭐⭐ |
| Anti-Bot options | ⭐⭐ | ⭐⭐⭐⭐⭐ |
| JavaScript loading | ❌ | ✅ |
Large whitespace padding was detected (a block of blank lines or a long run of spaces). This can push injected instructions below or to the right of the visible area so a human reviewer never sees them while the agent still reads them. Manual review of the hidden content is recommended.
| Feature | Fetcher | StealthyFetcher |
|--------------------|---------------------------------------------------|--------------------------------------------------------------------------------------------|
| Relative speed | 🐇🐇🐇🐇🐇 | 🐇🐇🐇 |
| Stealth | ⭐⭐ | ⭐⭐⭐⭐⭐ |
| Anti-Bot options | ⭐⭐ | ⭐⭐⭐⭐⭐ |
| JavaScript loading | ❌ | ✅ |
Large whitespace padding was detected (a block of blank lines or a long run of spaces). This can push injected instructions below or to the right of the visible area so a human reviewer never sees them while the agent still reads them. Manual review of the hidden content is recommended.
| Feature | Fetcher | StealthyFetcher |
|--------------------|---------------------------------------------------|--------------------------------------------------------------------------------------------|
| Relative speed | 🐇🐇🐇🐇🐇 | 🐇🐇🐇 |
| Stealth | ⭐⭐ | ⭐⭐⭐⭐⭐ |
| Anti-Bot options | ⭐⭐ | ⭐⭐⭐⭐⭐ |
| JavaScript loading | ❌ | ✅ |
Large whitespace padding was detected (a block of blank lines or a long run of spaces). This can push injected instructions below or to the right of the visible area so a human reviewer never sees them while the agent still reads them. Manual review of the hidden content is recommended.
| Feature | Fetcher | StealthyFetcher |
|--------------------|---------------------------------------------------|--------------------------------------------------------------------------------------------|
| Relative speed | 🐇🐇🐇🐇🐇 | 🐇🐇🐇 |
| Stealth | ⭐⭐ | ⭐⭐⭐⭐⭐ |
| Anti-Bot options | ⭐⭐ | ⭐⭐⭐⭐⭐ |
| JavaScript loading | ❌ | ✅ |
| Memory Usage | ⭐ | ⭐⭐⭐ |
Large whitespace padding was detected (a block of blank lines or a long run of spaces). This can push injected instructions below or to the right of the visible area so a human reviewer never sees them while the agent still reads them. Manual review of the hidden content is recommended.
| Feature | Fetcher | StealthyFetcher |
|--------------------|---------------------------------------------------|--------------------------------------------------------------------------------------------|
| Relative speed | 🐇🐇🐇🐇🐇 | 🐇🐇🐇 |
| Stealth | ⭐⭐ | ⭐⭐⭐⭐⭐ |
| Anti-Bot options | ⭐⭐ | ⭐⭐⭐⭐⭐ |
| JavaScript loading | ❌ | ✅ |
| Memory Usage | ⭐ | ⭐⭐⭐ |
Large whitespace padding was detected (a block of blank lines or a long run of spaces). This can push injected instructions below or to the right of the visible area so a human reviewer never sees them while the agent still reads them. Manual review of the hidden content is recommended.
| Feature | Fetcher | StealthyFetcher |
|--------------------|---------------------------------------------------|--------------------------------------------------------------------------------------------|
| Relative speed | 🐇🐇🐇🐇🐇 | 🐇🐇🐇 |
| Stealth | ⭐⭐ | ⭐⭐⭐⭐⭐ |
| Anti-Bot options | ⭐⭐ | ⭐⭐⭐⭐⭐ |
| JavaScript loading | ❌ | ✅ |
| Memory Usage | ⭐ | ⭐⭐⭐ |
Large whitespace padding was detected (a block of blank lines or a long run of spaces). This can push injected instructions below or to the right of the visible area so a human reviewer never sees them while the agent still reads them. Manual review of the hidden content is recommended.
| Feature | Fetcher | StealthyFetcher |
|--------------------|---------------------------------------------------|--------------------------------------------------------------------------------------------|
| Relative speed | 🐇🐇🐇🐇🐇 | 🐇🐇🐇 |
| Stealth | ⭐⭐ | ⭐⭐⭐⭐⭐ |
| Anti-Bot options | ⭐⭐ | ⭐⭐⭐⭐⭐ |
| JavaScript loading | ❌ | ✅ |
| Memory Usage | ⭐ | ⭐⭐⭐ |
No suspicious patterns detected.