ScrapingBee Fetch

Advanced JavaScript web page renderer using ScrapingBee API. Extracts main content and returns clean Markdown.

Use this skill to render JavaScript on target websites and extract the main content. It returns clean Markdown optimized for LLM reading.

Setup

You need a ScrapingBee API key to use this skill. Set it as an environment variable:

export SCRAPINGBEE_API_KEY="your_api_key_here"

Or add it to a .env file in the directory where you run the script.

Usage

uv run fetch.py --url "https://example.com"

Optional Parameters

• --no-render-js: Disable JavaScript rendering (faster, but might miss dynamic content).
• --country-code <code>: Use a proxy from a specific country (e.g., us, uk, ru).
• --wait <milliseconds>: Wait time in milliseconds before extracting content (default: 3000).
• --no-block-ads: Disable ad blocking (ads are blocked by default to save bandwidth and speed up rendering).
• --premium-proxy: Use a premium proxy (useful for highly protected websites).

Examples

Fetch a website using a US proxy and wait 5 seconds:

uv run fetch.py --url "https://example.com" --country-code us --wait 5000

Fetch a highly protected website using a premium proxy:

uv run fetch.py --url "https://example.com" --premium-proxy

Fetch a simple website without rendering JavaScript:

uv run fetch.py --url "https://example.com" --no-render-js