GitHub Trending Scraper

Scrape GitHub Trending repos into structured JSON. Use when the user asks about GitHub trending, hottest repos, trending repositories, what's popular on GitH...

Scrapes https://github.com/trending and outputs structured JSON.

Quick Start

# All languages, today, top 25
python3 scripts/github_trending.py

# Python repos, this week, top 10
python3 scripts/github_trending.py --language python --since weekly --top 10

# Save to file
python3 scripts/github_trending.py -o /tmp/github-trending.json

Options

Flag	Short	Default	Description
--language	-l	all	Filter by language (python, rust, go, javascript, etc.)
--since	-s	daily	Time range: daily, weekly, monthly
--top	-n	25	Number of repos to return
--output	-o	stdout	Output file path
--compact			Minified JSON output

Output Schema

{
  "source": "github-trending",
  "scraped_at": "ISO-8601",
  "language": "all|python|rust|...",
  "since": "daily|weekly|monthly",
  "count": 25,
  "repos": [
    {
      "rank": 1,
      "owner": "warpdotdev",
      "name": "warp",
      "full_name": "warpdotdev/warp",
      "url": "https://github.com/warpdotdev/warp",
      "description": "Warp is an agentic development environment...",
      "language": "Rust",
      "stars": 46667,
      "forks": 2917,
      "stars_period": 12822,
      "stars_period_label": "today"
    }
  ]
}

Integration with Trending Cards

Pipe output into the existing trending card generator:

python3 scripts/github_trending.py -o /tmp/github-trending.json
python3 ~/.openclaw/workspace/scripts/trending-card-gen.py \
  --input /tmp/github-trending.json \
  --output /tmp/trending-card.html \
  --platform github --theme white --size hd

Notes

• No API key required; scrapes the public GitHub Trending page
• Rate limit: reasonable use only; avoid rapid repeated calls
• Some repos (e.g. sponsors/username) may show 0 stars/forks due to GitHub page structure