{"skill":{"slug":"apify-substack-scraper","displayName":"Apify Substack Scraper","summary":"Scrape Substack newsletters and articles. Use when user asks to search Substack, find newsletter posts, extract Substack content, or monitor Substack publica...","description":"---\nname: apify-substack-scraper\ndescription: Scrape Substack newsletters and articles. Use when user asks to search Substack, find newsletter posts, extract Substack content, or monitor Substack publications. Requires APIFY_TOKEN environment variable.\nmetadata: {\"openclaw\":{\"emoji\":\"📰\",\"requires\":{\"env\":[\"APIFY_TOKEN\"],\"bins\":[\"curl\",\"jq\"]},\"primaryEnv\":\"APIFY_TOKEN\"}}\n---\n\n# Substack Scraper\n\nScrape Substack newsletters using an Apify Actor via the REST API.\n\n## Actor ID\n`BULaGFURBV7WG3K81`\n\n## Prerequisites\n- `APIFY_TOKEN` environment variable must be set\n- `curl` and `jq` must be available\n\n## Workflow\n\n### Step 1: Confirm parameters with user\nAsk what they want to scrape. Supported input fields:\n- `urls` (array of strings) - Substack publication URLs to scrape\n- `maxArticles` (integer) - max articles per publication\n- `includeContent` (boolean) - include full article text\n\n### Step 2: Run the Actor\n```bash\nRESULT=$(curl -s -X POST \"https://api.apify.com/v2/acts/BULaGFURBV7WG3K81/run-sync-get-dataset-items?token=$APIFY_TOKEN\" \\\n  -H \"Content-Type: application/json\" \\\n  -d '{\"urls\": [\"https://example.substack.com\"], \"maxArticles\": 20}')\necho \"$RESULT\" | jq '.'\n```\n\n### Step 3: Poll and fetch (if async)\n```bash\nRUN_ID=$(curl -s -X POST \"https://api.apify.com/v2/acts/BULaGFURBV7WG3K81/runs?token=$APIFY_TOKEN\" \\\n  -H \"Content-Type: application/json\" \\\n  -d '{\"urls\": [\"https://example.substack.com\"], \"maxArticles\": 100}' | jq -r '.data.id')\ncurl -s \"https://api.apify.com/v2/actor-runs/$RUN_ID?token=$APIFY_TOKEN\" | jq -r '.data.status'\ncurl -s \"https://api.apify.com/v2/actor-runs/$RUN_ID/dataset/items?token=$APIFY_TOKEN\" | jq '.'\n```\n\n### Step 4: Present results\nSummarize articles: titles, authors, dates, engagement. Offer JSON/CSV export.\n\n## Error Handling\n- If APIFY_TOKEN not set: `export APIFY_TOKEN=your_token`\n- If run FAILS: check log endpoint\n","tags":{"apify":"1.0.0","latest":"1.0.0","newsletter":"1.0.0","scraping":"1.0.0","substack":"1.0.0"},"stats":{"comments":0,"downloads":559,"installsAllTime":1,"installsCurrent":1,"stars":0,"versions":1},"createdAt":1772873163450,"updatedAt":1778491761092},"latestVersion":{"version":"1.0.0","createdAt":1772873163450,"changelog":"Initial release - scrape Substack newsletters","license":null},"metadata":{"setup":[{"key":"APIFY_TOKEN","required":true}],"os":null,"systems":null},"owner":{"handle":"marcindudekdev","userId":"s175vzm8t5k5914xmjc2e3y2ed83fmy3","displayName":"Marcin Dudek","image":"https://avatars.githubusercontent.com/u/109857699?v=4"},"moderation":null}