Context-Inappropriate Capability
Medium
- Confidence
- 89% confidence
- Finding
- The troubleshooting guidance explicitly recommends setting `robots_txt_obey = False` to improve crawl speed, which encourages bypassing site operators' access preferences and can facilitate unauthorized or non-compliant scraping. In the context of a scraping framework that already emphasizes stealth and anti-bot evasion, this materially increases abuse potential rather than serving a purely diagnostic purpose.
