Automates web content extraction using a four-tier fallback strategy to bypass bot detection and CAPTCHAs.
This skill provides a robust framework for retrieving web content through a progressive escalation strategy. It starts with lightweight methods like WebFetch and Curl, escalating to full Browser Automation and finally Bright Data's professional scraping infrastructure when facing advanced bot detection or CAPTCHAs. This ensures high success rates for scraping any URL while optimizing for speed and resource efficiency, ultimately delivering clean markdown content ready for analysis or processing within Claude Code.
Key Features
01Built-in support for JavaScript rendering via Playwright
02Advanced bot detection and CAPTCHA bypass via Bright Data MCP
03Automatic fallback logic for failed requests
04Four-tier progressive escalation strategy
05Standardized output in clean Markdown format
0681 GitHub stars
Use Cases
01Extracting content from Single Page Applications (SPAs) requiring JS execution
02Automating high-volume web research where reliability is critical
03Bypassing 403 errors and sophisticated anti-bot measures on protected domains
