Can this skill handle CAPTCHAs?

Yes, by escalating to Tier 4 (Bright Data MCP), the skill leverages specialized infrastructure designed to solve CAPTCHAs and navigate advanced anti-bot measures.

Is JavaScript execution supported?

Yes, Tier 3 uses full browser automation (Playwright) to render dynamic pages that require JavaScript to display their content.

How does the progressive escalation strategy work?

The skill attempts to fetch data using the most efficient method first (WebFetch). If blocked, it automatically escalates through custom Curl headers and Browser Automation, finally using Bright Data's professional proxy network if necessary.

What format is the scraped content returned in?

Regardless of the tier used for scraping, the skill processes the HTML and returns clean Markdown to Claude, ensuring the content is easy for the AI to analyze.

Bright Data Progressive Scraper

Name: Bright Data Progressive Scraper
Author: Microck

byMicrock

•

Web Scraping & Data Collection

Implements a four-tier progressive scraping strategy to bypass bot detection and reliably extract web content.

The Bright Data skill provides a robust framework for retrieving web content within Claude Code using an automated escalation workflow. It intelligently navigates through four levels of scraping—from simple WebFetch to advanced Bright Data MCP integration—ensuring that even websites with CAPTCHAs, heavy JavaScript, or strict bot detection can be successfully converted into clean Markdown for research and analysis.

Key Features

01Chrome-like header emulation to prevent 403 Access Denied errors

02Bypasses advanced bot detection and CAPTCHAs via Bright Data

03Converts complex HTML pages into clean, structured Markdown

04Automatic four-tier fallback strategy for maximum reliability

0581 GitHub stars

06Full JavaScript rendering using Playwright browser automation

Use Cases

01Extracting data from dynamic, JavaScript-heavy single-page applications

02Scraping content from protected sites that block standard AI crawlers

03Automating high-volume web data collection for research or coding projects

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add microck/ordinary-claude-skills brightdata

For use in Claude.ai and ChatGPT

Download Skill