What is the benefit of returning content in markdown?

Markdown provides a clean, structured, and token-efficient format that allows Claude to better understand the page hierarchy and content without the noise of raw HTML.

Do I need a Bright Data subscription to use this?

The first three tiers use local or built-in tools. Tier 4 requires the Bright Data MCP to be configured, which typically requires a professional scraping service account for the most advanced bot-bypass capabilities.

How does the progressive fallback strategy work?

The skill attempts to fetch content using the simplest method first (WebFetch). If blocked, it escalates to Curl with custom headers, then Browser Automation, and finally the Bright Data MCP for the most difficult targets.

Can this skill scrape sites that require JavaScript?

Yes. Tier 3 of the workflow uses full browser automation (Playwright) to render JavaScript and capture dynamic content that simple HTTP clients cannot see.

Bright Data Progressive Scraper

Name: Bright Data Progressive Scraper
Author: Microck

byMicrock

•

Web Scraping & Data Collection

Retrieves web content through a four-tier progressive fallback strategy to bypass bot detection and access restrictions.

This skill provides a robust framework for extracting web content within Claude Code, implementing a sophisticated four-stage escalation process. It begins with the lightweight WebFetch tool, falling back to customized Curl headers, then full Browser Automation via Playwright, and finally the professional Bright Data MCP for the most challenging sites. This ensures high success rates when dealing with JavaScript-heavy pages, CAPTCHAs, or advanced anti-bot systems, delivering all results in clean markdown format for immediate research or analysis.

Key Features

01Standardized markdown output for seamless integration into AI workflows

02Full JavaScript rendering using Playwright for dynamic web applications

0381 GitHub stars

04Automatic fallback logic from basic fetching to advanced proxy scraping

05Bypasses CAPTCHAs and sophisticated bot detection via Bright Data

06Progressive four-tier escalation strategy for maximum scraping reliability

Use Cases

01Retrieving content from JavaScript-heavy single-page applications (SPAs)

02Bypassing 403 Forbidden errors and bot detection on highly secured domains

03Extracting documentation or research data from protected or restricted websites

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add microck/ordinary-claude-skills brightdata

For use in Claude.ai and ChatGPT

Download Skill