In what format is the scraped content returned?

All extracted web content is processed and returned in clean, structured Markdown format, making it easy for Claude to analyze or use in development tasks.

Can this skill bypass CAPTCHAs?

Yes, the fourth tier utilizes the Bright Data MCP, which is specifically designed to handle CAPTCHAs and sophisticated anti-scraping technologies that block standard tools.

Do I need to configure anything to use this skill?

No configuration is required. The skill is designed to work out-of-the-box with Claude Code's existing toolset, automatically selecting the best method for each target site.

What is the four-tier scraping strategy?

It is a progressive escalation process that starts with simple WebFetch, moves to Curl with custom headers, escalates to Browser Automation for JavaScript, and finally uses Bright Data MCP for advanced bot protection.

Bright Data Web Scraper

Name: Bright Data Web Scraper
Author: Microck

byMicrock

•

110

•

Web Scraping & Data Collection

Implements a four-tier progressive fallback strategy to reliably extract web content from any URL, regardless of bot detection or JavaScript requirements.

This skill empowers Claude to navigate complex web access challenges by automatically escalating through four distinct scraping methods: simple fetching, custom curl requests, full browser automation, and the professional Bright Data MCP. It ensures high-quality markdown content extraction from standard websites, JavaScript-heavy applications, and sites protected by advanced anti-bot measures or CAPTCHAs, providing a seamless data retrieval experience for research, documentation, and analysis.

Key Features

01Converts complex web pages into clean, structured Markdown

02Automatic four-tier fallback strategy for maximum reliability

03110 GitHub stars

04Intelligent escalation minimizes resource usage and latency

05Bypasses advanced bot detection and CAPTCHA restrictions

06Supports JavaScript rendering via Playwright browser automation

Use Cases

01Scraping content from dynamic, JavaScript-heavy single-page applications

02Extracting data from sites that block standard crawlers or headless browsers

03Automating research tasks that require reliable access to diverse web sources

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add microck/ordinary-claude-skills brightdata

For use in Claude.ai and ChatGPT

Download Skill