Can I retrieve raw HTML source code?

Yes, the skill includes an option to return the full original HTML instead of just the extracted text.

What is the Scrape.do Web Scraper skill?

It is a specialized capability for Claude Code that uses the Scrape.do API to fetch web content from sites that block standard scrapers or require JavaScript rendering.

Do I need a Scrape.do account to use this skill?

Yes, you must have a Scrape.do API token configured to use this skill successfully.

How does the skill handle scraping errors?

It returns clear, descriptive error messages if the API token is missing, limits are reached, or the target site is completely inaccessible.

Why use this instead of a standard fetch command?

Standard fetch methods often fail on sites with anti-bot protections or those that load content via JavaScript; this skill handles those complexities automatically.

Scrape.do Web Scraper

Name: Scrape.do Web Scraper
Author: artwist-polyakov

byartwist-polyakov

•

Web Scraping & Data Collection

Extracts content from websites using the Scrape.do API to bypass anti-bot protections and render dynamic JavaScript.

The Scrape.do Web Scraper skill empowers Claude to access and extract data from websites that are typically inaccessible due to sophisticated blocking mechanisms or client-side rendering. By utilizing the Scrape.do proxy API, this skill allows for reliable data collection from protected URLs, offering options to retrieve either cleaned text or raw HTML. It is particularly useful for developers and researchers who need to gather information from modern, dynamic web applications where standard fetching methods fail.

Key Features

01Renders JavaScript-heavy dynamic websites automatically

02Provides both raw HTML and cleaned text output modes

03Bypass anti-bot protections and Cloudflare challenges

04Simplified command-line interface for rapid scraping

051 GitHub stars

06Detailed error reporting for API limits and site availability

Use Cases

01Gathering content from Single Page Applications (SPAs) and React-based sites

02Extracting data from websites with strict IP blocking or scraping protections

03Automating data collection from sites requiring proxy rotation

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add artwist-polyakov/polyakov-claude-skills scrapedo-web-scraper

For use in Claude.ai and ChatGPT

Download Skill