What makes this scraper pattern more resilient than standard scripts?

It utilizes a 4-tier fallback hierarchy—ranging from primary semantic locators to text-based regex patterns—ensuring the scraper continues to work even if the site's internal CSS structure changes.

Does this skill help with dynamic or JavaScript-heavy websites?

Yes, it includes best practices for Playwright navigation, wait states (domcontentloaded vs networkidle), and handling asynchronous loading indicators.

Why does the skill emphasize innerText over textContent?

InnerText only captures visible text as a human would see it, whereas textContent includes hidden scripts and CSS, often leading to messy data and broken regex matches.

How does this integrate with Claude Code's debugging features?

The skill provides patterns for logging which selectors were successfully used and suggests using Chrome DevTools MCP for live page inspection during the development process.

Playwright Web Scraper

Name: Playwright Web Scraper
Author: nathanvale

bynathanvale

•

Web Scraping & Data Collection

Implements production-proven Playwright web scraping patterns with a selector-first approach and robust error handling.

The Playwright Web Scraper skill equips Claude with specialized knowledge for building resilient, production-grade web scrapers and browser automation scripts. It prioritizes semantic locators over brittle CSS selectors and implements a sophisticated 4-tier fallback hierarchy to ensure data extraction remains stable even when website layouts change. By focusing on the critical differences between textContent and innerText and providing robust regex patterns for complex HTML, this skill helps developers create maintainable automation tools that thrive in dynamic web environments.

Key Features

014-tier fallback hierarchy for highly resilient data extraction

02Advanced regex patterns designed for multi-line HTML text extraction

03Selector-first approach using semantic locators and ARIA roles

04Integrated visual debugging and selector tracking patterns

051 GitHub stars

06Clean separation of concerns for scalable scraper client architecture

Use Cases

01Creating stable E2E browser tests that withstand minor UI updates

02Developing ADHD-friendly hyperfocused scrapers with clear error reporting

03Building automated data extraction pipelines for e-commerce or news sites

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add nathanvale/side-quest-marketplace playwright-scraper

For use in Claude.ai and ChatGPT

Download Skill