Do I need to manage Python environments manually?

No, the skill uses 'uv' scripts with inline metadata, which automatically handles dependency installation and management every time a script is run.

Is this skill compatible with authenticated APIs?

Yes, it provides implementation patterns for API authentication, including the secure use of environment variables for tokens and keys.

How does this skill help reduce token usage?

Instead of feeding thousands of lines of raw HTML into the AI's context, this skill writes and executes a local Python script that extracts only the necessary data points, returning a tiny, structured JSON object instead.

Can I scrape sites that require JavaScript to load?

Yes, the skill includes a specific pattern for Browser-Required Sites using Playwright, allowing you to scrape dynamic content and single-page applications effectively.

Efficient Web Scraping

Name: Efficient Web Scraping
Author: ClementWalter

byClementWalter

•

Web Scraping & Data Collection

Optimizes data extraction from websites and APIs using specialized Python scripts to maximize performance and minimize token consumption.

Efficient Web Scraping is a specialized Claude Code skill designed to handle complex data extraction tasks without bloating the conversation context. By utilizing programmatic extraction through uv-managed Python scripts, this skill enables Claude to target specific fields and return structured JSON rather than reading thousands of lines of raw HTML. It includes robust patterns for handling static pages, authenticated APIs, and dynamic JavaScript content via Playwright, resulting in up to a 100x reduction in token usage while maintaining high data integrity and reasoning accuracy.

Key Features

01Automated dependency management using uv inline metadata

02Structured JSON output for immediate programmatic use

03Context-aware token optimization for massive data reduction

04Built-in error handling and rate-limiting best practices

05Pre-defined patterns for static, dynamic, and API-based scraping

062 GitHub stars

Use Cases

01Extracting specific profile data and recent activity from social media platforms

02Filtering and processing large API responses to extract only essential data points

03Aggregating product information and pricing from multi-page e-commerce sites

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add clementwalter/rookie-marketplace efficient-scraping

For use in Claude.ai and ChatGPT

Download Skill