Web Scraping & Data Collection Agent Skills

Exa Semantic Search

Performs neural, semantic web searches and content discovery using the Exa API to find highly relevant data and research.

Tavily Web Search

Empowers Claude to perform advanced web searches, crawl websites, and extract high-quality content using the Tavily AI search engine.

Playwright Web Scraper

Extracts structured data from complex websites using a robust, three-phase Playwright automation workflow.

Job Description Parser

Extracts structured requirements and metadata from job descriptions to facilitate automated candidate matching and recruitment analysis.

Tavily Web Search & Research

Integrates high-performance web search, content extraction, and site crawling capabilities using the Tavily API for real-time information retrieval.

Twitter Data Extraction (twscrape)

Extracts Twitter/X data using the GraphQL API with automated account rotation and session management.

Z.AI Intelligence CLI

Integrates advanced vision analysis, real-time web search, and GitHub exploration tools directly into the Claude Code environment.

Crypto News Aggregator

Aggregates and filters real-time cryptocurrency news from over 50 authoritative sources with automated relevance scoring.

Exa SDK Installation & Authentication

Configures Exa SDKs and handles API authentication for AI-powered search and data retrieval.

Firecrawl Architecture Variants

Architects scalable Firecrawl integrations using validated monolith, service layer, and microservice patterns.

FireCrawl Cost Optimization

Optimizes FireCrawl API expenses through intelligent tier selection, usage monitoring, and request efficiency strategies.

Exa Core Secondary Workflow

Executes secondary search and data retrieval workflows using the Exa API to complement primary AI-driven discovery tasks.

FireCrawl Core Workflow

Executes the primary FireCrawl workflow to transform web content into structured data for AI applications.

FireCrawl Performance Tuning

Optimizes FireCrawl API integrations using advanced caching, request batching, and connection pooling strategies.

FireCrawl Installation and Authentication

Installs and configures the FireCrawl SDK and CLI with secure API authentication for web scraping workflows.

FireCrawl Reliability Patterns

Implements robust error handling and fault-tolerance patterns for stable FireCrawl web scraping integrations.

Exa API Troubleshooting

Diagnoses and resolves common Exa API errors and integration issues to ensure reliable AI search functionality.

FireCrawl Reference Architecture

Implements production-ready architectural patterns and structured project layouts for FireCrawl web scraping integrations.

FireCrawl Secondary Workflow B

Executes optimized secondary FireCrawl data extraction tasks to complement primary web scraping workflows.

FireCrawl Rate Limit Handler

Implements resilient FireCrawl API interactions using exponential backoff, jitter, and idempotency patterns.

FireCrawl Pitfall Guard

Audits and optimizes FireCrawl implementations by identifying common anti-patterns and security vulnerabilities.

FireCrawl Quick Start

Bootstraps a minimal FireCrawl integration to verify API connectivity and client initialization.

FireCrawl SDK Upgrade & Migration

Streamlines FireCrawl SDK upgrades by identifying breaking changes and automating version migrations across your codebase.

PySpider Development Toolkit

Streamlines the creation of production-ready PySpider web crawlers using standardized templates, advanced scraping patterns, and enterprise-grade best practices.

Webpage Summarizer & Markdown Generator

Extracts web content from static and dynamic sites and transforms it into structured, high-quality Markdown documentation.

FireCrawl Webhooks & Events

Secures and processes FireCrawl webhook notifications with robust signature validation and automated event routing.

FireCrawl SDK Patterns

Implements production-ready architectural patterns and best practices for FireCrawl SDK integrations in TypeScript and Python.

Jina AI MCP Reader

Installs and configures the Jina AI MCP server to enable high-quality web scraping and URL content extraction within Claude Code.

RFP Data Ingestion Engine

Automates the collection, normalization, and deduplication of Request for Proposal (RFP) opportunities from government and private data sources.

YouTube Video Downloader

Downloads YouTube videos and audio with customizable quality and format settings directly through the command line.