Web Scraping & Data Collection Agent Skills

DOCX Advanced Patterns

32

Extracts text and structural data from complex Microsoft Word documents containing nested tables, checkboxes, and multi-layered cell layouts.

Gemini Web Search

31

Empowers Claude with real-time internet research capabilities by integrating Gemini's Google Search tool directly into the terminal workflow.

Twitter Data Collector

31

Automates the collection, filtering, and processing of Twitter search results into structured link lists and databases.

GitHub Source Fetcher

31

Extracts clean source code from GitHub file URLs using the GitHub CLI to bypass web scraping noise and HTML clutter.

Browser Content Capture

29

Extracts data from JavaScript-heavy websites, authenticated pages, and complex documentation using advanced browser automation.

Data Sourcing & Provider Optimization

29

Optimizes B2B data enrichment through intelligent provider selection, waterfall logic, and credit-efficient routing.

Local Media Source Manager

29

Lists and manages configured event sources for Instagram accounts and web aggregators used in newsletter generation.

News Extractor

23

Extracts structured content from popular Chinese news platforms and converts it into JSON and Markdown formats.

Web Search

21

Searches the web using Exa AI to provide real-time information retrieval and up-to-date data for AI coding workflows.

Firecrawl Web Scraper

21

Converts entire websites into LLM-ready markdown and structured data with advanced anti-bot bypass and JavaScript rendering.

Web Content Fetcher

21

Extracts clean, markdown-formatted content and metadata from any URL using the Jina Reader API for LLM consumption.

Google Export

20

Downloads and converts public Google Docs, Sheets, and Slides into local formats for direct analysis and integration.

Hacker News Reader

18

Fetches and analyzes real-time stories, comments, and user data from Hacker News using the official API.

Tavily AI Search

18

Integrates the Tavily API to perform live web searches and structured data retrieval for RAG-augmented workflows.

Brave Search

18

Integrates privacy-focused web, image, video, and news search capabilities directly into Claude Code via the Brave Search API.

SerpApi Search & Scraping

18

Accesses real-time search engine results from Google, Bing, and YouTube directly within Claude Code using structured JSON.

Bright Data Web Scraper

18

Extracts structured data from major social media platforms and websites using the Bright Data Web Scraper API.

RSS Feed Fetcher

18

Fetches and parses RSS/Atom feeds to automate news gathering and content monitoring directly within Claude Code.

Supadata Video & Web Extraction

18

Extracts transcripts from social media videos and scrapes websites into LLM-ready markdown format.

ScrapeNinja Web Scraper

18

Bypasses anti-bot protections and extracts structured data from complex websites using high-performance Chrome TLS fingerprinting and JS rendering.

Apify Web Scraping & Automation

18

Automates web data collection and browser tasks using pre-built Actors for popular sites like Amazon, Google, and LinkedIn.

Firecrawl Web Scraper

18

Automates web scraping, site crawling, and structured data extraction from any URL using the Firecrawl API.

BioRxiv Database

16

Searches and retrieves life sciences preprints from the bioRxiv server using keywords, authors, date ranges, and categories.

ClinicalTrials.gov Database

16

Accesses and queries the ClinicalTrials.gov API v2 to retrieve detailed medical study data, recruitment status, and eligibility criteria for clinical research.

Extract Moves From Video

16

Extracts text commands, terminal inputs, and gameplay moves from screen recordings using optimized OCR and image preprocessing techniques.

PubMed Database Connector

16

Facilitates direct access to PubMed literature and the NCBI E-utilities API for advanced biomedical research and data extraction.

Extract Moves from Video

16

Extracts typed commands and sequential text inputs from screen recordings and terminal sessions using optimized OCR workflows.

Financial Document Processor

16

Extracts structured data from financial documents using OCR and text extraction while enforcing rigorous data safety and verification protocols.

USPTO Database Access

16

Accesses official USPTO APIs to perform comprehensive patent and trademark searches, intellectual property analysis, and prosecution history tracking.

Code From Image

16

Extracts and implements code or algorithms from images by utilizing OCR tools, image preprocessing, and systematic verification strategies.