Web Scraping & Data Collection Agent Skills

Web Research & Synthesis

Conducts structured, multi-threaded web research by spawning specialized subagents to gather and synthesize information.

Structured Web Research

Orchestrates parallel subagents to conduct systematic, well-documented web research and synthesize findings into comprehensive reports.

Video Downloader

Automates video and audio downloads from YouTube and other platforms with customizable quality and format options.

Video Downloader

Downloads high-quality videos and audio from YouTube and other platforms for offline access, archival, and content repurposing.

Video Downloader

Downloads videos and audio from YouTube and other platforms for offline viewing, archiving, and media editing.

LinkedIn Resume & Job Optimizer

Automates LinkedIn job searching and generates ATS-optimized resumes with integrated skill gap analysis and interview preparation.

YouTube Video Downloader

Downloads YouTube videos and audio with customizable quality and format settings directly within Claude Code.

XLSForm Designer

Simplifies the creation of standardized data collection forms in Excel for mobile survey platforms like ODK and KoBoToolbox.

Wikidata Search & Authority Control

Searches the Wikidata knowledge base to retrieve structured entity details and universal external identifiers.

Web Scraper Data Processor

Processes raw web scraping data into clean, formatted Excel reports with automated statistical analysis and deduplication.

URL Reader Mode to Markdown

Transforms web URLs into clean, distraction-free Markdown files using reader-mode heuristics and automated filename sanitization.

Video Downloader

Downloads high-quality video and audio content from YouTube and other platforms for offline viewing and archival.

Video Subtitle Extractor

Extracts and cleans transcripts from global video platforms like YouTube and Bilibili into readable text files.

Article Extractor

Extracts clean, readable text from URLs by stripping away ads, navigation menus, and web clutter.

Web Scraper Quality Assurance

Enforces a rigorous, test-driven development workflow for building and maintaining web scrapers and data extraction agents.

Advanced Research Assistant

Conducts exhaustive, discovery-driven research using parallel LLM agents and multi-source synthesis to deliver cited, high-confidence reports.

Daily Competition Scout

Automates the entire end-to-end competition management workflow from discovery and analysis to entry drafting and notification.

Web Search & Summarizer

Performs focused web searches to retrieve and summarize real-time information from authoritative sources.

Web Content Fetcher

Scrapes web pages and WeChat articles to produce clean, noise-free Markdown content for processing, translation, or archival.

XML Element Extractor

Isolates specific XML elements from large source files while maintaining structural integrity and formatting.

Twitter Thread Extractor

Extracts and converts Twitter/X threads into clean, well-formatted markdown files using automated browser interaction.

CASS Freight Inflation Detector

Monitors the CASS Freight Index to identify economic cycle turns and predict US inflation trends through logistics data analysis.

Genome Assembly Dataset Curator

Automates the end-to-end processing and metadata curation of genome assembly datasets for VEuPathDB resources.

Web Researcher

Conducts deep, multi-source web research and synthesis without cluttering the primary conversation context.

Gemini Web Search

Performs advanced web searches using Gemini to retrieve real-time, high-relevance information for complex technical queries.

YouTube Transcript Downloader

Downloads and processes YouTube video transcripts in bulk from CSV files or individual URLs into structured Markdown format.

API Scraper Architect

Provides standardized architectural patterns and Pydantic models for building robust API documentation scrapers.

Automated Video Parser & Downloader

Automates video metadata extraction and file downloading by processing task lists through MCP services.

WebMind DOM Analyzer MCP

Integrates the WebMind MCP server into Claude Code to provide advanced DOM analysis and specialized Ragic assistant capabilities.

Blog Profile Analyzer

Analyzes blogs and online publications to extract deep insights into author perspectives, political leanings, and hidden biases.