Web Scraping & Data Collection Agent Skills

YouTube Transcript Extractor

Extracts high-quality subtitles and transcripts from YouTube videos in multiple formats and languages for analysis and automation.

Market Research Setup

Configures the essential Brave Search MCP integration and environment settings required for automated market research workflows.

Video Downloader

Automates video and audio downloads from various web platforms with customizable quality and format settings using yt-dlp.

APOD Downloader

Downloads NASA's Astronomy Picture of the Day along with detailed metadata directly to your desktop.

Insight Extractor

Extracts valuable insights and key information from URLs or text documents to streamline information processing.

WeChat Article Fetcher & Research Analyst

Fetches and ranks WeChat articles based on research interests with seamless Obsidian integration.

bioRxiv Database Search

Searches and retrieves life sciences preprints from the bioRxiv database using keywords, authors, and DOIs.

Website Crawler

Maps complex website structures and discovers URLs using a high-performance Go-powered engine with TypeScript integration.

Structured Evidence Collection

Standardizes research by creating traceable YAML evidence objects with semantic IDs and confidence scores to ensure data-driven decision making.

Deep Research Diffusion

Conducts exhaustive, multi-perspective research using parallel agent workers and iterative gap detection.

Structured Web Research

Conducts systematic web investigations by deploying parallel subagents to gather, verify, and synthesize information from multiple sources.

Web Research & Synthesis

Conducts multi-threaded, deep-dive web investigations by orchestrating parallel subagents to gather and synthesize complex information.

Web Research & Synthesis

Conducts structured, multi-threaded web research by delegating sub-tasks to specialized agents and synthesizing findings into comprehensive reports.

Web Search

Performs structured web searches via DuckDuckGo to retrieve real-time documentation, library information, and technical solutions.

YouTube Video Downloader

Downloads YouTube videos and audio with customizable quality, format, and output settings using yt-dlp.

Competitive Ads Extractor

Scrapes and analyzes competitor advertisements from major ad libraries to uncover successful messaging and creative patterns.

Competitive Ads Extractor

Scrapes and analyzes competitor advertisements from major ad libraries to uncover successful messaging, creative patterns, and market positioning.

YouTube Video Downloader

Downloads YouTube videos and audio with customizable quality and format settings directly within Claude Code.

Crawl4AI Web Scraper

Extracts clean markdown and structured data from any website, including JavaScript-heavy single-page applications.

Wikidata Search & Authority Control

Searches the Wikidata knowledge base to retrieve structured entity details and universal external identifiers.

Web Scraper Data Processor

Processes raw web scraping data into clean, formatted Excel reports with automated statistical analysis and deduplication.

Firecrawl Web Scraper

Converts any website into clean, LLM-ready markdown or structured data using the Firecrawl API.

URL Reader Mode to Markdown

Transforms web URLs into clean, distraction-free Markdown files using reader-mode heuristics and automated filename sanitization.

Video Downloader

Downloads high-quality video and audio content from YouTube and other platforms for offline viewing and archival.

YouTube Transcript Downloader

Extracts and cleans transcripts, subtitles, and captions from YouTube videos using yt-dlp and OpenAI Whisper for AI-powered transcription.

Article Extractor

Extracts clean, readable text from URLs by stripping away ads, navigation menus, and web clutter.

Advanced Research Assistant

Conducts exhaustive, discovery-driven research using parallel LLM agents and multi-source synthesis to deliver cited, high-confidence reports.

Daily Competition Scout

Automates the entire end-to-end competition management workflow from discovery and analysis to entry drafting and notification.

Web Search & Summarizer

Performs focused web searches to retrieve and summarize real-time information from authoritative sources.

YouTube Video Downloader

Downloads YouTube videos and audio with customizable quality and format settings using the powerful yt-dlp engine.