Web Scraping & Data Collection Agent Skills

Tavily Web Search

Integrates real-time web search and content extraction capabilities into Claude Code using the Tavily API.

Tavily Web Search & Research

Empowers Claude with real-time web search, content extraction, and automated crawling capabilities using the Tavily API.

Firecrawl Web Scraper

Scrapes websites, searches the web, and extracts structured data from pages using the token-efficient Firecrawl API.

Tavily Web Search

Empowers Claude with real-time web search, content extraction, and automated crawling capabilities using the Tavily API.

Web to Markdown

Converts web pages into clean Markdown files for local documentation storage and AI context.

YouTube Transcript Extractor

Extracts subtitles and transcripts from YouTube videos and saves them as local text files with timestamps.

Stepstone Germany Job Scraper

Scrapes and filters job listings from Stepstone Germany with support for direct-employer targeting and real-time data extraction.

LinkedIn Lead Finder

Identifies hiring managers and key decision-makers on LinkedIn to streamline job outreach and lead generation.

Lead Hunting & Recruitment Orchestrator

Automates the end-to-end recruitment pipeline by orchestrating job board scraping and identifying hiring managers on LinkedIn.

Indeed Germany Job Scraper

Automates the extraction of real-time job listings from Indeed Germany with advanced filtering and deep-dive capabilities.

Job Filtering & Lead Deduplication

Filters, deduplicates, and scores job listings to isolate high-quality technical roles from direct employers.

PySpider Task Manager

Automates web scraping task creation and management across social media, e-commerce, and SEO platforms via Feishu API integration.

YouTube Video Downloader

Downloads YouTube videos and audio with customizable quality and format settings using yt-dlp.

Firecrawl Scraper

Automates deep web scraping, PDF parsing, and website crawling using the Firecrawl API to extract structured content.

YouTube Transcript Downloader

Downloads, cleans, and polishes YouTube video transcripts and captions into structured markdown files.

Pattern Radar Configurator

Configures sources, relevance weights, and domain interests for the Pattern Radar discovery tool.

Scrapedo Web Scraper

Automates the extraction of structured data from websites using optimized scraping patterns.

Content Crawler

Extracts high-speed, read-only markdown content from documentation, blogs, and static websites.

Technical Web Research

Conducts comprehensive technical research, compares technologies, and extracts best practices from the web to inform development decisions.

Pattern Radar Adapter Creator

Generates and tests custom data source adapters for the pattern-radar monitoring system.

Advanced Gemini Web Search

Enhances Claude Code with deep web searching capabilities using Gemini for complex information gathering and synthesis.

YouTube Transcript Extractor

Extracts and saves subtitles or transcripts from any YouTube video URL directly to your local workspace.

Competitive Ads Extractor

Extracts and analyzes competitor advertisements from ad libraries to uncover winning messaging, pain points, and creative strategies.

Website Content Extractor

Extracts clean, clutter-free article and blog content from URLs by stripping away ads, navigation, and unnecessary UI elements.

Article Extractor

Extracts clean, clutter-free content from web articles and blog posts for readable text storage.

YouTube Transcript Analyzer

Extracts and analyzes YouTube video transcripts to provide summaries and answer specific questions about video content.

Multi-Agent Research Assistant

Orchestrates parallel research agents across Perplexity, Claude, and Gemini to deliver synthesized, multi-perspective reports with source attribution.

Markdown Web Content Fetcher

Optimizes web content retrieval by converting URLs to clean Markdown to reduce token usage by approximately 80%.

Perplexity AI Research Tools

Conducts cited web research, technical reporting, and complex reasoning by querying Perplexity AI’s advanced Sonar models.

YouTube Live Segment Downloader

Extracts high-quality video segments from YouTube live streams at up to 30x real-time speed.