Web Scraping & Data Collection Agent Skills

Competitive Ads Extractor

Extracts and analyzes competitor advertisements from major ad libraries to provide strategic insights into messaging and creative trends.

Technical Web Research

Conducts comprehensive technical research, compares technologies, and extracts best practices from the web to inform development decisions.

IPO Tracker & TradingView Watchlist Generator

Tracks recent Initial Public Offerings and generates ready-to-import TradingView watchlists with enriched market data.

Competitive Ads Extractor

Extracts and analyzes competitor advertising strategies from major ad libraries to optimize your own messaging and creative performance.

Web Scraper Quality Assurance

Enforces a rigorous, test-driven development workflow for building and maintaining web scrapers and data extraction agents.

Weather Data Fetcher

Retrieves real-time temperature data from the wttr.in API for specific geographic locations.

XLSForm Designer

Simplifies the creation of standardized data collection forms in Excel for mobile survey platforms like ODK and KoBoToolbox.

Web Search

Retrieves real-time information, news, images, and videos from the web using DuckDuckGo to provide up-to-date data and resources.

Video Subtitle Extractor

Extracts and cleans transcripts from global video platforms like YouTube and Bilibili into readable text files.

Unified Research

Aggregates data from multiple search APIs like Tavily, SerpAPI, and Perplexity to provide comprehensive, fact-based research summaries.

LinkedIn Resume & Job Optimizer

Automates LinkedIn job searching and generates ATS-optimized resumes with integrated skill gap analysis and interview preparation.

Video Downloader

Downloads videos and audio from YouTube and other platforms for offline viewing, archiving, and media editing.

Video Downloader

Downloads high-quality videos and audio from YouTube and other platforms for offline access, archival, and content repurposing.

Video Downloader

Automates video and audio downloads from YouTube and other platforms with customizable quality and format options.

Article Extractor

Extracts clean, readable text from web articles and blog posts by removing ads, navigation, and clutter.

Structured Web Research

Orchestrates parallel subagents to conduct systematic, well-documented web research and synthesize findings into comprehensive reports.

Firecrawl Real Estate Scraper

Extracts structured property data from real estate listing URLs using Firecrawl AI for market analysis and content creation.

JRA-VAN Keiba Data Pipeline

Automates the retrieval of JRA-VAN horse racing data and facilitates seamless loading into PostgreSQL databases.

Web Research Agent

Executes multi-perspective web searches and generates structured research reports with source attribution and uncertainty analysis.

Web Research & Synthesis

Conducts structured, multi-threaded web research by spawning specialized subagents to gather and synthesize information.

RuTracker Torrent Manager

Automates searching, filtering, and downloading torrents from RuTracker using Playwright and aria2c.

Markdown URL Extractor

Converts web URLs into clean, raw markdown to minimize context window usage and eliminate HTML noise.

Web Research Pro

Verifies technical requirements and gathers real-time information through structured web searches and documentation analysis.

YouTube Video Downloader

Downloads YouTube videos and audio with customizable quality and format settings directly through the terminal.

Gemini Web Search

Enhances Claude with advanced web search capabilities using Gemini to retrieve and synthesize real-time information from the internet.

RSS Feed Operations

Reads and processes RSS/Atom feeds from any blog URL with intelligent automatic feed discovery.

Industry Research

Conducts comprehensive market analysis and trend forecasting across the consumer, technology, healthcare, and finance sectors.

Playbooks Fetch

Converts any URL into clean, structured Markdown with YAML metadata for efficient content consumption and LLM processing.

Persistent Sector Caching

Optimizes yfinance data retrieval by implementing a permanent SQLite caching layer to bypass API rate limits and 401 errors.

Firecrawl Scraper

Extracts clean, structured data from any website using the powerful Firecrawl API for deep web crawling and scraping.