Web Scraping & Data Collection Agent Skills

Automated Document Hunter

Automates the systematic search, retrieval, and organization of primary source documents from free public archives using browser automation.

Biographical Researcher for Music

Conducts deep biographical research to extract humanizing details, quotes, and life trajectories for documentary-style music production.

Financial Research Specialist

Analyzes SEC filings, earnings calls, and market data to extract deep corporate insights and financial narratives.

YouTube Transcript Downloader

Extracts, downloads, and cleans YouTube video transcripts and captions for easy reading and analysis.

Video Transcript & Media Downloader

Downloads videos, extracts high-quality audio, and generates clean, paragraph-style transcripts from YouTube and other media platforms.

MQL5 Article Extractor

Extracts and organizes technical trading articles and documentation from mql5.com for research and training data collection.

AT Protocol Data Ingest

Orchestrates large-scale data acquisition and ingestion from the Bluesky/AT Protocol social graph for downstream analysis.

SearXNG Local Search

Deploys a local, privacy-respecting metasearch engine to aggregate web, package repository, and code results in structured JSON.

Exa Semantic Web Search

Empowers Claude with AI-powered semantic search to find web content, research papers, and code repositories by meaning rather than keywords.

Exa Websets Search

Manages automated web searches, structured data enrichment, and entity-based collection building using the Exa.ai engine.

Exa Get Contents

Extracts structured data and AI-generated summaries from any URL with high token efficiency and live crawling.

Ark Technical Research

Conducts deep technical research by gathering multi-source evidence, analyzing GitHub repositories, and documenting implementation options.

Scraping Data Pipeline

Orchestrates the extraction, validation, and database loading of comprehensive fighter data from UFCStats.com using Scrapy spiders.

Ethical Web Scraping & Data Extraction

Implements ethical, resilient, and legally compliant web scraping strategies to extract high-quality data while avoiding bot detection.

Newsletter Event Source Manager

Adds and configures Instagram accounts and web aggregators to local media event tracking systems.

Newsletter Events Research

Extracts event data from Instagram, Facebook, and web aggregators to power local media newsletters.

Firecrawl Web Scraper

Converts websites into LLM-ready markdown or structured data using the Firecrawl v2 API.

Exa Find Similar

Discovers related web content, articles, and research papers using AI-powered similarity matching via Exa.ai.

Exa Webset Monitor

Automates the periodic search and refresh of Exa.ai websets to keep your data collections continuously updated.

Exa Answer

Generates fact-based answers and structured data from the web using AI-powered search and synthesis.

Exa Deep Research

Conducts complex, multi-step asynchronous research and deep analysis using Exa's AI-driven search engine.

Wayback Machine Checker

Checks the archival status and availability of URLs within the Internet Archive's Wayback Machine.

Deep Research Professional

Conducts comprehensive market intelligence, company analysis, and competitive research using structured methodologies and automated data collection.

Video Downloader

Downloads high-quality videos and audio from YouTube and other platforms for offline access and archival.

Torrent Search & Download

Searches multiple torrent trackers and automates content downloading via magnet links and WebTorrent.

YouTube Video Downloader

Downloads YouTube videos and audio with customizable quality and format settings using yt-dlp integration.

Skillstash Research Assistant

Automates source gathering and note synthesis for the development and validation of Claude Code skills.

AI News Crawler & Summarizer

Crawls global AI news sources to generate deduplicated, Chinese-language summaries in a structured JSON format.

AT Protocol Data Ingest

Extracts and ingests social graph data and content from the AT Protocol and Bluesky into structured formats.

Efficient Web Scraping

Optimizes data extraction from websites and APIs using specialized Python scripts to maximize performance and minimize token consumption.