Web Scraping & Data Collection Agent Skills

Web Research Assistant

Orchestrates parallel subagents to perform structured, multi-source web investigations and synthesize findings into comprehensive reports.

Advanced Gemini Web Search

Enhances Claude Code with deep web searching capabilities using Gemini for complex information gathering and synthesis.

Twscrape Twitter Data Collection

Extracts comprehensive data from Twitter/X using GraphQL APIs with robust account rotation and session management.

Competitive Ads Extractor

Extracts and analyzes competitor advertisements from platforms like Facebook and LinkedIn to provide strategic messaging and creative insights.

Fetch Stores

Fetches business listings, store locations, and restaurant details from Google Maps using the Dumpling AI API.

External Research Explorer

Conducts targeted external research for competitive analysis, technical standards, and API documentation to provide actionable project context.

Content Crawler

Extracts high-speed, read-only markdown content from documentation, blogs, and static websites.

DOM Reader & Web Scraper

Extracts fully rendered HTML and dynamic content from JavaScript-heavy websites using headless browser automation.

RSS Feed Fetcher

Fetches and parses RSS feeds from multiple URLs to gather articles for content creation.

YouTube Transcript Extractor

Extracts and cleans transcripts from YouTube videos for quick reading and summarization.

Pattern Radar Adapter Creator

Generates and tests custom data source adapters for the pattern-radar monitoring system.

Article Extractor

Extracts clean, clutter-free content from web articles and blog posts for readable text storage.

Firecrawl Web Scraper

Scrapes websites, searches the web, and extracts structured data from pages using the token-efficient Firecrawl API.

Exa Web Search & Content Extraction

Searches the live web and extracts structured content or code examples using Exa AI's neural search engine.

YouTube Transcript Downloader

Downloads and processes YouTube video transcripts, captions, and subtitles into clean text or VTT formats.

NotebookLM Research Assistant

Queries your Google NotebookLM notebooks directly from Claude Code for source-grounded, citation-backed documentation answers.

Structured Output Fabric

Transforms unstructured text from any source into clean, validated JSON based on specific user-defined fields or schemas.

Video Content Downloader

Downloads high-quality video and audio content from YouTube and other platforms for offline access, editing, and archival.

YouTube Transcript Downloader

Downloads and processes YouTube video transcripts, captions, and subtitles into clean, readable plain text formats.

USPTO Database Connector

Accesses official USPTO APIs to perform comprehensive patent searches, trademark tracking, and patent examination history analysis.

BrightData Scraper

Implements a progressive four-tier scraping strategy to retrieve content from any URL while bypassing bot detection and CAPTCHAs.

News Summary & AI Insight

Automates multi-source news gathering and generates interactive HTML dashboards with on-demand AI deep-dive analysis.

Article Extractor

Extracts clean, distraction-free text content from web articles and blog posts for easy reading and local storage.

Competitive Ads Extractor

Extracts and analyzes competitor advertising strategies from major ad libraries to optimize your own messaging and creative performance.

YouTube Video Downloader

Downloads YouTube videos with customizable resolution, format, and audio extraction options via yt-dlp.

BioRxiv Database Search

Searches and retrieves life sciences preprints from the bioRxiv server with comprehensive metadata and PDF support.

Bright Data Advanced Scraper

Executes a progressive four-tier scraping strategy to reliably extract content from websites while bypassing bot detection and CAPTCHAs.

Competitive Ads Extractor

Extracts and analyzes competitor advertisements from major ad libraries to provide strategic insights into messaging and creative trends.

Competitive Ads Extractor

Extracts and analyzes competitor advertising data from social ad libraries to identify high-performing messaging and creative patterns.

Bright Data Scraper

Automates multi-tier web scraping with an intelligent fallback strategy to bypass bot detection and capture content from any URL.