Web Scraping & Data Collection MCP Servers

YouTube Transcript

Extracts transcripts from YouTube videos, enabling content analysis and processing.

Chrome Extension Bridge

Enables interaction between web pages and a local server by establishing a WebSocket connection, allowing access to browser APIs and DOM elements.

Rod

Automates browser interactions and provides web interaction capabilities for applications using the Rod browser automation framework.

Manus

Enables web browsing, search queries, and code execution capabilities for language models.

Kaggle

Enables interaction with the Kaggle API for dataset discovery, download, and EDA notebook generation.

Browser Agent

Enables Claude Desktop to autonomously interact with web content through browser automation.

SearXNG Enhanced

Enhances SearXNG with category-aware web search, website scraping, and date/time retrieval.

BuiltWith

Identifies the technology stack behind any website, enabling AI assistants to provide detailed information about frameworks, analytics tools, and hosting services.

V0 Capture

Captures and analyzes network responses from v0.dev, including streamed AI responses, for debugging and analysis.

DuckDuckGo Search

Enables web search and content extraction using DuckDuckGo within Model Context Protocol (MCP) environments.

SearXNG Scraper

Scrapes and parses results from public SearXNG instances into a JSON format.

Browserai

Enables AI agents and applications to access and extract real-time web data.

OpenAlex Author Disambiguation

Enables author disambiguation and institution resolution through the OpenAlex.org API.

WeChat Official Accounts Scraper

Crawls and analyzes articles from WeChat Official Accounts, integrating AI agents with a Selenium-based scraping engine.

PTT

Enables MCP clients to interact with and automate operations on PTT, a popular Taiwanese bulletin board system, via the Model Context Protocol.

Prediction Market

Aggregates real-time data from various prediction market platforms.

Supadata

Extracts video transcripts from popular platforms and performs comprehensive web scraping, crawling, and URL discovery.

Crawl4AI+SearXNG

Provides AI agents and coding assistants with complete web search, crawling, and RAG capabilities through a self-contained Docker solution integrating Crawl4AI, SearXNG, and Supabase.

Minimax Search

Enables web search and intelligent browsing through an MCP server, integrating powerful LLM capabilities for content understanding.

PolyMCP

Simplify the creation, exposure, and orchestration of tools using the Model Context Protocol (MCP) with intelligent agents.