Web Scraping & Data Collection MCP Servers

Xiaohongshu Automation

Automate core interactions with Xiaohongshu, including login, content publishing, searching, commenting, and user profile retrieval, via standardized interfaces for AI Agents.

Crawleo

Enables AI assistants to access real-time web data and perform deep content extraction through native tool integration.

Wanyi Watermark

Extracts watermark-free videos and images from Douyin and Xiaohongshu, offering video link parsing and text transcription.

Better Fetch

Intelligently fetches and processes web content, transforming documentation sites and web resources into structured markdown files.

Doc Scraper

Scrapes web-based documentation and converts it into markdown format.

Internetdata

Enables TypeScript projects to retrieve and interact with internet data through a structured API.

Playwright Scraper

Scrapes web content and converts it to Markdown format.

Tavily Search

Integrates Tavily's search API with LLMs to provide intelligent web search capabilities.

DefiLlama

Enables Claude to access and utilize DeFi data from the DefiLlama API.

Reddit Buddy

Connects AI assistants to Reddit for browsing posts, searching content, and analyzing users without complex setup.

Selenium Grid

Enables AI agents to request and manage Selenium browser instances through a secure API.

Puppeteer Linux

Automates web browser interactions on Linux environments using Puppeteer.

Crypto Trending

Tracks and monitors the latest trending tokens on CoinGecko, providing real-time insights into popular cryptocurrencies.

Scrap

Scrape web pages and extract targeted content using CSS selectors through the Model Context Protocol.

Manus

Automates browser interactions through the Model Context Protocol (MCP), enabling integration between large language models and web browsing.

LoL Client

Provides real-time access to League of Legends in-game data through an MCP server.

Sveriges Radio

Access Swedish Radio's open data to retrieve programs, podcasts, live streams, playlists, and news.

Website Scraper

Extracts and converts website content to Markdown format.

Snf

Provides a Model Context Protocol server for web search, Wikipedia lookups, and content extraction from web pages.

Biomart

Interfaces with Biomart databases using the Model Context Protocol (MCP) to provide biological data to Large Language Models.