Web Scraping & Data Collection MCP Servers

ArXiv Humanity

Empowers AI assistants to deeply read, analyze, and synthesize scientific breakthroughs from ArXiv in real-time.

PuchAI Hackathon

Renders various data plots, scrapes Reddit for market insights, retrieves medicine information, and provides persistent memory for user preferences and tasks.

News Instagram

Automates the intelligent scraping, AI-processing, and publishing of Canadian news into engaging Instagram content.

URL Text Fetcher

Enables LM Studio to fetch web page text and links directly from URLs.

PullPush

Enables AI assistants to search historical Reddit comments and submissions through the PullPush.io API.

Scrapy

Scrapes websites, from basic HTTP requests to dynamic sites requiring JavaScript execution, using TypeScript.

LinkedIn Profile Scraper

Scrapes LinkedIn profile data asynchronously using the RapidAPI LinkedIn Profile Scraper API.

AI Makerspace Session 13

Provides a foundational Model Context Protocol server, integrating the Tavily API for advanced web search capabilities.

Model Context Protocol

Integrates AI applications with external data sources and tools through a standardized open protocol.

V2.ai Insights

Scrapes and indexes blog content from V2.ai Insights and Contentful, offering full-text search and AI-powered summarization.

News

Aggregates and delivers real-time news feeds from major Singapore news sources.

SearxNG

Facilitates web searching through SearxNG via a command-line interface and a Model Context Protocol server.

Myongji University Notices

Provides real-time access to the latest notices from Myongji University's official website for AI agents.

Taiwan Weather

Retrieves real-time weather reports, forecasts, and satellite images from Taiwan's Central Weather Administration for agentic AI applications.

WebNexus

Enables intelligent document discovery and semantic search through powerful web crawling and a local Retrieval-Augmented Generation system.

Tor Search

Empowers large language models with anonymous web search and content retrieval capabilities through the Tor network.

Perplexity Web Search

Integrates Perplexity's Sonar API to equip AI assistants with real-time web and academic research capabilities.

AI News Agent

Aggregates, summarizes, and displays the latest AI-related news articles in a visually appealing and user-friendly web application.

Research Assistant

Offers extensive tools, resources, and prompts by integrating Google Custom Search and Wikipedia functionality for advanced research and information retrieval.

Crawl4AI

Wraps the Crawl4AI library with a Model Context Protocol (MCP) server, providing crawling functionality via Python functions.