Can I export the data for other tools?

Absolutely. The skill supports multiple output formats including a plain list of links for manual filtering tools and JSON for database integration.

Can I filter tweets by engagement levels?

Yes, you can use parameters like --min-likes to ensure you only collect high-performing content that meets your engagement threshold.

Does the skill handle deduplication?

Yes, the collector uses a Set-based data structure to automatically remove duplicate tweet IDs during the collection process.

Do I need a Twitter API key to use this skill?

No, this skill uses browser automation via Playwright or Claude's MCP browser tool to collect public search results without requiring an official API key.

What is the difference between MCP mode and Local mode?

MCP mode is fully automated and uses Claude's internal browser, while Local mode runs scripts on your own machine using a Chrome debug port.

Twitter Data Collector

Name: Twitter Data Collector
Author: ttmouse

byttmouse

•

Web Scraping & Data Collection

Automates the collection, filtering, and processing of Twitter search results into structured link lists and databases.

About

The Twitter Data Collector skill streamlines the gathering of social media data by automating search queries, scrolling, and data extraction using Playwright. It is specifically designed for users who need to batch-process Twitter content based on complex parameters like engagement thresholds, specific date ranges, and media filters. By bridging the gap between raw social media activity and structured data, this skill enables researchers and curators to bypass manual searching and move directly to analysis or database entry through either a zero-config MCP mode or local terminal scripts.

Key Features

31 GitHub stars
Automated infinite scrolling and extraction of tweet URLs and metadata
Zero-configuration MCP mode utilizing Claude's built-in browser capabilities
Versatile output support including plain text, JSON, and visual HTML previews
Advanced search filtering by engagement metrics, timeframes, and content type
Built-in deduplication logic and customizable keyword-based scoring

Use Cases

Curating specialized content feeds for specific niche topics or keywords
Building automated data pipelines that feed social signals into local databases or AI models
Batch gathering high-engagement tweets for market research and sentiment analysis

About

Key Features

31 GitHub stars
Automated infinite scrolling and extraction of tweet URLs and metadata
Zero-configuration MCP mode utilizing Claude's built-in browser capabilities
Versatile output support including plain text, JSON, and visual HTML previews
Advanced search filtering by engagement metrics, timeframes, and content type
Built-in deduplication logic and customizable keyword-based scoring

Use Cases

Curating specialized content feeds for specific niche topics or keywords
Building automated data pipelines that feed social signals into local databases or AI models
Batch gathering high-engagement tweets for market research and sentiment analysis