Provides comprehensive Reddit thread content, including full comment trees, optimized for Large Language Models with significant token reduction.
Sponsored
Reddit Lurker is a powerful tool designed to transform Reddit content for Large Language Models (LLMs). It goes beyond typical Reddit readers by recursively expanding every collapsed branch and resolving all '+N more replies' placeholders to reconstruct complete comment trees. Before presenting content to your model, it preprocesses the data by stripping unused fields and compressing it into a compact, tab-delimited notation. This process significantly reduces token count—up to 94% fewer tokens than raw JSON and 44% fewer than Markdown—making long Reddit discussions economical for LLMs to consume. It also features smart comment limiting for large threads, adaptive caching, multi-subreddit search, and optional OAuth support for higher rate limits, all delivered as a single, dependency-free Go binary.
Key Features
01Full, expanded Reddit comment trees at any depth
021 GitHub stars
03Multi-subreddit search with parallel fetching and deduplication
04Adaptive caching for efficient data retrieval
05Up to 94% token reduction for LLM context
06Smart comment limiting with preview for large threads
Use Cases
01Reading complete Reddit threads with all replies for LLM analysis.
02Browsing trending content and posts across multiple subreddits.
03Searching for specific topics or user activity within Reddit communities for research.