About
The Content Crawler skill enables Claude to perform zero-latency markdown extraction from web sources. It is specifically optimized for rapid data retrieval from static pages like technical documentation and blogs, bypassing the overhead of traditional browser automation. By utilizing the @just-every/crawl utility via Bash, it can fetch single pages or spider through sitemaps to generate structured JSON data, making it an essential tool for gathering context and reference material during the development process.
