Do I need a Firecrawl account to use this skill?

Yes, you must sign up at firecrawl.dev and provide an API key via the FIRECRAWL_API_KEY environment variable to authenticate requests.

Does this skill handle JavaScript-heavy websites?

Yes, Firecrawl is designed to handle modern, dynamic websites and SPAs, converting them into clean markdown or HTML that is optimized for AI processing.

Is it possible to crawl an entire website at once?

Yes, the Crawl function supports multi-page crawling with configurable depth, page limits, and include/exclude path filters to target specific sections of a site.

Can I extract data into a specific JSON format?

Yes, the Extract feature allows you to provide a JSON schema and a prompt, using AI to map web content directly to your specified structure.

Firecrawl Web Scraper

Name: Firecrawl Web Scraper
Author: vm0-ai

byvm0-ai

•

Web Scraping & Data Collection

Automates web scraping, site crawling, and structured data extraction from any URL using the Firecrawl API.

About

This skill integrates the Firecrawl API into Claude Code, enabling powerful web data collection directly within your terminal. It allows you to convert complex websites into AI-ready markdown, perform deep site-wide crawls, discover hidden URLs, and utilize LLM-powered extraction to turn unstructured web content into clean JSON schemas. It is an essential tool for developers building RAG systems, performing market research, or automating data pipelines where high-quality web data is required.

Key Features

Asynchronous site-wide crawling with depth and path filtering
Single-page scraping to markdown, HTML, or screenshots
Integrated web search with direct content extraction
AI-driven structured data extraction using custom JSON schemas
Rapid URL mapping and discovery across entire domains
18 GitHub stars

Use Cases

Automating lead generation by mapping and searching target domains
Extracting pricing, product specs, or competitor data into structured JSON
Converting documentation websites into markdown for RAG or LLM training

About

Key Features

Asynchronous site-wide crawling with depth and path filtering
Single-page scraping to markdown, HTML, or screenshots
Integrated web search with direct content extraction
AI-driven structured data extraction using custom JSON schemas
Rapid URL mapping and discovery across entire domains
18 GitHub stars

Use Cases

Automating lead generation by mapping and searching target domains
Extracting pricing, product specs, or competitor data into structured JSON
Converting documentation websites into markdown for RAG or LLM training