Does this skill support websites with heavy JavaScript?

Yes, it uses Puppeteer to render pages in a headless browser, ensuring dynamic content is captured accurately before conversion.

How do I handle sites that require a login?

You can use the --interactive flag, which pauses the process and opens a browser window for you to complete manual logins or human checks.

Can I convert multiple URLs at once?

Yes, the skill can process a list of URLs and save the results into a specified directory using automated naming conventions.

What local dependencies are required?

This skill requires the web2md CLI tool and a Chromium-based browser (Chrome, Brave, or Edge) installed on your local machine.

Web to Markdown Converter

Name: Web to Markdown Converter
Author: softaworks

bysoftaworks

•

347

Web Scraping & Data Collection

Transforms web pages into clean, readable Markdown files optimized for AI ingestion and local documentation.

About

The web-to-markdown skill enables Claude to extract structured content from any URL, including JavaScript-heavy sites, by utilizing a local browser environment. It leverages Puppeteer and Readability to strip away clutter like ads and navigation, producing high-quality Markdown that is perfect for feeding into LLMs, creating local documentation libraries, or archiving web content for development workflows. With support for interactive modes and custom wait conditions, it can even handle complex pages that require login or specific user interactions.

Key Features

347 GitHub stars
Renders JavaScript-heavy pages using Puppeteer and Chromium.
Interactive mode for bypassing human checks, captchas, or login walls.
Customizable rendering controls including CSS selectors and wait-until conditions.
Batch processing capabilities for converting multiple URLs simultaneously.
Extracts primary content using Readability to remove headers, footers, and ads.

Use Cases

Converting online technical documentation into local Markdown files for offline reference.
Scraping blog posts or research articles to provide context for AI-driven coding tasks.
Capturing content from dynamic web applications that require full browser execution.

About

Key Features

347 GitHub stars
Renders JavaScript-heavy pages using Puppeteer and Chromium.
Interactive mode for bypassing human checks, captchas, or login walls.
Customizable rendering controls including CSS selectors and wait-until conditions.
Batch processing capabilities for converting multiple URLs simultaneously.
Extracts primary content using Readability to remove headers, footers, and ads.

Use Cases

Converting online technical documentation into local Markdown files for offline reference.
Scraping blog posts or research articles to provide context for AI-driven coding tasks.
Capturing content from dynamic web applications that require full browser execution.