Can I capture pages that require a login?

Yes. By using the --wait mode, you can manually log in or navigate the page before signaling the skill to capture the content.

Does this skill work with JavaScript-rendered websites?

Yes, it uses Chrome CDP (Chrome DevTools Protocol) to ensure full rendering of SPAs and dynamic content before converting to Markdown.

Does it preserve page metadata?

Yes, every output file includes YAML front matter containing the source URL, page title, description, author, and capture timestamp.

What are the system requirements for this skill?

The skill requires Bun for execution and a local installation of Chrome or Chromium. You can customize the Chrome path using environment variables if needed.

Where are the converted Markdown files stored?

Files are automatically organized in a 'url-to-markdown' directory, categorized by domain name with slug-based filenames.

URL to Markdown Converter

Name: URL to Markdown Converter
Author: JimLiu

byJimLiu

•

3,229

•

Web Scraping & Data Collection

Converts any live webpage into clean, structured Markdown format using Chrome CDP for full JavaScript rendering.

The baoyu-url-to-markdown skill enables Claude to browse the web with high fidelity, capturing complex pages and converting them into production-ready Markdown. By utilizing the Chrome DevTools Protocol (CDP), it ensures that JavaScript-heavy sites, single-page applications (SPAs), and dynamic content are fully rendered before conversion. It features a unique 'wait mode' for handling pages behind logins or paywalls, allowing users to manually signal when a page is ready for capture. This tool is ideal for developers, researchers, and writers who need to archive web content, documentation, or articles with preserved metadata and clean formatting.

Key Features

01Comprehensive YAML front matter including URL, title, and author metadata

02Customizable Chrome profiles and environment variable support

03Intelligent conflict resolution with timestamped file naming

04Two capture modes: automated on network idle or manual user signal

053,229 GitHub stars

06Full JavaScript rendering via Chrome CDP for dynamic web content

Use Cases

01Automating the collection of web data into a structured local knowledge base

02Saving technical documentation or blog posts for offline reading or AI processing

03Extracting content from password-protected or paywalled sites via interactive wait mode

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add jimliu/baoyu-skills baoyu-url-to-markdown

For use in Claude.ai and ChatGPT

Download Skill