Retrieves web content as Markdown and saves it to a local file.
Sponsored
Fetch-Save empowers LLMs to retrieve content from web pages, convert HTML to Markdown for simplified consumption, and persistently store the retrieved content in a local file. Unlike standard fetch servers, this tool offers a 'fetch-save' function, enabling both content retrieval and local storage for future access or processing.
Key Features
01Option to ignore robots.txt
02Saves fetched content to a local file
03Supports configuration for proxy and user-agent
04Fetches content from URLs
050 GitHub stars
06Converts HTML to Markdown
Use Cases
01Creating a local archive of web content for offline access
02Preparing web content for ingestion into LLMs
03Automating the process of web scraping and saving data
