Does this skill require specific setup?

Yes, it requires several environment variables including MONGODB_URL, FEISHU_API_URL, and PYSPIDER_BASE_URL to communicate with your infrastructure.

How does it ensure scraping tasks actually run?

The skill performs a mandatory status check on the PySpider project to ensure it is in a 'RUNNING' or 'DEBUG' state before submitting any new orders.

Which platforms are supported by this skill?

It supports major social media platforms (Reddit, Instagram, TikTok, Twitter, Facebook), e-commerce sites (Amazon, SellerSprite), and SEO tools like SEMrush.

Can I use this for LinkedIn scraping?

Currently, LinkedIn is not supported. If requested, the skill will provide a list of all currently available and supported scraping platforms.

What happens if I provide an invalid URL for Facebook Ads?

The skill includes built-in validation that checks if Facebook URLs start with the required 'https://www.facebook.com/' prefix and prompts for correction if they don't.

PySpider Task Manager

Name: PySpider Task Manager
Author: Within-7

byWithin-7

•

Web Scraping & Data Collection

Automates web scraping task creation and management across social media, e-commerce, and SEO platforms via Feishu API integration.

This skill empowers analysts to manage complex PySpider web scraping workflows using natural language. It acts as a bridge between user requests and the PySpider dispatcher, handling the entire lifecycle of a scraping order from parameter validation and project status checks to Feishu API logging. By automating the mapping of natural language to specific crawler configurations for platforms like Reddit, Amazon, and SEMrush, it ensures precise execution and reliable data collection without requiring manual script configuration.

Key Features

01Natural language parsing for multi-platform scraping requests

02Automated Feishu API integration for task tracking and notifications

03Platform-specific input validation for URLs and keywords

04Real-time PySpider project status verification before task execution

051 GitHub stars

06Comprehensive error handling with manual fallback instructions

Use Cases

01Monitoring e-commerce pricing and reviews across global marketplaces

02Collecting SEO backlink and keyword data for competitive research

03Automating social media data extraction for market sentiment analysis

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add within-7/minto-plugin-tools skills

For use in Claude.ai and ChatGPT

Download Skill