Does Evaluator integrate with other skills?

Yes, it is designed to work seamlessly with the ClaudeShack ecosystem, including the Oracle, Guardian, and Summoner skills.

Is my data private when using Evaluator?

Yes. Evaluator is strictly opt-in, never collects PII (Personally Identifiable Information), code content, or file paths, and only shares anonymized aggregate statistics.

What kind of data does Evaluator collect?

If you opt-in, it collects anonymous event types, skill success/failure rates, error types for debugging, and performance metrics like duration.

How do I start or stop data collection?

You can control your data using simple commands: use '/evaluator enable' to opt-in or '/evaluator disable' to stop collection and '/evaluator purge' to delete local data.

Where can I see the feedback collected?

Manual feedback is organized in GitHub Issues, and weekly aggregate reports are typically posted to the GitHub Discussions section of the repository.

Evaluator Telemetry Framework

Name: Evaluator Telemetry Framework
Author: Overlord-Z

byOverlord-Z

Analytics & Monitoring

Monitors skill performance and gathers anonymous user feedback through a privacy-first, opt-in telemetry framework.

About

Evaluator is a specialized framework for Claude Code designed to improve the ClaudeShack ecosystem through transparent, data-driven insights. It allows users to contribute anonymous usage metrics and structured feedback via GitHub Issues and Projects, ensuring developers can prioritize features and fix bugs based on real-world performance. Built with a privacy-first philosophy, Evaluator stores data locally, removes all personally identifiable information, and only shares aggregated statistics, making it an essential tool for maintaining high-quality, reliable AI skills.

Key Features

Direct integration with GitHub Issues and Projects for feedback
Developer hooks for instrumenting custom Claude skills
0 GitHub stars
Privacy-first, strictly opt-in telemetry collection
Local-first storage with transparent data audit capabilities
Aggregated performance reporting for skill optimization

Use Cases

Collecting structured community feedback and bug reports via GitHub
Tracking success rates and execution latency for custom AI skills
Identifying high-impact feature requests through aggregate usage patterns

About

Key Features

Direct integration with GitHub Issues and Projects for feedback
Developer hooks for instrumenting custom Claude skills
0 GitHub stars
Privacy-first, strictly opt-in telemetry collection
Local-first storage with transparent data audit capabilities
Aggregated performance reporting for skill optimization

Use Cases

Collecting structured community feedback and bug reports via GitHub
Tracking success rates and execution latency for custom AI skills
Identifying high-impact feature requests through aggregate usage patterns