Why is tracking the prediction_id important?

It serves as the unique key that correlates the initial entry signal with the final exit event, allowing the system to calculate the exact accuracy and error of a specific trade.

How does it handle directional noise?

It utilizes a 0.1% threshold to classify moves as up or down; anything smaller is classified as neutral to prevent tiny price fluctuations from skewing accuracy statistics.

What data is stored in the outcome record?

The skill records the actual direction (-1, 0, 1), the percentage magnitude change, the final exit price, and calculated fields like directional correctness and magnitude error.

What exit paths does this skill cover?

The pattern covers all three critical exit points: Stop-Loss/Take-Profit triggers, Signal-Based Flattening (when a signal becomes neutral), and Reverse Signal Closes.

Can this be used for both live trading and backtesting?

Yes, while specifically designed for live trading environments, the pattern is essential for backtesting to create comparable datasets between simulated and live performance.

Trading Prediction Outcome Tracker

Name: Trading Prediction Outcome Tracker
Author: smith6jt-cop

bysmith6jt-cop

0•

Data Science & ML

Automates the recording of actual trading results against predicted signals to enable accurate performance metrics and model retraining.

This skill provides a standardized pattern for closing the prediction loop in algorithmic trading systems by capturing outcome data when positions exit. It ensures that every prediction—whether it ends in a stop-loss, take-profit, or manual signal reversal—is accurately mapped to its result with precise magnitude and direction calculations. By implementing this pattern, developers can generate reliable datasets for model evaluation, accuracy analysis, and automated retraining triggers, solving the common problem of 'orphaned' predictions that lack ground truth data.

Key Features

01Captures outcomes across all exit points including stop-loss, take-profit, and signal reversals

020 GitHub stars

03Standardizes magnitude recording as percentage-based change for consistent evaluation

04Tracks prediction IDs through the entire position lifecycle to correlate entries and exits

05Calculates directional accuracy using a configurable 0.1% movement threshold

06Includes SQL verification queries to monitor outcome recording health and data integrity

Use Cases

01Debugging trading strategy performance by correlating signals with actual exit prices

02Measuring the win rate and directional accuracy of machine learning trading models

03Building a verified ground truth dataset for model retraining and optimization

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add smith6jt-cop/skills_registry prediction-outcome-recording

For use in Claude.ai and ChatGPT

Download Skill