How does visual regression work in Seer?

It uses a loop comparison script to check current window captures against saved 'baseline' images, generating pixel diffs and reports to identify UI regressions.

Does Seer require any external dependencies?

Yes, certain features require Python 3 with the Pillow library installed, and frame extraction from video requires ffmpeg.

Can I use Seer to create UI wireframes?

Yes, Seer includes a utility to convert natural language descriptions into Excalidraw scene files, making it easy to generate wireframes directly from chat.

Can Seer interact with apps, or just take screenshots?

Seer can perform basic interactions like focusing applications, typing text, and clicking relative coordinates within a window to simulate user behavior.

What operating systems does Seer support?

Seer is specifically designed for macOS, utilizing system-level tools like osascript and screencapture to interact with native windowing.

Seer Visual Automation

Name: Seer Visual Automation
Author: w00ing

byw00ing

•

Design Tools

Captures and analyzes macOS application windows for visual UI verification and automated regression testing.

About

Seer is a comprehensive visual automation skill for macOS that empowers Claude to see and interact with running applications. It provides a robust suite of tools for capturing precise window screenshots, recording interaction videos, and extracting frames for granular analysis. Beyond simple capture, Seer facilitates automated UI mockups via JSON specs, natural language conversion to Excalidraw wireframes, and a sophisticated visual regression loop that compares current UI states against baselines. This ensures visual consistency and rapid UI feedback throughout the development lifecycle.

Key Features

Visual regression testing with baseline comparison and diff reporting
Automated UI interaction including text input and relative clicking
59 GitHub stars
Natural language to Excalidraw wireframe generation
High-precision window screenshot and video recording on macOS
Image annotation and mockup creation via JSON specifications

Use Cases

Generating quick wireframes and annotated mockups from text descriptions
Verifying UI changes match design specs during frontend development
Automating visual regression tests for macOS applications

About

Key Features

Visual regression testing with baseline comparison and diff reporting
Automated UI interaction including text input and relative clicking
59 GitHub stars
Natural language to Excalidraw wireframe generation
High-precision window screenshot and video recording on macOS
Image annotation and mockup creation via JSON specifications

Use Cases

Generating quick wireframes and annotated mockups from text descriptions
Verifying UI changes match design specs during frontend development
Automating visual regression tests for macOS applications