Can I record or stream the simulator screen with this skill?

Yes, AXe supports high-quality H.264 video recording to MP4 files and can stream video in various formats like MJPEG or raw BGRA at custom frame rates.

Does AXe require any special background daemons?

No, AXe is a standalone binary that interacts directly with Apple's private APIs, making it lightweight and easy to integrate into CI/CD workflows without resident processes.

How does AXe differ from the standard simctl tool?

While simctl focuses on device lifecycle, permissions, and status bar control, AXe provides advanced UI interaction capabilities like tapping specific accessibility elements, simulating gestures, and inspecting the UI tree.

Why should I use describe-ui before performing interactions?

The describe-ui command provides the current accessibility tree, allowing you to find stable IDs and labels. This ensures your automation targets the correct elements without relying on fragile, coordinate-based guesses.

iOS Simulator UI Automation (AXe)

Name: iOS Simulator UI Automation (AXe)
Author: CharlesWiltgen

byCharlesWiltgen

•

233

•

Mobile Development

Automates complex iOS Simulator UI interactions and accessibility-based testing using the AXe CLI tool.

This skill provides comprehensive guidance for using the AXe CLI to automate iOS Simulator interactions beyond the standard capabilities of simctl. It enables developers to perform accessibility-based tapping, complex gestures, text input, and hardware button simulation while offering deep UI tree inspection to locate stable element identifiers. By prioritizing accessibility IDs over fragile coordinates, it helps create robust automation scripts for end-to-end testing and UI walkthroughs in modern xOS development environments.

Key Features

01Complex gesture simulation including custom swipes and scrolls

02233 GitHub stars

03Accessibility-first UI targeting using identifiers and labels

04High-quality H.264 video recording and real-time streaming

05Deep UI tree inspection with the describe-ui command

06Direct simulation of hardware buttons and keyboard input

Use Cases

01Automating complex user login and multi-step UI flows

02Capturing high-resolution screenshots and video for test documentation

03Auditing and debugging iOS accessibility hierarchies

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add charleswiltgen/axiom axiom-axe-ref

For use in Claude.ai and ChatGPT

Download Skill