Does ADB Pilot work with physical devices?

Yes, ADB Pilot works with both physical Android devices and emulators, provided ADB is enabled and the device is connected via USB or Wi-Fi.

Do I need to manually find X/Y coordinates for tapping?

No, ADB Pilot allows you to tap elements by their text labels (e.g., 'Book Now'), which the skill automatically translates into coordinates.

Can Claude 'see' the Android screen with this skill?

Yes, the screenshot command captures the screen and generates a JSON map of UI elements, allowing Claude to identify buttons, fields, and text.

Is Python required to run this skill?

Yes, the skill requires Python 3.8+ and ADB (Android Debug Bridge) to be available in your system's PATH.

ADB Pilot

Name: ADB Pilot
Author: ThilinaTLM

byThilinaTLM

Mobile Development

Automates Android device interaction and UI testing through a unified, LLM-optimized CLI interface.

About

ADB Pilot is a specialized skill designed to bridge the gap between Claude and Android environments, providing a JSON-ready interface for controlling emulators and physical devices. It enables Claude to perform complex mobile tasks such as taking screenshots with mapped UI elements, tapping buttons by text label, filling forms in single commands, and waiting for specific UI states. This tool is essential for developers and QA engineers who want to automate mobile workflows, verify UI flows, or perform end-to-end testing directly through an AI-powered coding assistant.

Key Features

Comprehensive device control including swipes, key events, and app launching
UI-aware screenshots that map element coordinates to text labels
Human-readable interactions including 'tap by text' and 'fill form'
0 GitHub stars
Unified CLI with JSON output optimized for LLM consumption
Reliable synchronization with wait-for logic for UI state changes

Use Cases

Debugging complex UI flows by interacting with live emulators via natural language
Capturing and analyzing mobile app states with element-mapped screenshots
Automating end-to-end user journeys for Android application testing

About

Key Features

Comprehensive device control including swipes, key events, and app launching
UI-aware screenshots that map element coordinates to text labels
Human-readable interactions including 'tap by text' and 'fill form'
0 GitHub stars
Unified CLI with JSON output optimized for LLM consumption
Reliable synchronization with wait-for logic for UI state changes

Use Cases

Debugging complex UI flows by interacting with live emulators via natural language
Capturing and analyzing mobile app states with element-mapped screenshots
Automating end-to-end user journeys for Android application testing