phone-harness

Phone-harness lets an AI agent physically drive your iPhone. It captures the macOS iPhone Mirroring window, runs Apple's OCR over it for eyes, and posts real taps, drags, and keystrokes for hands. No jailbreak, no Xcode, about 500 lines of Python, MIT licensed and free.

Setup is a one-time iPhone Mirroring pairing plus Accessibility and Screen Recording permissions, and a doctor command checks the chain. The design constraint is that the mirroring window is just a video stream: no accessibility tree, so anything not rendered as readable text is invisible to the agent, and the window must stay frontmost, so your Mac is occupied while it runs.

This is a proof of concept for people experimenting with agent-driven mobile automation, not a QA tool; Appium and Maestro remain the serious answers for testing. And it does not work in the EU at all, because Apple has never shipped iPhone Mirroring there.

The catch: you're giving an LLM unsupervised control of your personal, logged-in phone with nothing sandboxing it. Very young, tiny commit history, and the issue list is already outrunning the code. Fun to try; think hard before trusting it.