You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[Feature]: Support physical iOS devices in the Device hub
#14794
Problem
The Device hub can open and control iOS Simulators, and there is ongoing work for physical Android devices (#12765, via scrcpy). Physical iPhones are not supported, so I can't preview or let agents interact with my app on a real device, where behavior often differs from the Simulator (camera, push notifications, performance, haptics, real network conditions).
Proposed solution
Detect iPhones connected over USB or the local network, show their screen in the Device panel, and forward taps, swipes, and text input, ideally with agent device access like simulators get today.
Possible implementation paths
Screen capture: iOS devices expose their screen as a CoreMediaIO capture source on macOS (the mechanism QuickTime uses for screen recording).
Input and automation: WebDriverAgent / XCUITest, the approach used by Appium and mobile-mcp, can drive physical devices.
Device discovery and app install/launch: xcrun devicectl.
Smallest useful scope
macOS only, one USB-connected iPhone: view the screen, tap/swipe/type, take screenshots for agent inspection. Install/launch, recording, and multiple devices can come later.
Alternatives considered
macOS iPhone Mirroring and QuickTime can display the device, but they aren't integrated into T3 Code and agents can't control them.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
Problem
The Device hub can open and control iOS Simulators, and there is ongoing work for physical Android devices (#12765, via scrcpy). Physical iPhones are not supported, so I can't preview or let agents interact with my app on a real device, where behavior often differs from the Simulator (camera, push notifications, performance, haptics, real network conditions).
Proposed solution
Detect iPhones connected over USB or the local network, show their screen in the Device panel, and forward taps, swipes, and text input, ideally with agent device access like simulators get today.
Possible implementation paths
Screen capture: iOS devices expose their screen as a CoreMediaIO capture source on macOS (the mechanism QuickTime uses for screen recording).
Input and automation: WebDriverAgent / XCUITest, the approach used by Appium and mobile-mcp, can drive physical devices.
Device discovery and app install/launch: xcrun devicectl.
Smallest useful scope
macOS only, one USB-connected iPhone: view the screen, tap/swipe/type, take screenshots for agent inspection. Install/launch, recording, and multiple devices can come later.
Alternatives considered
macOS iPhone Mirroring and QuickTime can display the device, but they aren't integrated into T3 Code and agents can't control them.
All reactions