Apple TV Remote App Inspired Steve Jobs to Make Original Siri Remote

Last week Apple removed the Apple TV Remote app from the App Store, given that the app's functionality has been baked into the Control Center on iPhone and iPad since iOS 11. Following the Remote app's discontinuation, a former Apple engineer took to Twitter to share some interesting details about the app's original development.

Alan Cannistraro writes that he began writing the app in 2006 before he even saw the first iPhone user interface, and instead used his own UI elements to begin with. The former designer explains that the Remote app was Apple's first production app that the ‌App Store‌ team used to "test their upload flow" to the Store, and while it only shipped with iTunes and ‌Apple TV‌ controls, early prototypes were a lot more functional.

While we shipped it only with iTunes and Apple TV control, my prototype also allowed me to turn on/off lights, TVs and Receivers (via an IR adaptor), and save and resume a room’s state as a "Scene".

A year later (2009) I had also built prototypes in Remote that would let your phone touchscreen be your mouse for your computer, and to interact with photos, applications (the original TouchBar) and screensavers on your Mac.

I was pitching a larger idea around device communication that never got off the ground (too early?). Predecessor to HomeKit & AirPlay. I had devices from Denon, Marantz, Sharp that spoke a protocol I designed so you could turn them on/off, change inputs and volume, tone, etc.

Another prototype Cannistraro designed in 2009 turned the iPhone's touchscreen surface into a computer mouse, and also offered a way for Mac users to "interact with photos, applications (the original TouchBar) and screensavers."

Cannistraro says he showed the app to then-Apple CEO Steve Jobs, who was so impressed with the way it let you control the ‌Apple TV‌ with swipes and gestures that he wanted the next hardware ‌Apple TV‌ remote to work similarly.

In 2010, I sat down with with Steve to show him how Remote controlled Apple TV with swipes, and he said, “our next Apple TV Remote should be this without a screen”. It took five years (lots of stuff paused when Steve died), but eventually Siri Remote came out and was just that.

On reflection, Cannistraro says he believes the "ultimate vision" for Remote still hasn't been realized, and that smart home control remains a "disjointed experience" on any ecosystem. "HomeKit and Alexa are getting us closer," he says, "but there is still much to do to make the rooms we live in into elegant, ambient, intelligent experiences. Working on it."

• How to Use Control Center's Apple TV Remote on iPhone and iPad