Apple Multi-Touch Display? - MacRumors
Skip to Content

Apple Multi-Touch Display?

As a final note in the recent flurry of Apple Tablet and Gesture patents, one user points out some interesting possible relationships between Apple's recent patents.

One video has received a lot of attention. It is a video by Jeff Han on his research into Multi-Touch displays. The impressive display shows a user using multiple fingers/hands in manipulating objects on the screen. A closer look at technology behind the demonstration reveals that it is a very intricate setup.

The system shown uses a technique called Frustrated Total Internal Reflection (FTIR) to accomplish the tasks shown. It involves the use of a transparent screen with the images rear-projected onto it. For touch-sensing, a camera is placed behind the screen to detect the user interaction. A diagram of the setup is shown here.

The use of both a projector and rear-camera, of course, is not feasible in any potential laptop or tablet device from Apple... but conveniently enough, Apple has recently applied for a patent on an Integrated Sensing Display (diagram) providing a screen that can be used both as a display and as a camera:

The integrated sensing display includes both display elements and image sensing elements. As a result, the integrated sensing device can not only output images but also input images.

At the time, many users dismissed the need for such an elaborate display when the built-in iSights offer a reasonable solution for video-conferencing needs. Of course, the use of this "integrated sensing" display would not likely use the FTIR method as described above, but could offer similar multi-touch functionality.

Apple has recently demonstrated a need for a multi-touch display in their recent Gesture patent application, specifically in this image.

Update: Hrmph previously noted a European patent application from Apple for a "Multi-point touchscreen" -- allowing up to 15 simultaneous presses.

Popular Stories

Apple Event Logo

Apple's Next Era Begins September 1

Thursday May 7, 2026 10:36 am PDT by
Apple recently announced that Tim Cook will be stepping down as CEO later this year, after 15 years of leading the company. Effective September 1, Apple's hardware engineering chief John Ternus will become the company's next CEO, while Cook will become executive chairman of Apple's board of directors. In his new role, Apple said Cook will assist with "certain aspects" of the company,...
Four iPhone 18 Pro Colors Mock Feature

iPhone 18 Pro Launching in September With These 10 New Features

Saturday May 9, 2026 6:03 am PDT by
While the iPhone 18 Pro and iPhone 18 Pro Max are not launching until September, there are already plenty of rumors about the devices. It was initially reported that the iPhone 18 Pro models would have fully under-screen Face ID, with only a front camera visible in the top-left corner of the screen. However, the latest rumors indicate that only one Face ID component will be moved under the...
Apple Watch Series 10 Jet Black Touch ID

Apple Watch Series 12 and watchOS 27: What to Expect Later This Year

Friday May 8, 2026 2:07 pm PDT by
While not too much has been reported about the next Apple Watch models, there are a few rumors about potential design changes and watchOS 27 features. Apple Watch Series 12 and Apple Watch Ultra 4 models are expected to be released in September, and we have outlined some of the key rumored hardware and software changes below. A new Apple Watch SE is not expected this year, as that model was...