Apple Pencil Used as Weight Scale, Synthesizer and 3D Image Editing Controller - MacRumors
Skip to Content

Apple Pencil Used as Weight Scale, Synthesizer and 3D Image Editing Controller

by

While the Apple Pencil is designed as a sketching tool for creative professionals, MacRumors reader Simon Gladman has created three Swift demo apps that show the accessory being used for three unconventional purposes -- as a weight scale, controlled synthesizer and 3D controller for image editing.

PencilScale


PencilScale, based on Goodman's Plum-O-Meter, is an experimental app that uses a homemade harness to turn the Apple Pencil into an electronic scale that is highly sensitive, but not incredibly accurate.

The experiment works by subtracting the touch's force from a base weight, which is "set as the current touch force when the 'zero' button is pressed," and multiplying it by 140 for a very rough weight in grams.

PencilSynth


PencilSynth is an AudioKit-powered synthesizer that can be controlled by the Apple Pencil depending on its orientation and position.

  • Apple Pencil's horizontal position on the screen controls frequency

  • Apple Pencil's vertical position on the screen controls the modulating multiplier

  • Apple Pencil's altitude angle controls the carrier multiplier

  • Apple Pencil's azimuth angle controls the modulation index

PencilController


PencilController is an experimental image processing app that uses the Apple Pencil as a controller for the fine setting of parameters on Core Image filters.

The demo has three image filtering modes:

  • Hue/Saturation - Apple Pencil's azimuth angle controls hue and its altitude angle controls the saturation

  • Brightness/Contrast - Apple Pencil's altitude angle along North/South controls contrast and the angle along West/East controls brightness

  • Gamma/Exposure - Apple Pencil's altitude angle along North/South controls exposure and the angle along West/East controls gamma

Gladman explains that "the app uses a spring loaded pattern, so the user needs to hold down one of the mode keys in the bottom left of the screen to stay in the filtering mode."

The source code for all three projects is available on GitHub.

Related Roundup: iPad Pro
Buyer's Guide: iPad Pro (Caution)
Related Forum: iPad Accessories

Top Rated Comments

FlexMonkey Avatar
142 months ago
I know this is sounds cool. But come on guys I'm tired of hearing this non-sense use of technology. There is abviously a much better device for such thing and it doesn't cost a lot of money to have one. I'm talking about the scale and somebody did it on iPhone 6S 3D Touch too. It's because you can it doesn't mean you have too.
Hi!

I'm actually the same guy that did the "Plum-O-Meter" for weighing things on an iPhone :)

Of course there are better devices, but I'm interested in experimenting, tinkering and playing then seeing what results. Actually, using the Pencil as a controller works really well for the fine adjustments in the image processing app and the fact the it has five degrees of freedom makes it a unique input device for the audio app.

Without some left field thinking, we'd all be using abacuses!

Cheers!

Simon
Score: 16 Votes (Like | Disagree)
142 months ago
Aren't the phrases "Highly Sensitive" and "Not Incredibly Accurate" a bad combination under pretty much any circumstance?

.....As a side note, those two phrases remind me of almost every girlfriend I've ever had, the first phrase typically causing the second.... ;)
Score: 7 Votes (Like | Disagree)
teslo Avatar
142 months ago
I know this is sounds cool. But come on guys I'm tired of hearing this non-sense use of technology. There is abviously a much better device for such thing and it doesn't cost a lot of money to have one. I'm talking about the scale and somebody did it on iPhone 6S 3D Touch too. It's because you can it doesn't mean you have too.
yeah, why would anyone ever want to do things?

i, for one, am witnessing exactly what i'd hope would start happening upon the release of a new device: tinkering, feedback, and constructive criticism. i'm sorry you're tired, i hear energy drinks are all the rage nowadays.
Score: 6 Votes (Like | Disagree)
142 months ago
Aren't the phrases "Highly Sensitive" and "Not Incredibly Accurate" a bad combination under pretty much any circumstance?
Nope, from a scientific terminology perspective, that actually makes perfect sense.

Accuracy, scientifically speaking, is how close to the real value a measurement will produce.

Precision (aka sensitivity) is how small of a quantity you can measure, accurately or otherwise.

And repeatability is how close to the same value taking the same measurement at two different times will produce, accurately, precisely, or otherwise.

So: An accurate scale will tell you something weighs 502 grams when it weighs 502 grams. A precise scale will tell you that something weighs 498.93 grams, although it might actually weigh 502.00 grams if the scale is not also accurate. And a repeatable (and precise) scale will tell you that something weighs 498.93 grams every time you weigh it, although if it's not also accurate it might really weigh 502 grams.

This particular "scale", silly or otherwise, will give you a lot of digits of precision on the weight measurement, so it's quite precise. It however isn't calibrated at all, so the accuracy is bad. No idea whether it's repeatable or not.
Score: 5 Votes (Like | Disagree)
nagromme Avatar
142 months ago
Think what you could do with 3 pencils! You could control that synthesizer with one, and jam the other 2 in your ears until the racket stops.
Score: 4 Votes (Like | Disagree)
garirry Avatar
142 months ago
I know this is sounds cool. But come on guys I'm tired of hearing this non-sense use of technology. There is abviously a much better device for such thing and it doesn't cost a lot of money to have one. I'm talking about the scale and somebody did it on iPhone 6S 3D Touch too. It's because you can it doesn't mean you have too.
Jesus ****ing christ, it's called EXPERIMENTATION. People EXPERIMENT with various devices and tools to create fun stuff. Maybe in real life it's incredibly pointless (there are better devices/software for cheap), but from a pure technical standpoint, it's very interesting.
Score: 3 Votes (Like | Disagree)

Popular Stories

new ipad cyber

New Entry-Level iPad Not Expected Until Early 2027

Sunday October 11, 2026 8:57 am PDT by
Apple's next entry-level iPad models, codenamed J581 and J582, will not arrive until early 2027, according to Bloomberg's Mark Gurman. He added that Apple plans a major iPad Air refresh to add an OLED display and a new iPad Pro in 2027. The latter could gain a vapor chamber to improve thermals and performance. A new iPad mini is still expected to arrive at the end of October this...
ipad 10th gen blue

iPad Could Get Significantly Thinner Bezels, Leaker Says

Monday October 5, 2026 8:39 am PDT by
The iPad is set to gain significantly narrower borders around its display, according to the leaker known as "Instant Digital" on Weibo. The post gives no model or timeline; it could refer to the entry-level iPad or to Apple's tablet lineup in general. Refreshes of the entry-level iPad, iPad mini, iPad Air, and iPad Pro are in the pipeline. The next iPad mini is already rumored to gain OLED and ...
iPhone Duo Apple Pencil

iPhone Duo Supports Apple Pencil Starting With iOS 27.2

Wednesday October 21, 2026 8:19 am PDT by
As noted by Creative Strategies analyst Max Weinbach, the iPhone Duo is gaining Apple Pencil support with iOS 27.2, which is expected to be released to the public next week. You can use the USB-C version of the Apple Pencil to draw, annotate, and scroll within supported apps on the iPhone Duo's inner and outer displays. In a post on X, Weinbach confirmed that Apple Pencil support was enabled...
Latest Stories
Giant iPhone Duo Displays Coming to Four Apple Stores
Giant iPhone Duo Displays Coming to Four Apple Stores
49 minutes ago
Apple Pulls Keynote, Pages and Numbers From App Store
Apple Pulls Keynote, Pages and Numbers From App Store
2 hours ago
Apple Updates More Apps With iPhone Duo Support
Apple Updates More Apps With iPhone Duo Support
2 hours ago
Apple Will Label Apps 'Made for iPhone Duo' in App Store
Apple Will Label Apps 'Made for iPhone Duo' in App Store
5 hours ago
Amazon Takes $49 Off iPad With Prices Starting at $399.99
Amazon Takes $49 Off iPad With Prices Starting at $399.99
6 hours ago
F1 on Apple TV Now Available in Dolby Atmos
F1 on Apple TV Now Available in Dolby Atmos
6 hours ago
Apple Reveals More Than 50 Apps That Will Be Updated for iPhone Duo
Apple Reveals More Than 50 Apps That Will Be Updated for iPhone Duo
7 hours ago
Apple Blocks Certificates That Could Help Attackers Fake Websites
Apple Blocks Certificates That Could Help Attackers Fake Websites
8 hours ago
Giant iPhone Duo Installations Spotted at Apple Fifth Avenue
Giant iPhone Duo Installations Spotted at Apple Fifth Avenue
9 hours ago
iPhone Duo 2 Prototypes Include Under-Display Face ID
iPhone Duo 2 Prototypes Include Under-Display Face ID
9 hours ago
Tesla App Gains iPad and iPhone Duo Support
Tesla App Gains iPad and iPhone Duo Support
13 hours ago
Apple Reportedly Boosts iPhone Duo Orders by 44%
Apple Reportedly Boosts iPhone Duo Orders by 44%
13 hours ago
Fortnite Returning to Australian App Store After Court Ruling
Fortnite Returning to Australian App Store After Court Ruling
14 hours ago
Apple Ordered to Open iPhone to Rival App Stores in Australia
Apple Ordered to Open iPhone to Rival App Stores in Australia
14 hours ago
Apple Suppliers Face Hurdles Cutting Circuit Board Emissions
Apple Suppliers Face Hurdles Cutting Circuit Board Emissions
14 hours ago
Things Updated for iPhone Duo With Adaptive Layout
Things Updated for iPhone Duo With Adaptive Layout
15 hours ago
Simplicity and Siri AI Are HomeView's Killer Features, Apple Says
Simplicity and Siri AI Are HomeView's Killer Features, Apple Says
15 hours ago
iPhone Duo Reviewers Really Miss Face ID
iPhone Duo Reviewers Really Miss Face ID
20 hours ago
Does the iPhone Duo Run Hot? Here's What Reviews Found
Does the iPhone Duo Run Hot? Here's What Reviews Found
22 hours ago
Apple Music's New Look is Now Live on Apple's Website
Apple Music's New Look is Now Live on Apple's Website
22 hours ago
Anthropic Launches Claude Duet, a Proactive AI Agent
Anthropic Launches Claude Duet, a Proactive AI Agent
23 hours ago
What 32,000 Folds Did to the iPhone Duo's Hinge
What 32,000 Folds Did to the iPhone Duo's Hinge
1 day ago
iPhone Duo's Hidden FaceTime Camera Takes 'Trash' Photos
iPhone Duo's Hidden FaceTime Camera Takes 'Trash' Photos
1 day ago
iPhone Duo Has 'Edge Light' Feature That Debuted on Macs Last Year
iPhone Duo Has 'Edge Light' Feature That Debuted on Macs Last Year
1 day ago
Apple Support App Updated for iPhone Duo's Larger Display
Apple Support App Updated for iPhone Duo's Larger Display
1 day ago
Amazon Sweetens the Deal on Entry-Level 16-Inch MacBook Pro With $570 Off
Amazon Sweetens the Deal on Entry-Level 16-Inch MacBook Pro With $570 Off
1 day ago
iPhone Duo Tips Over on MagSafe Stands When Unfolded
iPhone Duo Tips Over on MagSafe Stands When Unfolded
1 day ago
Apple Music's New Look Officially Announced
Apple Music's New Look Officially Announced
1 day ago
iPhone Duo Supports Apple Pencil Starting With iOS 27.2
iPhone Duo Supports Apple Pencil Starting With iOS 27.2
1 day ago
iPhone Duo Accessories Roundup: Cases and Screen Protectors From OtterBox, ZAGG, and More
iPhone Duo Accessories Roundup: Cases and Screen Protectors From OtterBox, ZAGG, and More
1 day ago