iPhone 16's Latest Visual Intelligence Features Explained - MacRumors
Skip to Content

iPhone 16's Latest Visual Intelligence Features Explained

by

For ‌iPhone 16‌ models, Apple's iOS 18.3 software update added new Visual Intelligence features to the Camera Control button. Keep reading to learn what you can do with the new capabilities and how to use them.

Apple Visual Intelligence

New Visual Intelligence Features

In iOS 18.2, Apple company added Visual Intelligence functionality to its latest iPhone 16 models, allowing device owners to point the camera at the world around them and get details about places, summarize and translate text, go to website links, call phone numbers, and more.

In iOS 18.3, Apple added new capabilities to Visual Intelligence, including an option to create a calendar event when viewing a poster or flyer, as well as the ability to easily identify plants, animals, and insects.

iphone 16 hands on camera control
Bear in mind that ‌Visual Intelligence‌ is an Apple Intelligence feature that is exclusive to the ‌iPhone 16‌ models – if you have an older model, you won't have a Camera Control button below the Side button on the right-hand side of your device.

Activating Visual Intelligence

To activate Visual Intelligence, press and hold the Camera Control button for a few seconds. A regular press simply opens the camera with Camera Control, so the press-and-hold gesture is necessary. Ensure the Camera app isn't already active, as Visual Intelligence won't work if the camera is already in use.

The Visual Intelligence interface includes a camera view, a capture button, and "Ask" and "Search" options. The "Ask" button interacts with ChatGPT, while "Search" sends the captured image to Google Search.

visual intelligence buttons
To use Visual Intelligence, you must take a photo of the object or scene you're observing. Use the Camera Control button to snap a picture, then select your desired option. It doesn't support live camera views or previously saved photos.

Create a Calendar Event From a Poster

Using ‌Visual Intelligence‌ to add an event to Calendar was a promised function that Apple showed off when introducing Camera Control, and it has been usable since the release of iOS 18.3.

create event visual intelligence
To add an event, view a document such as a poster with a date, and then tap on the date when the feature pops up in the ‌Visual Intelligence‌ interface.

Identify Pets, Animals, and Insects

The Photos app is already able to provide insight into plants, animals, and insects when opting to view additional information in the editing interface, but Camera Control will now show these details in real-time.

ios 18 3 camera control animals
When viewing an animal or a plant with ‌Visual Intelligence‌, you may see a tappable bubble at the top of the viewfinder that lets you know what you're looking at. Simply tap it to view more information. If the output is incorrect, you can use the thumbs up and thumbs down icons below the card to submit feedback to Apple.

Top Rated Comments

23 months ago
Kind of a dick move to exclude 15 Pro’s
Score: 14 Votes (Like | Disagree)
23 months ago
Looks like a nice feature set. Looking forward to updating and checking it out.
Score: 7 Votes (Like | Disagree)
23 months ago
Apple Intelligence has proven worthless so far. Locking this feature to only iPhone 16 models continues this useless trend.
Score: 7 Votes (Like | Disagree)
teknikal90 Avatar
23 months ago

Like I keep saying, just buy Apple stock (AAPL) then you will be happy it's only on NEW models. :) :)
we're like 80% in to the Apple Intelligence rollout - can anyone honestly tell me 1 good benefit? The big downside, the massively decreased battery life is a tangible downside. I sure hope the contextual siri actually works.

None of that is creating any upward pressure on the company's valuation.
Score: 5 Votes (Like | Disagree)
23 months ago
Can’t wait. I really like AI, but know haters gonna hate.
Score: 5 Votes (Like | Disagree)
BGPL Avatar
23 months ago
This could be a very cool feature. Too bad my one year old phone doesn't support it. Classic Apple move.
Score: 5 Votes (Like | Disagree)

Popular Stories

Apple Intelligence Comes Under Fire Feature

Mac Users Reclaim 12GB+ of Storage With Apple Intelligence Removal Tool

Monday October 5, 2026 4:12 am PDT by
A new open-source tool is making waves in the Mac community by helping users reclaim valuable storage space taken up by Apple's AI models. Called "RemoveMacAI," the command line tool disables Apple Intelligence on macOS 27, removes its downloaded models, and prevents them from being downloaded again. In macOS 27, Apple removed the toggle to disable Apple Intelligence wholesale, and simply...
apple intelligence black

Apple Intelligence Taking Up 30GB+ on Some Macs Running macOS 27

Wednesday September 23, 2026 3:30 am PDT by
After you install macOS 27 Golden Gate, Apple automatically downloads a multi-gigabyte AI model to your Mac the next time it's connected to the internet. Unlike previous versions of macOS, you can't prevent it. Siri AI, and by extension Apple Intelligence, are now a mandatory part of your system. For macOS 27 Golden Gate, Apple says the latest Apple Intelligence features require up to 14GB...
Apple TV Sans Remote Feature

tvOS 27.2 Code Hints at Apple Intelligence for New Apple TV

Monday October 5, 2026 1:45 pm PDT by
Apple's latest tvOS 27.2 beta adds weight to rumors that the next Apple TV will have Siri AI and Apple Intelligence support. Code suggests Apple is adding an Improve Siri & Apple Intelligence toggle to the tvOS Settings app. "Help improve foundation models and Siri by allowing Apple to collect and use your text and audio interactions with Siri, Dictation, and Translate," the text reads....
Latest Stories
Tesla App Gains iPad and iPhone Duo Support
Tesla App Gains iPad and iPhone Duo Support
2 hours ago
Apple Reportedly Boosts iPhone Duo Orders by 44%
Apple Reportedly Boosts iPhone Duo Orders by 44%
3 hours ago
Fortnite Returning to Australian App Store After Court Ruling
Fortnite Returning to Australian App Store After Court Ruling
3 hours ago
Apple Ordered to Open iPhone to Rival App Stores in Australia
Apple Ordered to Open iPhone to Rival App Stores in Australia
4 hours ago
Apple Suppliers Face Hurdles Cutting Circuit Board Emissions
Apple Suppliers Face Hurdles Cutting Circuit Board Emissions
4 hours ago
Things Updated for iPhone Duo With Adaptive Layout
Things Updated for iPhone Duo With Adaptive Layout
4 hours ago
Simplicity and Siri AI Are HomeView's Killer Features, Apple Says
Simplicity and Siri AI Are HomeView's Killer Features, Apple Says
5 hours ago
iPhone Duo Reviewers Really Miss Face ID
iPhone Duo Reviewers Really Miss Face ID
10 hours ago
Does the iPhone Duo Run Hot? Here's What Reviews Found
Does the iPhone Duo Run Hot? Here's What Reviews Found
11 hours ago
Apple Music's New Look is Now Live on Apple's Website
Apple Music's New Look is Now Live on Apple's Website
12 hours ago
Anthropic Launches Claude Duet, a Proactive AI Agent
Anthropic Launches Claude Duet, a Proactive AI Agent
12 hours ago
What 32,000 Folds Did to the iPhone Duo's Hinge
What 32,000 Folds Did to the iPhone Duo's Hinge
13 hours ago
iPhone Duo's Hidden FaceTime Camera Takes 'Trash' Photos
iPhone Duo's Hidden FaceTime Camera Takes 'Trash' Photos
15 hours ago
iPhone Duo Has 'Edge Light' Feature That Debuted on Macs Last Year
iPhone Duo Has 'Edge Light' Feature That Debuted on Macs Last Year
15 hours ago
Apple Support App Updated for iPhone Duo's Larger Display
Apple Support App Updated for iPhone Duo's Larger Display
15 hours ago
Amazon Sweetens the Deal on Entry-Level 16-Inch MacBook Pro With $570 Off
Amazon Sweetens the Deal on Entry-Level 16-Inch MacBook Pro With $570 Off
16 hours ago
iPhone Duo Tips Over on MagSafe Stands When Unfolded
iPhone Duo Tips Over on MagSafe Stands When Unfolded
16 hours ago
Apple Music's New Look Officially Announced
Apple Music's New Look Officially Announced
17 hours ago
iPhone Duo Supports Apple Pencil Starting With iOS 27.2
iPhone Duo Supports Apple Pencil Starting With iOS 27.2
18 hours ago
iPhone Duo Accessories Roundup: Cases and Screen Protectors From OtterBox, ZAGG, and More
iPhone Duo Accessories Roundup: Cases and Screen Protectors From OtterBox, ZAGG, and More
19 hours ago
Apple Stores Will Have 'Limited' Availability of iPhone Duo for Walk-In Customers
Apple Stores Will Have 'Limited' Availability of iPhone Duo for Walk-In Customers
19 hours ago
iPhone Duo Reviews Explain Why Device is Both 'Fun' and 'Frustrating'
iPhone Duo Reviews Explain Why Device is Both 'Fun' and 'Frustrating'
19 hours ago
Apple Says 'Reachability' Feature Coming to iPhone Duo Later This Year
Apple Says 'Reachability' Feature Coming to iPhone Duo Later This Year
21 hours ago
Loop Capital Cuts Apple Rating Over iPhone Sales Outlook
Loop Capital Cuts Apple Rating Over iPhone Sales Outlook
1 day ago
Apple Stores in Bordeaux and Lille Looted During French Protests
Apple Stores in Bordeaux and Lille Looted During French Protests
1 day ago
Bluesound Adds Native Apple Music Support
Bluesound Adds Native Apple Music Support
1 day ago
Apple CEO John Ternus Explains What Makes Good Product Design
Apple CEO John Ternus Explains What Makes Good Product Design
1 day ago
UK Proposes New Ways to Help Apple Pay Rivals
UK Proposes New Ways to Help Apple Pay Rivals
1 day ago
WhatsApp Developing In-App Browser for All Chat Links on iPhone
WhatsApp Developing In-App Browser for All Chat Links on iPhone
1 day ago
Apple's App Store Chief Explains Its Push for Premium Games
Apple's App Store Chief Explains Its Push for Premium Games
1 day ago