IOS 26 Visual Intelligence: New Features
- Apple's upcoming iOS 26 will feature enhanced Visual Intelligence, offering users more ways to interact with and search using images.
- One key feature is highlight to Search, similar to Android's Circle to Search.
- while Google Image Search is the default, Apple demonstrated the feature working with other apps like Etsy.
Uncover the power of iOS 26 Visual Intelligence, transforming how you interact with images. Apple’s latest update introduces sophisticated tools for object identification within screenshots and photos, revolutionizing your search capabilities. Explore the innovative “Highlight to Search” feature, enabling precise searches with a simple gesture, and learn how the “Ask” button, powered by ChatGPT, answers your broader image-related questions. Enhanced image search capabilities now extend to recognizing art, books, landmarks, and sculptures.Discover how News Directory 3 is keeping tabs on the latest tech innovations and insights regarding the future of iOS. Visual Intelligence is poised to reshape your digital interactions, bringing context to every image.Discover what’s next in the realm of image recognition.
iOS 26 Visual Intelligence Enhances Image Search
Apple’s upcoming iOS 26 will feature enhanced Visual Intelligence, offering users more ways to interact with and search using images. The update includes tools for identifying objects within screenshots and photos, and providing relevant information.
Highlight to Search
One key feature is highlight to Search, similar to Android’s Circle to Search. Users can draw around an object in a screenshot to initiate a search for that specific item. This allows for targeted image searches even when multiple objects are present in the picture.
while Google Image Search is the default, Apple demonstrated the feature working with other apps like Etsy. App developers will likely need to add specific support for this functionality.
In some instances, Visual intelligence will automatically identify objects, allowing users to tap directly without needing to highlight. This is similar to the object identification already available in the Photos app, but now leads to an image search.
Ask and Search
For broader inquiries, the Ask button allows users to pose questions about the entire screenshot. these questions are processed by ChatGPT, which then provides relevant information. The Search button performs a Google Search for additional details.
Visual Intelligence can also recognize dates, times, and related event information in screenshots, offering to add them directly to the user’s calendar.
Enhanced Object Identification
Visual intelligence expands its object recognition capabilities to include art, books, landmarks, natural landmarks, and sculptures. previously, it could identify animals and plants.
When Visual Intelligence recognizes an object, a glowing icon appears. Tapping the icon reveals information about the object, whether in a live camera view or a captured photo.
While Ask and Search require a photo to be sent to services like ChatGPT,the identification of art,books,and other objects is done on-device.
Compatibility and Launch
Visual Intelligence is exclusive to devices supporting Apple Intelligence, including the iPhone 15 Pro models and the upcoming iPhone 16 models. It is activated via a long press on the camera Control button or through the Action Button or a Control Center toggle.
iOS 26 is currently in beta and is scheduled for public release in September.