During its Worldwide Developers Conference, Apple showcased its latest innovation: Siri AI. In addition to Siri, several new features under the banner of Apple Intelligence were announced, set to be integrated into iOS 27, iPadOS 27, macOS 27, watchOS 27, and visionOS 27.
The Photos app is now harnessing advanced image models, enabling edits while preserving the integrity of the captured moment. The Spatial Reframing feature allows users to touch and drag a photo, offering a live preview of perspective shifts, thanks to Apple’s profound understanding of spatial models on the Vision Pro headset.
Essentially, users can 'edit' images as if they had repositioned the camera in the original scene. Spatial Reframing generates new content only in areas where the perspective has shifted, ensuring consistency with the original photo. The Extend tool lets users expand images, straighten crooked horizons without cropping important details, and adjust aspect ratios.
The Clean Up tool has also received significant enhancements, with Apple asserting it can effectively remove distractions from images, offering improved quality and realistic in-fills, even in complex scenes.
Safari is set to receive numerous AI enhancements as well. It can now automatically categorize tabs into relevant topics. As users navigate, new tabs will be organized into existing topics or new ones as deemed appropriate. The new Notify Me feature enables users to monitor a web page for changes, alerting them when modifications occur—ideal for tracking restocks and price drops.
Another innovative AI feature, Describe an Extension, allows users to describe a desired Safari extension, which the browser will then generate directly in the toolbar.
Managing passwords has also been streamlined: users can now rectify weak and compromised passwords with a single tap. This feature employs Apple Intelligence alongside Safari to facilitate secure sign-ins and password updates, automatically storing the new, stronger passwords.
The Image Playground feature now empowers users to create high-quality images in nearly any style, including photorealistic ones, using a new generative model on Apple’s Private Cloud Compute. This model ensures users' private data remains confidential. Image Playground also facilitates easy edits using prompts, touch, and visual cues to highlight objects for relocation or resizing.
The Image Playground can generate Lock Screen wallpapers and Contact Posters, allowing users to select the aspect ratio for generated images to suit their needs.
The Messages app now offers one-tap contextual suggestions, such as creating reminders or finding photos based on keywords, locations, and people in your library. Additionally, Mail suggestions have gained new capabilities, including integration with third-party apps, while Smart Reply in both Mail and Messages adapts to users' personalized writing styles.
When calling businesses, the Call Context feature provides relevant information, such as confirmation codes or reservation numbers, displayed directly in the Phone app. This functionality operates based on the identity of the caller rather than voice content, maintaining user privacy since all data processing occurs on the device.
Describe a Shortcut enables users to utilize the Shortcuts automation app through simple verbal descriptions. The app will automatically compile necessary steps, and users can further refine their requests by describing any adjustments.
The Home app now features generated video summaries, allowing users to quickly grasp the events across sequenced clips from smart home devices without needing to watch them. Additionally, users can search through camera clips to find specific content, like package deliveries. The app will also highlight noteworthy clips at the top of its Search page.
Voice Control has been enhanced for easier navigation of iPhones and iPads purely by voice, allowing users to describe on-screen buttons and controls without having to memorize precise labels or numbers. The Accessibility Reader can deliver on-demand summaries and translations.
Furthermore, intelligent name suggestions for files and folders will be provided based on their contents, while Genmoji's capabilities have improved, allowing users to detail changes they want to make.
Apple Intelligence will be available on the iPhone 16 and later, iPhone 15 Pro, iPhone 15 Pro Max, iPad mini (A17 Pro), iPad models with M1 or later, MacBook Neo, Macs with M1 or later, the Vision Pro, Apple Watch Series 10 and later, Apple Watch Ultra 2 and later, and Apple Watch SE 3 when linked with an Apple Intelligence-enabled iPhone.
Note that some features, such as image generation, come with daily usage limits, which can be increased with iCloud+ subscription plans. These plans also include Apple Intelligence features for compatible Home app cameras.
Source
