During its Worldwide Developers Conference, Apple showcased Siri AI as the headline feature, along with a suite of enhancements across iOS 27, iPadOS 27, macOS 27, watchOS 27, and visionOS 27.
One of the notable updates is in the Photos app, which now utilizes advanced image models to allow for more intuitive editing while preserving the integrity of the captured moment. The new Spatial Reframing feature enables users to touch and drag a photo, instantly previewing perspective changes, benefitting from Apple’s comprehensive understanding of spatial models on the Vision Pro headset.
This allows you to modify an image as if the camera had been repositioned in the original scene. The Spatial Reframing feature generates new content only where perspective adjustments occur, maintaining consistency with the original image. Additionally, the Extend tool enables users to straighten horizons without losing essential elements, or to adjust aspect ratios seamlessly.
Apple has significantly enhanced the Clean Up tool, improving its ability to remove distractions from photos with higher quality and more realistic infills, even in intricate scenes.
Safari is also receiving a range of AI upgrades. It will automatically categorize tabs into relevant topics and, while you browse, can organize new tabs into existing categories or create new ones as necessary. The new Notify Me feature allows Safari to monitor web pages for changes, notifying you when updates occur—perfect for tracking product restocks and price drops.
Another innovative feature, Describe an Extension, lets users articulate the functionality of a desired Safari extension, which Safari will then create directly in the toolbar.
Users can now automatically enhance weak and compromised passwords with a single tap through the use of Apple Intelligence and Safari. The system navigates websites to securely update your passwords to stronger alternatives that are then remembered.
The Image Playground feature allows you to generate high-quality images in various styles, including photorealistic ones. This utilizes a new generative model within Apple's Private Cloud Compute, ensuring user data privacy. Users can easily edit images using prompts or by selecting and adjusting specific objects.
Image Playground can also create customized Lock Screen wallpapers and Contact Posters, with options for aspect ratio generation based on use cases.
In the Messages app, users will benefit from one-tap suggestions that relate to the context of conversations—such as setting reminders or sharing notes. If someone requests photos, the app can assist by identifying relevant images based on keywords, locations, and contacts. Additionally, Mail has expanded its capabilities with enhanced suggestions that now integrate third-party apps, and the Smart Reply feature in Mail and Messages adapts to your personalized writing style.
The Call Context feature provides relevant information about a business you're calling, such as confirmation codes or reservation numbers, directly in the Phone app. This feature operates based on your contact list rather than your conversation content and runs entirely on-device, ensuring privacy.
With Describe a Shortcut, users can utilize the Shortcuts automation app simply by articulating what they want, with the app assembling the necessary actions on their behalf. Users can also specify any adjustments, which the app will implement accordingly.
The Home app now features generated video descriptions that allow users to quickly grasp what transpired in video clips captured by smart home devices without viewing them. Furthermore, users can search through video clips to find specifics, such as package deliveries. Noteworthy clips will be highlighted on the Search page for easy access.
Voice Control has become more intuitive, enabling users to navigate their iPhone or iPad entirely by voice and describe on-screen buttons and controls instead of memorizing exact labels. The Accessibility Reader feature can provide on-demand summaries and translations.
Users will also receive intelligent suggestions for naming files and folders based on their content. Additionally, the quality of Genmoji has been improved, allowing users to specify desired changes to them.
Apple Intelligence will be accessible on the iPhone 16 and later, iPhone 15 Pro, iPhone 15 Pro Max, iPad mini (A17 Pro), iPad models with M1 or later, MacBook Neo, Mac devices with M1 or later, Vision Pro, Apple Watch Series 10 or later, Apple Watch Ultra 2 or later, and Apple Watch SE 3 when paired with an Apple Intelligence-enabled iPhone.
Some features, such as image generation, will have daily usage limits, which can be expanded with iCloud+ subscription plans. Additionally, these plans include Apple Intelligence features for compatible cameras within the Home app.
