As a part of its WWDC 2024 announcements, the tech giant unveiled visionOS 2, tvOS 18, watchOS 11, iPadOS 18, macOS 15 “Sequoia” and iOS 18. The visionOS 2 marks the first major software update for the Apple Vision Pro headset. It includes changes to the gestural system, making quick actions easier to access. The Photos app can now automatically synthesise Spatial Photos from your 2D photo library, and the Mac Virtual Display feature is being upgraded with bigger resolutions and better quality. Travel Mode will also work on trains.
Additionally, Apple announced that the Apple Vision Pro headset will be expanding beyond the US for the first time. The headset will go on sale in eight additional countries, in two batches. Firstly, on June 28, the Apple Vision Pro will be available in China, Japan, and Singapore. On July 12, it will also launch in Australia, Canada, France, Germany, and the United Kingdom.
Apple iOS 18
The upcoming tvOS 18 will come with several new features. One of them is InSight, which is similar to Amazon X-ray but for Apple original content. In terms of video, Apple will now support 21:9 projectors for the first time. For audio, Apple is upgrading its Enhance Dialogue feature using machine learning to improve voice isolation. With the new version of tvOS, subtitles will be enabled automatically at relevant moments, such as when the volume of the movie is muted or when you skip back ten seconds to replay the scene. Additionally, tvOS 18 will include an upgraded set of screensavers, including a new animated Snoopy screensaver, and an option that features scenes from Apple TV+ shows.
Apple watchOS 11
Apple watchOS 11 will now allow users to take a rest day without losing an activity streak, and it also enables setting custom ring goals for different days of the week.
Apple macOS 15 Sequoia
The new version of the Mac operating system, macOS 15 Sequoia, includes Math Notes, new features in Messages, a new way to mirror your iPhone on your Mac screen, and more. Users now have new ways to take advantage of Continuity features between their Mac and iPhone. Apple has also introduced a standalone Passwords app with macOS 15 Sequoia, allowing users to easily manage their passwords without the need for third-party apps. Safari has also been improved and now uses AI to automatically highlight useful information, such as map directions or a video on the webpage.
Apple Intelligence
During its WWDC keynote, Apple announced its AI strategy, revealing a range of features designed to be powerful, intuitive, integrated, personal, and private. These Apple Intelligence features are available across iPhone, iPad, and Mac, utilising a blend of on-device and server-powered generative AI models. The features include personalised notification prioritisation on iPhone, generative writing tools across apps, image generation, and more. Apple states that its generative AI is unique in that it personalises outputs to individual contexts while maintaining privacy.
You can use Image Generation to create cartoon images that look like the contacts in your address book and then send them to friends through Messages. Apple's Intelligence is mainly powered by on-device models and is compatible with the A17 Pro on iPhone 15 Pro, as well as M1 and later Apple Silicon Macs.
Apple is introducing server infrastructure to run more advanced models, known as Private Cloud Compute. According to Apple, this will allow more powerful generative AI models to process your data without compromising your privacy. Apple assures that your data is never stored or accessed by Apple when using Private Cloud Compute.
New version of Siri powered by AI
Apple has introduced a new user interface for Siri, featuring a glow around the device bezel and richly detailed response cards. The updated Siri will be gradually rolled out over the next year and will have on-screen awareness of the user's current activity. It will be able to take in-app actions, such as finding and extracting relevant information, like a driving license number, to fill in a form. Siri's new feature, App Intents, will enable it to work deeply with both first-party and third-party apps. During a demo, Apple showed Siri editing an image in the Photos app based on the user's current activity.
