Apple WWDC 2024: Apple Intelligence, iOS 18, watchOS 11, visionOS 2, iPad, MacOS Sequoia, Siri Unveiled With Machine Learning and AI Features

Cupertino, June 10: Apple WWDC 2024 finally live streamed online and Apple introduced some groundbreaking AI and machine learning-powered updates during the event. Apple CEO Tim Cook kick-started Apple’s highly anticipated event and confirmed more such groundbreaking software updates will be coming in the future. Apple first introduced visionOS 2 for Apple Vision Pro mixed reality headsets and then all the other operating systems.

Apple introduced software updates to its six broader categories, which included visionOS 2 for the Apple Vision Pro headset, iOS for iPhones, Audio & Home for Apple TV and Apple Air Pods, watchOS for Apple watches, iPadOS for Apple iPads, and iMacOS for Apple Mac computers. Apple CEO Tim Cook Meets Akshat Srivastava, Indian Student and Winner of ‘Swift Student Challenge’ Ahead of WWDC 2024.

Apple All Announcements: 

Apple All Announcements (Photo Credit: Official Apple WWDC 2024 Event)

Apple visionOS Update:

visionOS (Photo Credit: Official Apple WWDC 2024 Event)

Apple iOS 18 Update:

IOS 18 (Photo Credit: Official Apple WWDC 2024 Event)

Audio & Home: 

Audio & Home (Photo Credit: Official Apple WWDC 2024 Event)

Apple watchOS 11:

watchOS (Photo Credit: Official Apple WWDC 2024 Event)

Apple iPadOS:

iPadOS (Photo Credit: Official Apple WWDC 2024 Event)

Apple macOS:

macOS (Photo Credit: Official Apple WWDC 2024 Event)

Apple Intelligence: 

Apple Intelligence (Photo Credit: Official Apple WWDC 2024 Event)

visionOS 2 New Features and Upgrades

  • Ability to process spatial photos
  • Multiview in TV app
  • New Bora Bora Environment
  • Travel mode on trains for interactive multimedia experience
  • Mouse Support
  • Follow Your breathing option
  • AirPlay Receiver
  • Newly added gestures and tap controls for notifications
  • HealthKit
  • Recent Guest User
  • Home View Customisation and rearrangement
  • Volumetric APIs, Enterprise APIs and TabletopKit
  • Mac Virtual Display enhancements
  • Keyboard breakthrough
  • Apple spatial videos coming to the Vimeo app are compatible with the Vision Pro headset.
  • Apple Vision Pro launch announcement in nine more countries including China, Japan, Singapore,  Australia, Canada, Germany, the UK  and more.

iOS 18 New Features and Upgrades

  • Home Screen and wallpaper customisations according to tints
  • Control Centre customisations and quick access
  • Enhanced privacy features in iOS 18 – locking and hiding apps
  • Messages update – Emoji Tapbacks, scheduled messaging, text effects, Messages via Satellites
  • Email improvements – better categorisations, interactions, finding relevant information
  • Hiking in Maps with turn-by-turn voice guidance
  • “Tap to cash” feature for quick payments between iPhones (works like NFC)
  • Journal new features – easy tracking of goals, pastries check and more
  • ‘Game Mode’ coming on iOS 18 with enhanced visuals and better gaming experience
  • Photos app redesigned – easy categorisation, finding specific photos, filtering, Collections, favourites, carousel and wallpapers

Audio and Home New Features and Upgrades:

  • Apple Air Pods Pro and Siri integration for hands-free experience
  • Voice Isolation feature on Air Pods Pro for exceptional call quality
  • Personalised Spatial Audio API to boost gaming experience
  • New Apple TV Screen savers
  • FaceTime Live Captions
  • Hands-free unlocking with UWB locks
  • On-device Siri available on Apple TV
  • InSight feature to find actors in real-time and save audio version to listen later for Apple Originals
  • Redesigned Apple Fitness+
  • Enhanced Dialogues feature for getting on-point subtitles for Apple TV and improved human dialogues.
  • 21:9 movie format projections to watch movies or videos in the director’s aspect ratio
  • Robot vacuums in the Home app
  • Home Electricity
  • Guest access
  • Subtitles on mute
  • SharePlay on HomePod

watchOS 11 New Features and Upgrades:

  • Live Activities on Apple Watches
  • Effort rating
  • Redesigned Photos app in watchOS
  • Details about Vitals
  • Training Load
  • Enhanced Ticketing
  • Speech Recognition and Translate feature
  • Multiple interactive widgets
  • Double tap API
  • Intelligence Smart Stack
  • Custom workouts for Pool Swims
  • Vitals app allowing to see health metrics and changes
  • Pregnancy-related data
  • Uber ride updates
  • Distance and route maps for more workouts

iPadOS New Features and Upgrades

  • Game Mode on iPad
  • Home Screen personlisation
  • Control Centre customisations
  • Responsive animations and morphing effects
  • Calendar reminder integration
  • Customisation in-app icons
  • Emoji Tapbacks
  • Smart Script for handwriting, spell checks, moving or erasing text and more
  • Tab Bar Customisations
  • FreeForm scenes
  • SharePlay screen-sharing features
  • Improved calculator supporting handwriting with Apple Pencil integration
  • Math Notes for calculations, problem-solving, and handwriting support with Apple Pencil
  • Text effects

MacOS Sequoia New Features and Upgrades:

  • Hiking in Maps – easy route finding and tracking
  • Text effects on MacOS Sequoia
  • Collection in Photos app
  • Game Porting Toolkit 2 for a powerful gaming experience, Xcode support
  • iPhone Mirroring, interaction and getting notification
  • Emoji Tapbacks
  • Keychain for secured password protection across all synced devices.
  • Seamless video calling background removal
  • Scenes in FreeForm
  • Apple Pay on third-party browsers
  • Math Notes
  • Redesigned Reader
  • Scheduling messages
  • Safari updates – battery saving, improved privacy, profiles, translation and more, highlights using ML
  • Assassin’s Creed Shadows coming on iPad this year

Apple Intelligence Key AI Features, Personal Intelligence

Apple also discussed “Apple Intelligence,” which it referred to as a “personal intelligence” system, during the Apple WWDC 2024. Apple said that most online AI tools know little about individuals. Apple Intelligence comes with capabilities for language, image, action, and personal context. It comes with understanding personal context, including relations, and also boosts privacy.

Apple announced that this personal intelligence is processed on-device, boosting privacy. The tech giant also announced ‘Private Cloud Compute’ for processing and maintaining privacy. The company said that it would never store any user data. Apple’s “personal intelligence system” also comes with natural language search, search in videos and the ability to create a memory movie using image understanding. Another feature introduced was Genmoji, allowing people to create real-time emojis with text descriptions. Here are the highlights,

  • Image Wand
  • Audio Recording
  • Genmoji creation
  • Natural Language Search
  • Cleaning up in the Photos app
  • Reduce Interruptions
  • Email priority messages and sorting
  • More personal Siri
  • Private Cloud Compute
  • Writing tools
  • Summaries in Messages
  • Image Playground
  • Prioritising notifications

Siri Updates

Apple has also improved Siri and the voice assistant and added new features. Siri has a richer language understanding and effortlessly performs more integration tasks. The tech giant promised more features next year. Siri will also take in-app actions on behalf of users. With more voice commands, Siri makes interacting with each app intuitively without even touching the screen. It also summarises the meeting and understanding of personal text, such as personally sent links, finding information, and doing more. Samsung Launches 2024 QLED 4K TV Series in India; Know About Price, Specifications and Features.

ChatGPT Integration:

Apple finally opened up about its collaboration with OpenAI by announcing ChatGPT interaction with its operating systems. If the users asked Siri about any particular question and it might not have an answer, then it would suggest using ChatGPT seamlessly. ChatGPT in IOS 18 and other platforms is coming later this year while boosting users’ privacy. Apple said that paid users could also enjoy the premium features of ChatGPT in iOS, and those who want to remain private could use it without registering for it. Apple Intelligence will be available in the US this summer.

(The above story first appeared on LatestLY on Jun 11, 2024 12:25 AM IST. For more news and updates on politics, world, sports, entertainment and lifestyle, log on to our website latestly.com).

Leave a Reply

Your email address will not be published. Required fields are marked *