iOS 18

The 2024 Worldwide Developers Conference is fast approaching, and iOS 18 is going to be the star of the event. Apple is working on a major overhaul to iOS with the launch of iOS 18, introducing a range of AI features across the operating system. From Messages to Siri to Photos, many of the built-in Apple apps and features are going to get smarter and more capable.

Siri is going to get a major AI update, making the personal assistant better at natural interactions and speech. Spotlight search will incorporate more information from across the operating system, and Messages will be able to generate auto-complete sentences and also custom emoji based on the content of messages.

Apple music could get auto-generated plalists, the Reminders app is expected to integrate with the Calendar app, and the Photos app is expected to feature AI-powered photo retouching.

Along with AI features, iOS 18 will bring a more customizable Home Screen. App icons will be ale to be placed anywhere on the Home Screen grid, and users may be able to pick custom colors for app icons.

According to Bloomberg's Mark Gurman believes that iOS 18 will be a "relatively groundbreaking" software update with "major new features and designs." Apple executives have reportedly described iOS 18 as "ambitious and compelling," and Gurman says that it has the potential to be the "biggest" software update in the iPhone's history with a "slew of new AI features."

Apple CEO Tim Cook said in February that Apple is investing a "tremendous amount of time and effort" on artificial intelligence, and he confirmed that Apple plans to share the details of its ongoing AI work "later this year."

As with all iOS updates, iOS 18 will be accompanied by iPadOS 18, a version of iOS 18 with some features specific to the larger displays of Apple's tablet lineup.

Apple is racing to catch up to companies that have an AI head start, such as Microsoft, Google, Amazon, and OpenAI. Apple is spending more than $1 billion per year on AI research and the hardware needed to run large language models, and Apple plans to use AI in multiple ways in iOS 18 to bolster built-in apps and features. In Apple Music, for example, Apple plans to offer auto-generated Apple Music playlists, and apps like Pages and Keynote can provide AI-assisted writing and slide deck creation.

Some of the initial AI features coming in iOS 18 will be run on-device and won't rely on cloud servers, but Apple does plan to take advantage of cloud technology for off-device processing. There will be a focus on security, however, with Apple using the Secure Enclave in iOS processors to isolate the data being processed on its cloud servers.

Apple has designed the AI features coming in iOS 18, with functionality running on device and on Apple's own servers, but it is also planning to partner with OpenAI and possibly Google to power cloud-based generative AI features like creating images, and writing essays based on a prompt, and summarizing data. There are many AI features Apple is working on, such as:

• Photo retouching in the Photos app.
• Auto-generated playlists in Apple Music.
• Voice memo transcription.
• Suggested replies for emails and messages.
• Auto-generated emojis based on the content of a user's messages, with Apple creating all-new emoji for any occasion.
• Improved Safari web search.
• Smart recaps of missed notifications and individual messages, web pages, news articles, documents, and notes.

Apple will not offer its own generative AI chatbot in iOS 18, but it could opt for a chat feature that uses technology from Google or OpenAI. Apple is said to be close to finalizing a deal with OpenAI and it is also holding discussions with Google about integrating the Gemini AI engine into the iPhone in iOS 18.

The next-generation A18 chip that's planned for the iPhone 16 Pro models is rumored to feature an upgraded Neural Engine with "significantly" more cores, allowing for improved AI/machine learning performance. It is possible that some AI functionality will be limited to Apple's newest iPhones, including the iPhone 15 and iPhone 16 lineup.

Apple's full generative AI vision will take time to fully scale, so the complete suite of AI features that Apple has planned might not arrive in iOS 18, and the functionality will be improved on over time.

Siri will take advantage of the artificial intelligence improvements that Apple is bringing in iOS 18. One leaker has suggested that Apple is planning to use large-language models (LLMs) to entirely revamp Siri and turn it into the "ultimate virtual assistant." LLMs are the driving force behind chatbots like ChatGPT, and they incorporate huge amounts of data and use algorithms to generate content based on that information.

Siri will reportedly have a more conversational feel, with Apple improving "proactive intelligence. Siri will eventually be able to do more, and responses will be updated thanks to a new framework that takes into account entities like people, companies, calendar events, locations, and dates.

There will be more natural Siri voice options with improved text to speech functionality, plus there are a number of specific Siri features that are in the works.

Siri In-App Expansion

Siri will be able to control individual features in apps, expanding the range of functions the personal assistant is able to perform. This feature will initially be limited to Apple's built-in apps. Some of what Siri will be able to do:

• Open specific documents
• Move a note from one folder to another
• Move a file between folders
• Delete an email
• Summarize an article
• Summarize recent notifications or messages
• Email a web link
• Open a particular news site in Apple News

Apple rearchitected Siri's underlying software with large language models or LLMs to make this happen. Siri will only be able to respond to a single command at first, but Apple is eventually aiming to allow Siri to complete multi-step tasks such as turning a photo into a GIF and then messaging it to someone.

While Apple plans to show the Siri features off at WWDC, the revamped Siri will not be coming in September when iOS 18 first launches. It will instead be released in a future iOS 18 update that's coming in 2025.

Spotlight

The built-in Spotlight search feature could include more intelligent results and improved sorting, with the iPhone able to better integrate information from apps like Contacts and Calendar.

Siri for Apple Watch

Siri on Apple Watch is expected to improve, with rumors suggesting we'll see a version of Siri that is optimized for "on-the-go tasks."

The iOS 18 update is expected to bring some design changes, with Bloomberg's Mark Gurman suggesting Apple is working to update the design of the operating system "as early as this year."

iOS might take some design cues from visionOS, but it is not expected to adopt a complete visionOS overhaul, despite a rumor suggesting iOS 18 would be redesigned to match visionOS.

Home Screen Revamp

iOS 18 is expected to feature a more customizable Home Screen, giving iPhone users more options for the look of the iPhone. Apple plans to give customers more control over how their app icons are arranged.

App icons are expected to remain locked to an invisible grid for organizational purposes, but the update could add the option to create blank spaces, rows, and columns between app icons. iOS 18 is likely to bring the most significant update to the Home Screen that we've had in years, on par with the Lock Screen changes that Apple introduced in iOS 16.

Icon Colors

Apple is expected to let users change the colors of app icons in iOS 18, so icons won't be restricted to the color that developers offer. Users will, for example, be able to make all social icons blue or all message related icons green, streamlining the Home Screen.

iOS 18 is expected to include updates for several of the built-in apps, including Notes, Mail, Photos, and Fitness. We don't know a lot about some of the planned refreshes, but we have heard hints for a few of the new features.

Safari

Safari is expected to get a significant overhaul, with an updated look along with new tools to improve browsing. An "Intelligent Search" option will use on-device AI technology to identify key topics and phrases on webpages to offer a summary.

A "Web Eraser" tool will allow users to remove unwanted portions of webpages. Sections of websites that are "erased" persist across visits unless the change is reverted.

There will be an updated quick-access menu available from the address bar that combines page tools and some of the functions that are currently housed in the Share Sheet.

Apple also plans to further align the iPadOS and macOS versions of Safari.

Messages

The Messages app will be able to offer a range of suggested replies for quicker responses to incoming messages.

Apple is planning for an auto-generated emoji feature that will generate a new emoji based on the content of a user's messages. The emoji will be all-new and created via AI rather than something from the existing emoji catalog.

iMessages will support text effects, allowing for individual words to be animated in a message. With RCS support, text effects may also work when messaging Android users.

Mail

Like the Messages app, the Mail app will be able to suggest replies to incoming emails.

Apple Maps

There are several new features rumored for the Apple Maps app in iOS 18.

With support for custom routes, Apple Maps users may be able to input self-selected routes rather than being limited to the pre-selected options that Apple provides. Custom routes would let users select what roads they want to travel down, whether for scenic purposes or the familiarity of a route.

Apple may also bring the watchOS 10 topographic map feature to the iPhone in iOS 18. Topographic maps include trails, contour lines, elevation, points of interest, and other features that are of use for hiking and other outdoor activities.

Photos

Apple plans to add AI-based photo editing features to the Photos app in iOS 18, though Bloomberg's Mark Gurman says these features will not be as impressive as those offered by other editing platforms like Photoshop.

One option will allow users to retouch photos, removing unwanted objects using generative AI.

Notes

The iOS 18 Notes app is expected to offer support for recording voice memos directly in the app, with recordings able to be embedded in notes. Apple is also rumored to be adding support for displaying mathematical notation for including more kinds of equations to notes.

Notes and Voice Memos will include audio transcription features, offering up auto-generated transcripts of audio recordings. The Notes app is also expected to provide AI-generated summaries of key points in audio recordings and notes.

Calendar and Reminders

The Calendar app is expected to get Reminders integration, a feature that will let Reminders be viewed in and interacted with in the Calendar app.

Calculator App

Apple plans to introduce a built-in Calculator app for the iPad with iPadOS 18. The app will be a "universal" app able to run on the iPhone, iPad, and macOS, allowing for a similar look and function across all three devices.

The Calculator app for the iPhone may also see some design refinements, with both versions set to gain integration with the Notes app, an improved interface for unit conversions, and a list of recent calculations.

Freeform

The Freeform app is set to be updated with a "Scenes" feature that will let users to select specific sections or Scenes within their boards for quicker navigation. Scenes will be accessible through a new Scenes UI, which can be used to flip between saved scenes.

Apple Music

iOS 18 and macOS 15 will include smart song transitions that improve on the existing crossfade option. With smart song transitions, ‌Apple Music‌ users will be able to adjust the crossfade duration from 1 to 12 seconds.

As it stands, crossfade bridges the gap between songs by lowering the volume of the song that's ending while increasing the volume of the new song, creating a successful transition without the music ever coming to an end.

Apple music could also include a feature for auto-generated playlists, with users able to input a mood, a time of day, and other parameters to get music suggestions.

Keynote, Numbers, and Pages

Apple's iWork apps will include new AI features. Keynote will have an option for automatically generating slides, and Pages will get a feature for generating text.

Shortcuts

Shortcuts will better integrate with Siri, allowing for the automation of complex tasks with less effort.

Health

The Health app could get new AI features, but specifics are unknown at this time.

Notifications

iOS 18 will add smart recaps of missed notifications and individual messages, making it quicker to catch up and skip out on notifications that are not useful.

Control Center

Control Center will be revamped, but it is not yet clear what Apple will change.

Settings

The Settings app will be streamlined, with a new UI that has a reorganized, cleaner layout. The updated app is said to be simpler to navigate, with Apple also planning to improve search within the Settings app.

Apple is expanding accessibility features for CarPlay, and there are several updates planned.

• Voice Control: Lets users navigate through CarPlay options and apps with voice commands.
• Color Filters: Changes the look of the CarPlay interface for those who are color blind.
• Sound Recognition: Allows drivers or passengers who are deaf or hard of hearing to receive CarPlay notifications for sounds like car horns and sirens.

Apple "later in 2024" will adopt the Rich Communication Services (RCS) standard as an alternative to SMS/MMS. iMessage isn't going anywhere for iPhone to iPhone conversations, but RCS will make iPhone to Android conversations better in myriad ways. Sending photos and videos to Android users from an iPhone will no longer result in errors, and group chats will have better performance. Features like cross-platform emoji reactions, read receipts, and real-time typing indicators will also be added.

• Support for higher resolution photos and videos.
• Support for larger file sizes and file sharing.
• Audio messages.
• Cross-platform emoji reactions.
• Real-time typing indicators.
• Read receipts.
• Ability to send messages over cellular or Wi-Fi (SMS is cellular only). There is no cost to send an RCS message over Wi-Fi.
• Improved group chats.

Apple hasn't provided specifics on when RCS will be adopted, but "later in 2024" suggests that it's going to come following the launch of iOS 18. Everything about RCS and what it means for iPhone users can be found in our RCS guide.

Apple announced several new accessibility features coming to iOS 18 in May, giving us a quick preview of what to expect.

Reduce Motion Sickness

There's a new Vehicle Motion Cues option that's meant to prevent motion sickness when looking at an iPhone or iPad while in a moving vehicle as a passenger. Motion sickness is often caused by a sensory conflict between what a person sees and what they feel, which is an issue in a moving vehicle.

Motion Vehicle Cues use visual elements on the display that indicate real-time changes in motion. Basically, animated dots at the edges of the screen represent changes in vehicle motion, reducing sensory conflict without interfering with the main content. The option can be set to show automatically on the iPhone and it can be turned on and off in Control Center.

Eye Tracking

Eye Tracking allows users to navigate through the iPhone or iPad interface with only their eyes. The feature uses AI and the front-facing camera to determine where a user is looking. It can be used to activate buttons, swipes, and other gestures.

Music Haptics

When Music Haptics is enabled, the iPhone's Taptic Engine will play "taps, textures, and refined vibrations" that correspond to the audio of the music. The feature works across millions of songs in the Apple Music catalog and developers can implement it into their apps.

Vocal Shortcuts

With Vocal Shortcuts, iPhone and iPad users can assign "custom utterances" so that Siri is able to launch shortcuts and understand complex tasks.

Other Features

• New voices for VoiceOver, a flexible Voice Rotor, and custom volume control.
• Voice Control offers support for custom vocabularies and complex words.
• A new Reader Mode for Magnifier and an option to launch Detection Mode with the Action button.
• Updates to accessing Braille Screen Input.
• Hover Typing shows larger text when typing in a text field.
• Live Speech includes categories and simultaneous compatibility with Live Captions.

With the launch of iOS 18, the AirPods Pro are expected to gain a new "hearing aid mode." While the feature was initially rumored for the next-generation AirPods Pro, Apple is now said to be planning to introduce support through a software update. Apple already has Conversation Boost for increasing the volume and clarity of people directly in front of the wearer, so it is not clear what hearing aid mode will do differently.

Apple cannot market the AirPods Pro as offering hearing help for those who are hearing impaired, but the FDA has approved over-the-counter hearing aids designed for non-hearing impaired customers.

Apple is working on new Accessibility features for iOS 18 and macOS 15. An Adaptive Voice Shortcuts feature will let users create a custom phrase and then select an accessibility setting to link to that phrase. Speaking the phrase will then activate the accessibility option. Users will be able to toggle accessibility features like VoiceOver, Voice Control, Zoom, and more.

Live Speech will gain an option for user-created categories that can be used to organize custom phrases.

iOS 18 is expected to run on all iPhones that are able to run iOS 17, which includes the iPhone XR, iPhone XS, iPhone SE 2, and newer.

• All iPhone 15 models
• All iPhone 14 models
• All iPhone 13 models
• All iPhone 12 models
• All iPhone 11 models
• iPhone XS and XS Max
• iPhone XR
• iPhone SE (2nd and 3rd gen)

iPadOS 18 is rumored to drop support for the first-generation 10.5-inch iPad Pro and the second-generation 12.9-inch iPad Pro, both of which used the A10X Fusion chip. The update is also unlikely to run on the sixth-generation and seventh-generation iPad models.

The update should be compatible with the following iPads:

• iPad Pro: 2018 and later
• iPad Air: 2019 and later
• iPad mini: 2019 and later
• iPad: 2020 and later

iOS 18 will be previewed at the Worldwide Developers Conference on June 10. After WWDC, iOS 18 will be made available to developers for testing purposes, with a public beta likely to come out sometime in July.

Following the beta testing period, iOS 18 will see a launch in September 2024 alongside new iPhones.