SAN FRANCISCO - Apple on Monday introduced Apple Intelligence, the personal intelligence system for iPhone, iPad, and Mac that combines the power of generative models with personal context at the WWDC24 event.

"Apple Intelligence is deeply integrated into iOS 18, iPadOS 18, and macOS Sequoia. It harnesses the power of Apple silicon to understand and create language and images, take action across apps, and draw from personal context to simplify and accelerate everyday tasks," the company said, adding that with Private Cloud Compute, Apple sets a new standard for privacy in AI, with the ability to flex and scale computational capacity between on-device processing and larger, server-based models.

"Apple Intelligence will transform what users can do with our products, and what our products can do for our users," said Tim Cook, Apple's CEO. "Our unique approach combines generative AI with a user's personal context to deliver truly helpful intelligence. And it can access that information in a completely private and secure way to help users do the things that matter most to them. This is AI as only Apple can deliver it, and we can't wait for users to experience what it can do."

With new systemwide Writing Tools built into iOS 18, iPadOS 18, and macOS Sequoia, users can rewrite, proofread, and summarize text nearly everywhere they write, including Mail, Notes, Pages, and third-party apps, the company said.

"Rewrite helps deliver the right words to meet the occasion. Proofread checks grammar, word choice, and sentence structure while also suggesting edits ... With Summarize, users can select text and have it recapped in the form of a digestible paragraph, bulleted key points, a table, or a list," Apple noted.

ALSO READ: Apple challenges $2b EU antitrust fine at EU court

With Priority Messages, a new section at the top of the inbox shows the most urgent emails. Smart Reply provides suggestions for a quick response, and will identify questions in an email to ensure everything is answered.

In the Notes and Phone apps, users can now record, transcribe, and summarize audio. Apple Intelligence can generate a summary to help recall key points.

With Image Playground, users can create fun images in seconds, choosing from three styles: Animation, Illustration, or Sketch.

Also on Monday,  Apple previewed visionOS 2, a major update to Apple Vision Pro with new spatial computing experiences

Searching for photos and videos becomes more convenient with Apple Intelligence. Natural language can be used to search for specific photos. Search in videos can find specific moments in clips so users can go right to the relevant segment. Additionally, the new Clean Up tool can identify and remove distracting objects in the background of a photo.

With Memories, Apple Intelligence can pick out the best photos and videos based on a user's description, craft a storyline, and arrange it all into a movie with its own narrative arc.

Powered by Apple Intelligence, Siri becomes more deeply integrated into the system experience. With richer language-understanding capabilities, Siri is more natural, more contextually relevant, and more personal, with the ability to simplify and accelerate everyday tasks. Users can switch between text and voice to communicate with Siri.

Apple is integrating ChatGPT access into experiences within iOS 18, iPadOS 18, and macOS Sequoia, allowing users to access its expertise, as well as its image- and document-understanding capabilities, without needing to jump between tools.

ChatGPT will be available in Apple's systemwide Writing Tools, which help users generate content. With Compose, users can also access ChatGPT image tools to generate images.

Using the Compose tool in Pages, a user enters a prompt about writing a bedtime story about a 6-year-old named Annie who's great at solving riddles.

Apple Intelligence is free for users, and will be available in beta as part of iOS 18, iPadOS 18, and macOS Sequoia this fall in US English. Some features, software platforms, and additional languages will come over the course of the next year. Apple Intelligence will be available on iPhone 15 Pro, iPhone 15 Pro Max, and iPad and Mac with M1 and later. 

Also on Monday,  Apple previewed visionOS 2, a major update to Apple Vision Pro with new spatial computing experiences.

With more than 2,000 spatial apps designed for Apple Vision Pro and more than 1.5 million compatible iOS and iPadOS apps, visionOS 2 enables developers to take further advantage of spatial computing with new tools and makes it easier to create all-new app experiences that are more volumetric and shareable, the company said.

"Apple Vision Pro delivers revolutionary experiences for users and developers, and we're excited to advance spatial computing even further with visionOS 2 just months after its initial release," said Mike Rockwell, Apple's vice president of the Vision Products Group.

"From navigating visionOS more seamlessly to pushing the boundaries of how users connect with memories, and enhancements to key Vision Pro apps ... with a robust set of tools that enable developers to create richer spatial apps, visionOS 2 makes Vision Pro even more powerful," he added.

The visionOS uses advanced machine learning to transform a 2D image into a spatial photo on Vision Pro. Users can share their spatial photos with others to view on Vision Pro.

An update to Final Cut Pro will enable creators to edit spatial videos on their Mac, and with the Vimeo app designed for Vision Pro, users can upload and share spatial videos for others to discover and enjoy, according to Apple.

ALSO READ: Nvidia overtakes Apple as No. 2 most valuable company

The visionOS also introduced a spatial interface that users control with their eyes, hands, and voice.

Later this year, Mac Virtual Display will feature a higher resolution and larger size, creating an ultra-wide display that is equivalent to two 4K monitors side by side, the company said.

The visionOS 2 includes new APIs and frameworks that help developers more easily create apps and games that are more volumetric and introduce new shareable experiences.

"New tools in visionOS 2 enable developers to extend capabilities in the healthcare, manufacturing, aerospace, automotive, and other industries," Apple said.

Apple also announced that Apple Vision Pro will expand to new countries and regions, with pre-orders for Chinese mainland, Hong Kong, Japan, and Singapore beginning June 13, and availability beginning June 28. Customers in Australia, Canada, France, Germany, and the United Kingdom can pre-order Vision Pro beginning June 28, with availability beginning July 12.