Apple Introduces Apple Intelligence at WWDC 2024

Apple has introduced "Apple Intelligence" at WWDC 2024, a new suite of AI features for iPhone, Mac, and iPad. This update will include a more conversational Siri, custom AI-generated “Genmoji,” and access to GPT-4o, which Siri will use when it can't answer a query on its own.

Apple is now incorporating many features similar to those launched by Google, Microsoft, and others over the past year. These AI features will be available exclusively on iPhone 15 Pro and 15 Pro Max, as well as iPads and Macs with M1 or later chips. The rollout will begin this fall with iOS 18, iPadOS 18, and macOS Sequoia.

The new AI capabilities will facilitate interactions between apps, manage notifications, automatically generate text, and summarize content in various applications. Users can also adjust the tone of their writing with prompts. AI features will enable actions across different apps, such as playing a podcast from a message sent by someone. Apple's AI-enhanced Siri will have "onscreen awareness," enabling it to understand user queries and interact with content in both Apple and third-party apps. Users will also have the option to type their requests to Siri.

Privacy remains a priority for Apple. Many AI functions will be processed on-device, but complex requests will be handled in the cloud. Apple refers to this as "Private Cloud Compute," ensuring that data processed in the cloud remains inaccessible to Apple and is protected by servers powered by Apple Silicon. Independent experts will be allowed to inspect the code on these servers to verify privacy claims.

A notable addition is “Genmoji,” which generates custom emoji-like reactions using AI, allowing users to create the exact emoji they need. Another feature, "Image Playground," will be integrated into several apps and will also be available as a standalone app. Developers can use an API to incorporate Image Playground into their applications.

The Photos app will also receive AI enhancements, improving the search functionality to recognize more specific actions. New tools will allow users to remove unwanted elements from photos, similar to Google’s Magic Eraser.

GPT-4o, powered by ChatGPT, will be integrated into iOS, macOS, and iPadOS later this year. Siri will be able to consult ChatGPT for answers it cannot provide, with user permission required before sending any data. ChatGPT will also be used in AI writing tools and for generating images, with user privacy maintained by obscuring IP addresses and not storing user requests.

While users will not need to create an account or pay to use ChatGPT, those with subscriptions can connect their accounts to access premium features within Apple's integrations.

These new AI features from Apple are set to improve the user experience by making interactions with devices more intuitive and powerful. Apple Intelligence is scheduled to release later this year.