Apple is reportedly working on significant AI advancements for its upcoming operating systems, iOS 18 and macOS 15.
These enhancements, part of a project codenamed “Greymatter,” are expected to offer practical benefits to users across various applications, including Siri, Notes, and Messages.
Alongside these AI improvements, Apple plans to revamp several key system applications and features.
Also Checkout: iPhone 14 Pro Max Price, Features and Specifications
Project Greymatter: AI-Powered Innovations
Project Greymatter aims to integrate artificial intelligence deeply into Apple’s ecosystem.
Here are some key features you can look forward to:
Siri Improvements
- Notification Summarization: “Greymatter Catch Up” will allow Siri to provide an overview of recent notifications.
- Smart Response Framework: Siri will generate more intelligent responses by considering factors such as people, events, and locations.
- On-Device Processing: Siri will handle tasks like summarizing articles and transcribing audio directly on the device, ensuring faster and more secure operations.
- App Control: Siri will offer to perform tasks within apps based on your device’s analysis of your activities, such as summarizing meetings, cropping photos, or organizing notes.
Notes App Enhancements
- Audio Transcription and Summarization: The updated Notes app will support recording, transcribing, and summarizing audio, making it ideal for students and professionals.
- Math Notes: This new feature will recognize and solve mathematical equations, also offering graphing capabilities similar to the macOS Grapher app.
Photo Editing
- Generative AI Tools: A new “Clean Up” tool will allow users to remove objects from images, enhancing the current Retouch tool.
Cross-Device Media Controls:
- Users will soon be able to control media playback on different Apple devices using Siri, a feature expected to roll out later in 2024.
Generative Playground:
- An internal app where users can create and edit images using AI, with plans to extend these capabilities to iMessage.
System Application Overhauls
Beyond AI enhancements, Apple plans to update several system applications and features:
Settings App:
- A new, cleaner UI will improve organization and search functionality in both iOS and macOS Settings apps.
Control Center:
- The slide-down menu of quick settings in iOS will receive a new music widget and improvements for operating smart home appliances, potentially allowing for more customization of which devices appear.
Messages:
- A new feature will allow users to animate individual words in text messages. Apple will also add new Tapback icons, the reaction emoji-style icons that appear when you long-press a message.
Mail App:
- Several improvements are expected, although specific changes were not detailed.
Photos:
- UI changes are anticipated, enhancing user experience and functionality.
visionOS 2.0
Apple will also announce visionOS 2.0, introducing native versions of first-party apps. Currently, visionOS only features iPad versions of apps like Home, Calendar, Podcasts, and Pages.
Competing with Google and OpenAI
Apple’s push into AI comes as other tech giants like Google and OpenAI are making strides with their own AI solutions, such as Google Gemini and OpenAI’s ChatGPT.
Unlike these competitors, Apple’s AI will run on devices users already own, eliminating the need for additional hardware.
While Apple’s AI features may not yet match the capabilities of Google’s advanced AI, the company’s focus on enhancing its existing ecosystem and ensuring user privacy through on-device processing is a significant advantage.
What to Expect at WWDC
Apple is expected to showcase these AI advancements at its annual Worldwide Developers Conference (WWDC) on June 10.
In addition to the features mentioned, updates to the Calendar, Freeform, and System Settings apps are also anticipated. Some AI features will reportedly come this fall when iOS 18 rolls out.
By integrating these AI capabilities into their core applications and overhauling key system features, Apple is set to potentially enhance the daily experiences of its users, making their devices more intuitive and powerful.
This article is based on insider information reported by AppleInsider and Bloomberg. For more details, you can read the original reports here and here.