🗞️ Exciting news! @Apple has signed a deal with @OpenAI to bring chatbot functionality to iPhones. Despite this, they’re still negotiating with Google to offer Gemini as an additional option. Curious to see how this plays out next month! https://t.co/sCf1LWcJOX#AI #TechNews…
— Charlie Muirhead (@CharlieMuirhead) May 29, 2024
Apple is planning to introduce new AI features, including Smart Replies for messages and a generative retouch tool for photos. The latest insights into iOS 18 reveal widely anticipated AI enhancements.
Key rumored upgrades include improved responses with a new smart response framework that considers entities such as people, companies, calendar events, locations, and dates. Users can also expect more natural voices with better text-to-speech functionality and the ability to use Siri on one device to control playback on another, such as via the Apple Watch.
However, this feature is not expected until later in 2024.
Apple is betting that its giant user base will make the company a leader in AI, even if its technology lags behind, @markgurman reports in this week’s Power On https://t.co/sWBvLUPV77 via @technology
— Paul Triolo (@pstAsiatech) May 28, 2024
Additionally, users will be able to request an overview of their recent notifications via Siri.
Additional AI-powered features for specific apps in iOS 18 include Smart Replies, which allows users to reply to messages and emails with automatically generated text responses.
AI enhancements in iOS 18
The Notes app will also see new AI tools for editing audio, transcribing audio, and summarizing text.
Support for proper mathematical notation in the Notes app with Calculator app integration will allow the app to recognize mathematical equations, generate solutions, and create graphs. Enhancements for inputting mathematics will enable complex mathematical expressions to be completed, similar to predictive text.
A generative retouch tool will allow users to remove objects from photos using generative AI, replacing Apple’s current “Retouch” feature.
I'm still not sure I buy this. Why would Apple partner with such an open-borders entity? It's unusual for a company that prizes control over almost everything else.
iOS 18 could finally make Siri useful again thanks to rumored ChatGPT deal https://t.co/bIgO225c8k
— Lance Ulanoff (@LanceUlanoff) May 30, 2024
The company is also working on a “Generative Playground” application that uses generative AI to create and edit images with an iMessage app extension.
Initially designed for Apple’s internal tests, it indicates plans to allow users to generate and share images via iMessage. These features are expected to be previewed during Apple’s WWDC keynote on June 10, with a public release in September.
The iOS 18 announcement will likely include updates to the Calendar and Freeform apps, redesigned Voice Commands UI, and improved text predictions via Apple’s Transformer LM.
