Apple Intelligence Becomes More Powerful with New Features Across Devices
Cupertino, California – Apple has unveiled enhanced Apple Intelligence capabilities aimed at enriching user experiences across its product range, including the iPhone, iPad, Mac, Apple Watch, and Apple Vision Pro. These new advancements introduce features such as Live Translation, improved visual intelligence, and creative enhancements like Image Playground and Genmoji. Developers will now have direct access to the on-device foundational model to create smarter, more private applications.
Enhanced Communication with Live Translation
Live Translation aims to bridge language gaps, enabling seamless communication in messaging and calls. Integrated across Messages, FaceTime, and Phone, Apple’s proprietary models run locally, ensuring privacy during conversations. For instance, users can send messages that are automatically translated in real-time, receive immediate translations during FaceTime calls, and hear spoken translations during phone conversations.
Creative Expression with Genmoji and Image Playground
Genmoji and Image Playground have been updated to offer users expanded creative options. Users can now blend emoji with text descriptions to generate unique Genmojis and create images inspired by friends. Image Playground introduces new styles through ChatGPT and allows users to describe desired outcomes, producing distinct images while maintaining control over their data.
Visual Intelligence Enhancements
Building on Apple Intelligence, the visual intelligence feature enables users to interact with content on their iPhone screens effectively. Users can inquire about objects using ChatGPT or search for similar items from various apps. It will also suggest calendar events based on what users are currently viewing, extracting pertinent information to facilitate event creation.
Workout Buddy on Apple Watch
Introducing Workout Buddy, an innovative workout feature on the Apple Watch powered by Apple Intelligence. Analyzing fitness data, it provides personalized and motivational insights during workouts. This experience leverages real-time analytics to inspire users, presenting dynamic feedback through an engaging voice model created from Fitness+ trainers.
Developer Access to On-Device Model
Apple is now providing developers with direct access to the on-device model driving Apple Intelligence. The Foundation Models framework allows app creators to implement intelligent features without incurring cloud API costs, ensuring privacy and offline functionality. Developers can easily integrate this advanced model into existing applications with minimal code.
Additional Features and Availability
Apple Intelligence is also integrated into various apps, helping users manage their daily tasks more efficiently. Upcoming language support will expand to eight new languages later this year, and selected features will be available for testing. Users with compatible devices set to the right languages will gain access to these enhancements this fall, reinforcing Apple’s commitment to innovation while prioritizing user privacy.