Apple Intelligence Comes to Vision Pro with visionOS 2.4 Update
Apple has confirmed that its generative AI platform, Apple Intelligence, will be coming to the Vision Pro as part of the visionOS 2.4 update. The beta version of the software is currently available for developers, with the public version set for an April release.
Wave of Updates
Like the iPhone and Mac, the Vision Pro will receive Apple Intelligence updates in waves. The first wave includes several familiar offerings, primarily focused on generating text and images. The company sees the addition of features like Rewrite, Proofread, and Summarize as key components for on-device workflow.
Improving Text Composition
One of the challenges with composing text on the headset is the default typing method, which requires looking at a letter and pinching two fingers together to select. While well-implemented, this method can be cumbersome for writing more than a word or two at a time. Voice dictation helps to address this bottleneck, and Apple’s recent AI-powered Siri supercharge bodes well for the smart assistant’s Vision Pro future.
Image Generation
Image Playground is another big piece of the puzzle, bringing image generation to the wearable display as part of the visionOS 2.4 update. This feature is integrated directly into the visionOS Photos app, allowing users to create images through verbal prompts.
Vision Pro iPhone App
Along with visionOS 2.4, Apple has also launched a Vision Pro iPhone app, arriving with iOS 18.4, which is also now in beta. The app allows users to browse visionOS content, such as TV shows and movies, which can then be transferred onto the headset. This feature appears to be a response to the limitations of wearing the headset, both in terms of personal comfort and battery life.
Managing Guest Accounts
The app can also be used to manage guest accounts, with the Vision Pro prompting its owner when someone is attempting to sign in as a guest. A streaming image of the guest’s in-headset view is accessible through the new app.
Conclusion
The integration of Apple Intelligence in visionOS 2.4 brings a new level of efficiency and creativity to the Vision Pro, making it an even more powerful tool for daily use. With the addition of image generation and text composition features, users will be able to work and play in new and innovative ways.
FAQs
Q: When will the visionOS 2.4 update be available?
A: The public version of visionOS 2.4 is set for an April release.
Q: What features are included in the first wave of Apple Intelligence updates?
A: The first wave includes features like Rewrite, Proofread, and Summarize, primarily focused on generating text and images.
Q: How does the Vision Pro iPhone app work?
A: The app allows users to browse visionOS content, such as TV shows and movies, and transfer it onto the headset. It also allows for managing guest accounts and viewing the guest’s in-headset view.
