Apple Vision Pro
Links and Resources
visionOS XCode Development Tutorial (visionOS download only works for Apple Silicon or macOS ventura (old version). Developers are not happy about this, but unlikely that Apple will allow Intel since they are planning to cut support for future OS updates for Intel soon.)
Unity Polyspatial License
Unity Polyspatial Tutorial
Unity Support
Unity apps are supported on AVP with Unity's Polyspatial framework. This is not an out of the box solution, and will require modifying existing Unity apps to support AVP. Additionally, it requires a Unity Pro or Enterprise license, the former costing $2040 / yr and is not included in the Unity student plan.
Developer App Integration
Apple supposedly allows developers to test out their apps on AVP through two options: connecting through bluetooth or a $300 USB-C dongle.
Here is a tutorial for connecting via bluetooth and selecting AVP as the compilation target in Xcode on Mac. So far, although we have been able to pair the AVP with Mac, we have not been able to get Xcode to show the AVP as a target. Here is our stack overflow post and apple forum post detailing our woes.
Basic Information
"If you’ve used a Meta Quest, just imagine the best possible Meta Quest running something very much like iPadOS, and you’ll get it." - The Verge
On June 5, 2023, at WWDC, Apple unveiled a new mixed reality headset called the Apple Vision Pro. This headset supports both virtual and augmented reality through an outward display nicknamed , allowing you to switch between modes using a digital crown dial. It weighs a little less than a pound, appears similar in shape to a pair of ski goggles, and is expected to be released for sale to the public in early 2024. At $3499, this headset is a lot more expensive than the line of Quest headsets made by Meta, but granted the Vision Pro also has much better specs. It contains a micro-OLED display that has 23 million pixels in total, which is more than equivalent to 4K resolution per eye, 12 cameras, a LIDAR sensor, and a TrueDepth Camera. Users have the option of using the built-in spatial audio system, which has dual-driver audio pods next to each ear, or using the headset with Airpods Pro 2nd Generation.
The headset also has a dual-chip design, including the M2 system-on-chip that is used in new-generation Macbooks, as well as the brand new R1 chip that is optimized for processing input from sensors and streaming to displays with 12 ms latency.
Instead of using face ID as is standard on iPhones, the Vision Pro headset uses Optic ID, which takes a scan of your irises, and uses that to authorize purchases and unlock passwords. This biometric data is stored in a special highly secure portion of hardware known as the Secure Enclave.
Because the camera cannot fully capture the wearer's face, it generates a 3D scan of the face by stitching together multiple internal camera angles.
The headset can be used while connected to power or to an external portable battery that is tethered to the side of the headset. This battery supports up to 2 hours of usage.
https://www.apple.com/apple-vision-pro/
https://www.theverge.com/2023/6/5/23750003/apple-vision-pro-hands-on-the-best-headset-demo-ever
Extensive review from March 2024 praising hardware, characterizing device as a devkit, and dis-ing software https://hugo.blog/2024/03/11/vision-pro/
Operating System
The headset will run on visionOS, Apple's first spatial Operating System. It is a completely controller-free OS that uses hand-tracking and includes support for basic iOS applications, such as Photos, Safari, Apple TV, Music, Mail, as well as external applications that can be developed using SwiftUI, RealityKit, ARKit, and Unity. It already supports external applications such as Adobe Lightroom, Microsoft Teams/Office, and Zoom.
Developers have the option of creating any combination of windows (2D), volumes (small 3D), and spaces (immersive 3D) for their app. Windows can be created with SwiftUI, Apple's development framework specifically for creating user interfaces. Volumes can be created through a combination of SwiftUI scenes and RealityKit, ARKit, or Unity.
Developers also have the option of developing on Xcode, which now has suport for 3D content using a package called Reality Composer Pro, or developing on Unity, which will also include integration support for the Vision Pro.
AVP2 Rumours
Apple is reportedly working on a cheaper follow-up to the Apple Vision Pro, which is rumoured to be priced in the range of $1500 - $2500. It may run on an iPhone chip rather than a Macbook chip, have fewer cameras and have lower-resolution screens inside. It also may optionally come with prescription lenses and not have an external display, which means it will no longer have the EyeSight feature that allows the wearers eyes to remain visible while using the headset.