Update: just use Epic games tutorial

Setting Up Unreal Engine 5.4 for Apple Vision Pro Development

Unreal Engine 5.4 provides experimental support for full-immersion experiences on Apple Vision Pro. Below are basic instructions for starting, follow the Unreal Engine 5.4 VisionOS Build on Apple Vision Pro tutorial for a more complete walkthrough. Or this one from Epic Games. 

1. Install Unreal Engine 5.4 or Later: Ensure you have Unreal Engine version 5.4 or newer, as this version includes the necessary support for Vision Pro development. You can download it from the Epic Games Launcher.

2. Download Vision Pro SDK and Xcode. 

Prerequisites:

• Apple Vision Pro paired with your Mac

• Apple developer account

• Xcode 15.3 installed

Step 1: Set Up Xcode

1. Download Xcode 15.3 from Apple's developer site, unzip, and install it.

2. Rename any old version of Xcode to avoid conflicts.

3. Once ready, open Xcode 15.3 and navigate to Settings.

4. Ensure iOS 17.4 and VisionOS 11 are enabled.

5. Open Xcode and make sure it's set up correctly before proceeding.

Step 2: Unreal Engine Preparation

1. Go to the Unreal Engine GitHub and download version 5.4 as a ZIP file.

2. Extract the folder and move it to an external drive if preferred (e.g., Unreal Engine 5.4, Unreal Engine 5.5, etc.).

Step 3: Terminal Setup

1. Open Terminal and run:
   sudo spctl --master-disable

   • Enter your password when prompted. This command allows project files to run without extra verification.

2. Go to System Settings > Privacy & Security, and ensure apps are allowed from anywhere.

Step 4: Set Up Unreal Engine 5.4

1. Navigate to the Unreal Engine 5.4 directory and run Setup.command to download required dependencies.

2. Run GenerateProjectFiles.command to create the necessary project workspace files.

3. Open Xcode and select the Unreal Game target. Change it to Unreal Editor.

4. Navigate to Product > Build to compile the project. This will take a while.

5. Once complete, go to Binaries > Mac and open Unreal Editor.app.

6. Allow permissions as prompted for the external drive.

Step 5: Create a VR Project

1. Once the editor is open, select Games > Virtual Reality Template.

2. Set up the directory where the project will be saved.

3. Go to Edit > Plugins and enable OpenXR Vision OS (it’s in beta).

4. Enable Vision Pro Platform:

   • Platforms > Supported Platforms > Check Vision OS.

5. Turn off Anti-Aliasing to prevent performance issues (optional).

Step 6: Adjust Project Settings

1. Turn off iOS Mobile Rendering and enable Metal Desktop Renderer in Project Settings.

2. Add your Dev Team ID and Bundle ID in Xcode Info (e.g., com.company.app).

3. Add required PList permissions in Additional PList Data under project settings.

4. Convert your project to a code project:

   • Tools > New C++ Class > Create a new class and restart the editor when prompted.

5. Turn off Dynamic Shadows if experiencing performance issues (optional).

Step 7: Packaging and Deploying

1. Go to Package Project > Platforms > Vision OS and package the build.

2. Select a location (e.g., project directory). This will take time.

3. Once successful, locate the generated app.

4. Open Xcode > Window > Devices and Simulators > Select Apple Vision Pro.

5. Click the + button to add your app. Deploy it to the Vision Pro headset.

Debugging (Optional)

• If you need detailed logs and debugging:

  1. Open the Vision OS workspace in Xcode.

  2. Ensure the correct target is Apple Vision Pro.

  3. Hit the Play button to build and push the app.

  4. Unlock your headset if required for deployment.

  5. Debugging takes longer, but it is crucial for investigating crashes and missing data.

Notes for Speed Optimization

• For quick testing, deploying directly through Devices and Simulators is faster than rebuilding each time in Xcode.

• Dynamic shadows can be turned off for better performance, especially when running multiple complex objects.