Music visualization, Yanmi Yu, 4/24/2025
SETUP (Before Class Activity):
You’ll need the following:
Your Quest 3
A USB cable to connect your headset to your computer
The SideQuest set up on your computer with downloaded apk
(Optional but recommended) Headphones or earbuds that connects to your computer.
If you’ve already completed previous activities using SideQuest, you may skip this step.
Download SideQuest:
Go to SideQuest and download the Desktop app that matches your operating system.
Create an Account:
If you haven’t already, sign up for a SideQuest account.
Download the APK File:
Download the APK here.
Connect Your Headset:
Plug your headset into your computer via USB and power it on. Make sure it's discoverable.
Install the APK:
Follow the instructions on this guide to sideload the APK file to your headset.
Note: If a previous version of the project is already installed, uninstall it before attempting to install the new file.
The class will be divided into Group 1 and Group 2.
You will explore music notation in 2D and music visualization in AR, with each group experiencing the formats in a different order.
After completing each part of the activity, you’ll be asked to fill out the corresponding section of the survey. The survey includes the following components:
Select your group (Group 1 or Group 2)
Part I
Timed questions
Untimed questions
Part II
Timed questions
Untimed questions
Final Thoughts (open-ended reflection)
Survey [link]
Part I — Song A in 2D:
Wear your headphones/earbuds or turn up your speaker.
Listen the following music for at least 45 seconds. Try to remember the music notation you observe.
Press the play button at the top left to play the song. Here is the link:
Beethoven Sonata No.14 (2D Notation)
Complete the first part of Survey for group 1.
Part II — Song B in AR:
Launch the APK on your headset. Remember to press B to listen to song B!
AR Visualization Mapping:
In the AR experience, musical data is visualized using the dimensions of 3D cubes:
Pitch → Z Position
Duration → Cube Width (X-axis Scale)
Volume → Cube Height (Y-axis Scale)
Use this mapping to help you interpret the patterns you see in the AR visualization.
Use the controller as follows:
Left thumbstick: Move up/down/left/right
Right thumbstick: Move forward/backward, rotate left/right
Button B: Load Song B
Listen for at least 45 seconds. Try to remember the music pattern you observe.
Complete the second part of the same survey for group 1.
(Optional) Part III - experiment song A in AR if you want by pressing button A
Part I — Song A in AR:
Launch the APK on your headset.
AR Visualization Mapping:
In the AR experience, musical data is visualized using the dimensions of 3D cubes:
Pitch → Z Position
Duration → Cube Width (X-axis Scale)
Volume → Cube Height (Y-axis Scale)
Use this mapping to help you interpret the patterns you see in the AR visualization.
Use the controller as follows:
Left thumbstick: Move up/down/left/right
Right thumbstick: Move forward/backward, rotate left/right
Button A: Load Song A
Complete the first part of Survey for group 2.
Part II — Song B in 2D:
Wear your headphones/earbuds or turn up your speaker.
Listen the following music for at least 45 seconds. Try to remember the music notation you observe.
Press the play button at the top left to play the song. Here is the link:
https://www.noteflight.com/music/titles/f15e8096-60e8-45e7-a2fa-196ba26ac029/nocturne-op-9-no-2
Press the play button at the top left to play the song.
Listen for at least 45 seconds. Try to remember the music notation you observe.
Complete the second part of the same survey for group 2.
(Optional) Part III - experiment song B in AR if you want by pressing button B