Created ongyu Zhou, March 2022
Revised by Yanmi Yu, May 2025
The immersion of VR spaces allows audio to be experienced in rich ways that were previously difficult to understand. These new modalities for interaction and embodiment can introduce unique experiences that span data visualization, telepresence, collaboration, and entertainment. Depending on each visualizer's purpose, different affordances were introduced to produce natural combinations of what is audible and visible. Here, I describe several categories of VR audio visualization software and research that suit these different purposes.
Chromesthesia is a specific type of synesthesia where color is perceived in response to a particular stimulus, in this case, sound. As it is difficult for those who do not experience this phenomenon to understand its ramifications, many VR visualizers focus on creating discernible visuals to replicate its effect.
Benjamin Outram developed a VR system that maps colors to the frequency spectrum using a logarithmic scale, aligning with human pitch perception. The system features an "orbital mode" interaction technique, allowing users hands-free observation and navigation within the virtual environment. This approach enables users to experience music visually, with colors and shapes representing different sound frequencies.
Chromesthesia VR is a music visualizer that synchronizes over 30 different visual effects with imported music. Users can experience a dynamic display of colors, lights, and shapes that react in real-time to the audio, creating an immersive environment that enhances the perception of music through visual stimuli.
Aleksei Tepljakov and colleagues introduced methods for detecting the source of sound in a 3D space around the user. Their system transforms audio signals into visual shapes, where the size of each shape corresponds to the loudness of the sound source, and the color represents the dominant spectral component. This real-time visualization aids in understanding spatial audio dynamics within virtual environments.
Synesthesia VR is an application that simulates the experiences of individuals with synesthesia, a condition where stimulation of one sensory pathway leads to automatic experiences in another. The app recreates how four synesthetes perceive sounds as colors, allowing users to experience this cross-sensory phenomenon through immersive VR environments
A soundscape describes the acoustic environment as perceived by humans. Understanding soundscapes can reveal important information about the organisms and events that occur within that environment.
This research focuses on visualizing sound propagation in closed rooms using a technique called Phonon Tracing. By simulating how sound waves travel and interact within enclosed spaces, the study provides insights into acoustic behaviors, aiding in the design of spaces with optimal sound qualities.
This study introduces a methodology to assess the role of noise in the audio-visual design of urban public spaces. Utilizing Virtual Reality (VR) technology, the researchers evaluated how different noise levels and visual designs impact the overall appreciation of urban environments, emphasizing the importance of integrating sound considerations into urban planning.
Investigating the effects of audio-visual interactions on urban soundscapes, this study examines how combined auditory and visual elements influence human satisfaction in urban environments. Findings suggest that both sound and visual components significantly affect perceptions of urban spaces, highlighting the need for holistic design approaches.
ImmerSound is an innovative virtual reality (VR) experience developed at the MIT Media Lab's Opera of the Future group. It enables users to compose music by drawing in 3D space, creating a sculpted soundscape that is both visually and aurally immersive
Unsurprisingly, the majority of these audio visualizers were actually created for entertainment -- to visualize the mood of a piece of music in a scene, to sync with a brush, or to serve as a game. Visualizers in this category boast bold visuals and flashy effects to attract users.
Beat Saber is a highly acclaimed VR rhythm game where players wield two colored sabers to slash through blocks representing musical beats. The game features a variety of music genres and offers multiple difficulty levels, making it accessible to both newcomers and seasoned players. Its immersive gameplay and energetic soundtrack provide a compelling experience that combines music, movement, and visual effect
Vision is a VR application that animates colors, lights, and shapes based on audio input, creating a dynamic and immersive visual experience. Users can customize the visualizations to match their preferences, allowing for a personalized interaction with their music. While specific details about "Vision" are limited, it represents a category of VR music visualizers that transform auditory experiences into captivating visual displays.
Soundscape Universe is an expansive VR platform that simulates music festivals within audio-reactive fantasy worlds. Users can explore various immersive environments, each designed to respond dynamically to music, creating a unique and interactive concert experience. The platform supports both solo exploration and social interactions, allowing users to attend virtual concerts, interact with others, and even participate in live events.
Gravity is a virtual reality music visualizer that places you in the middle of an audio-reactive environment. As soon as you start, you'll find yourself surrounded by visuals that respond dynamically to the music, creating an immersive experience.
This application allows you to sit back, relax, and enjoy your favorite music surrounded by audio-reactive visual effects. You can play any audio track on your Quest, and the visuals will adapt in real-time to the music.
Available on the Oculus Go app store, Virtual Music allows users to manually load music and immerse themselves in visualizations of audio frequency. It provides a number of visualization configurations, enhancing the auditory experience with corresponding visuals.