Belly of the Beast

Jacob Hedges; Daniel Garrett; Jaxon Sharp

Belly of the Beast
Image credit: Jacob Hedges; Daniel Garrett; Jaxon Sharp

Abstract:

Belly of the Beast is an interactive music VR experience that allows users to dynamically manipulate a spatial musical composition in real time by moving sounds in 3D space, rearranging the structure of the composition, and playing virtual instruments along with the music. Leveraging the unique interactions of hand tracking and head tracking with the Meta Quest 3, This work harnesses XR technologies to reimagine the way we interact with music, allowing users to act as both producer, performer, and audience at once. Built using Unity and Wwise, and drawing inspiration from adaptive game music, the project empowers participants to shape the composition in real time through their movements and gestures. The composition presented is a 5-10 minute, semi-linear experience, where the user’s interactions progress the unfolding of the composition. It is a one headset per user experience, designed to be playable in a 4m x 4m square. The intended installation does not require extensive setup, as it operates with the Meta Quest 3 tethered to a Windows computer running the experience software.