Sonifying the MindCube through AI-Generated Music

Fangzheng Liu; Lancelot Blanchard; Don D Haddad; Joseph Paradiso

• Format: poster
• Session: posters-3
• Paper link

Abstract:

In this work, we explore the musical interface potential of the MindCube, an interactive device designed to study emotions. Embedding diverse sensors and input devices, this interface resembles a fidget cube toy commonly used to help users relieve their stress and anxiety. As such, it is a particularly well-suited controller for musical systems that aim to help with emotion regulation. In this regard, we present two different mappings for the MindCube, with and without AI. With our generative AI mapping, we propose a way to infuse meaning within a latent space and techniques to navigate through it with an external controller. We discuss our results and propose directions for future work.