Metabow: Gesture Mapping in Immersive Sonic Environments

Davor Vincze; Roberto Alonso; Peter Nelson

Image credit: Davor Vincze; Roberto Alonso; Peter Nelson

• Format: poster
• Session: posters-3
• Paper PDF link
• Presence: in person
• Duration: 5
• Type: short

Abstract:

This paper presents the MetaBow, an augmented violin bow designed to control digital sound processing through real-time motion tracking. We discuss the challenges of mapping Inertial Measurement Unit (IMU) data to audio parameters in immersive multi-speaker environments and propose hybrid strategies using both direct mapping and machine learning models. We reflect on design choices, trade-offs, and performer experience, drawing from technical development and performance contexts. Three condensed case studies illustrate the system’s versatility in spatial and interactive musical performance.