Metabow: Gesture Mapping in Immersive Sonic Environments

Davor Vincze; Roberto Alonso; Peter Nelson

Metabow: Gesture Mapping in Immersive Sonic Environments
Image credit: Davor Vincze; Roberto Alonso; Peter Nelson
  • Format: poster
  • Session: posters-3
  • Presence: in person
  • Duration: 5
  • Type: short

Abstract:

This paper presents the MetaBow, an augmented violin bow designed to control digital sound processing through real-time motion tracking. We discuss the challenges of mapping Inertial Measurement Unit (IMU) data to audio parameters in immersive multi-speaker environments and propose hybrid strategies using both direct mapping and machine learning models. We reflect on design choices, trade-offs, and performer experience, drawing from technical development and performance contexts. Three condensed case studies illustrate the system’s versatility in spatial and interactive musical performance.