The Shadow Harvester: Sonifying the Body Through Light

Darlene Castro

Image credit: Darlene Castro

• Format: poster
• Session: posters-2
• Presence: in person
• Duration: 5
• Type: medium

Abstract:

This paper explores the use of a violinist’s shadow as input for a NIME prototype called the Shadow Harvester. For centuries, shadows have captivated humanity’s imagination, and this project follows many artists, philosophers, and researchers equally captivated by the potential of shadows and silhouettes. This interface consists of a semi-translucent screen embedded with light-detecting sensors. These sensors register the movement of the violinist’s shadow and produce data that can be mapped to generate, trigger, or process sound in Max/MSP. The Shadow Harvester turns a human shadow into a real-time, life-size avatar, splitting the attention of the violinist between their shadow self and carnal self. They are ensnared in a web of sensors that require the same attention as the visceral joints in their body because any movement carries sonic repercussions through either their physical body playing the violin or their shadow body “playing” this interface. The Shadow Harvester creates a highly entangled feedback loop between the violinist, centuries of violin performance practice, and composition. As such, it carries the potential to encourage new ways of incorporating movement into the folds composition, notation, and performance.