Zum Hauptinhalt

Sound Gesture Intelligence

Dr. Greg Beller

Direct mapping between voice and gesture

Aerial percussion

Once the data from your smartphone's accelerometers and gyroscopes has been received in your Max patch, it needs to be processed to transform it into sound-triggering events. To do this, we use the [link] Gestural Sound Toolkit v2 (Caramiaux 2015).

edu sharing object

Gestural Sound Toolkit v2 – Toolkit in Max/MSP for gesture-to-sound scenario prototyping (Caramiaux 2015).


With this combination of an application and two packages, you can trigger sounds in Max from your smartphone.


Exercise: The Skatphone

Build a Max patch that triggers vocal sounds with a smartphone using the CoMo.te app, CoMo.te Max Package and the Gestural Sound Kit v2.