Sound Gesture Intelligence: Dynamics of the gesture

Sound Gesture Intelligence

Dr. Greg Beller

Direct mapping between voice and gesture

Dynamics of the gesture

To play aerial percussion, you will need a controller embedding dynamic sensors such as accelerometers or gyroscopes: R-IoT accelerometers, Nintendo Wii controller, Genki Wave Ring or your smartphone.

Inside-view of a R-IoT sensor (Tinoco, 2016)

Inside-view of a Nintendo-Wii remote controller (Tinoco, 2016)

Depending on the sensor used, you'll have access to 6 or 9 Dof (Degrees of freedom).

9 Dof (Degrees of freedom) sensor made of a 3-Axis accelerometer (left) 3-Axis gyroscope (center) and 3- Axis magnetometer (right). Figure from Longan Docs

Your smartphone, tablet or smartwatch contains these sensors, and you can use them to play aerial percussions. The easiest way to do this is to use the CoMo.te app, available for Android or iOS, in conjunction with the CoMo.te Max package.