Zum Hauptinhalt

Sound Gesture Intelligence

Dr. Greg Beller

Direct mapping between voice and gesture

Dynamics of the gesture

[This poge is under construction. –Editor] 

To play aerial percussion, you will need a controller embedding dynamic sensors such as accelerometers or gyroscopes: R-IoT accelerometers, Nintendo Wii controller, Genki Wave Ring or your smartphone.

An ex-bee sensor held between thumb and forefinger.

XBEE sensor


R-IoT sensor - inside view

R-IoT sensor, inside view


edu sharing object

Genki Wave ring



Inside view of a Nintendo Wii remote controller.

Nintendo-Wii remote controller


Controllers embedding dynamic sensors such as accelerometers or gyroscopes. Top left an XBEE sensor; Bottom left, an inside-view of a R-IoT sensor; Top right, a Genki Wave ring; Bottom right an inside-view of a Nintendo-Wii remote controller (Tinoco 2016).

Depending on the sensor used, you'll have access to 6 or 9 Dof (degrees of freedom).

edu sharing object

Nine DoF (degrees of freedom) sensor made of a 3-axis accelerometer (left), 3-axis gyroscope (centre) and 3-axis magetometer (right).


Your smartphone, tablet or smartwatch contains these sensors, and you can use them to play aerial percussions. The easiest way to do this is to use the CoMo.te app, available for Android or iOS, in conjunction with the CoMo.te Max package.

edu sharing object

CoMo.te app, available for Android or iOS, in conjunction with the CoMe.te Max package.