Skip to main content
Course overview
Skip to - Close
Skip to - Close

Sound Gesture Intelligence

Sound Gesture Intelligence

Completion requirements

Dr. Greg Beller

Direct mapping between voice and gesture

Dynamics of the gesture

To play aerial percussion, you will need a controller embedding dynamic sensors such as accelerometers or gyroscopes: R-IoT accelerometers, Nintendo Wii controller, Genki Wave Ring or your smartphone.

XBEE Sensor (Tinoco, 2016)

Genki Wave Ring (Tinoco, 2016)


Inside-view of a R-IoT sensor (Tinoco, 2016)

Inside-view of a Nintendo-Wii remote controller (Tinoco, 2016)

Depending on the sensor used, you'll have access to 6 or 9 Dof (Degrees of freedom). 

9 Dof (Degrees of freedom) sensor made of a 3-Axis accelerometer (left) 3-Axis gyroscope (center) and 3- Axis magnetometer (right). Figure from Longan Docs

Your smartphone, tablet or smartwatch contains these sensors, and you can use them to play aerial percussions. The easiest way to do this is to use the CoMo.te app, available for Android or iOS, in conjunction with the CoMo.te Max package.

CoMo.te app, available for Android or iOS, in conjunction with the CoMe.te Max package.