Sound Gesture Intelligence
Dr. Greg Beller
Direct mapping between voice and gesture
Dynamics of the gesture
[This poge is under construction. –Editor]
To play aerial percussion, you will need a controller embedding dynamic sensors such as accelerometers or gyroscopes: R-IoT accelerometers, Nintendo Wii controller, Genki Wave Ring or your smartphone.
XBEE sensor
R-IoT sensor, inside view
Genki Wave ring
Nintendo-Wii remote controller
Controllers embedding dynamic sensors such as accelerometers or gyroscopes. Top left an XBEE sensor; Bottom left, an inside-view of a R-IoT sensor; Top right, a Genki Wave ring; Bottom right an inside-view of a Nintendo-Wii remote controller (Tinoco 2016).
Depending on the sensor used, you'll have access to 6 or 9 Dof (degrees of freedom).
Nine DoF (degrees of freedom) sensor made of a 3-axis accelerometer (left), 3-axis gyroscope (centre) and 3-axis magetometer (right).
Your smartphone, tablet or smartwatch contains these sensors, and you can use them to play aerial percussions. The easiest way to do this is to use the CoMo.te app, available for Android or iOS, in conjunction with the CoMo.te Max package.
CoMo.te app, available for Android or iOS, in conjunction with the CoMe.te Max package.