Sound Gesture Intelligence

In this unit, you discovered some links between voice and gesture. You have used this natural proximity to create new intuitive musical instruments that allow you to manipulate sound with your hands. These instruments have enabled you to tackle, with increasing complexity, the notion of machine learning to model the temporal relationship between multimodal data. Various physical gesture sensors were introduced and compared. Libraries for gesture processing and machine learning were presented. Their uses have been demonstrated in different artistic contexts for pedagogical purposes. The exercises enable you to make them your own, and incorporate them into your artist's studio. Now it's your turn to create with these tools and make them even better!