Bruno Zamborlin hat mit einem Kontaktmikro ein Gestenerkennungssystem programmiert, das auf jeder Oberfläche funktioniert. Toll!
Mogees is an interactive gestural-based surface for realtime audio mosaicing. In the video […] we show how it is possible to perform gesture recognition just with contact microphones.
Through gesture recognition techniques we detect different kind of fingers-touch and associate them with different sounds. In the video we used two different audio synthesis techniques:
- physic modelling, which consists in generating the sound by simulating physical laws;
- concatenative synthesis (audio mosaicing), in which the sound of the contact microphone is associated with its closest frame present in a sound database.
The system can recognise both fingers-touches and objects that emits a sound, such as the coin shown in the video.