Speakatron

From Music Hack Day

by Marek Bereza ([1]), @mazbox

[edit] Description

A program that looks at you through your web cam and plays a sound when you open your mouth. It can tell what shape you're making and how high your mouth is on the screen as synthesis parameters.

Here's a video of the hack in action: http://vimeo.com/14964863

[edit] App and Source

• Mac app: http://code.google.com/p/ofxmarek/downloads/detail?name=singatron.zip
• Mac source: http://code.google.com/p/ofxmarek/downloads/detail?name=singatron-src-oF0061.zip

To get it to work you may have to press spacebar to enable the GUI, then adjust the threshold slider until it starts working.

Press 1, 2, 3 or 4 to try different sounds - I got a cat, a synth, birdsong and buddhist monks. Open the data/patches folder to reveal the pd patches that drive the audio.

[edit] Tech

• openframeworks - creative coding framework in C++[2]
• opencv - machine vision library [3]
• zengarden - Pd C++ static library [4]