a video theremin based on PoseNet

veremin qr code


A video theremin that allows you to make beautiful music just by waving your arms!


After the video loads, it will include an overlay with skeletal and joint information detected by PoseNet. The overlay also include two adjacent zones/boxes. Move your wrists within each of the zones to make sounds.

Move your right hand/arm up and down (in the right zone) to generate different notes.

Move your left hand/arm left and right (in the left zone) to adjust the velocity of the note.


At a minimum, your browsers must allow access to a webcam and support the Web Audio API.

If your browser supports the Web MIDI API, you can connect a MIDI synthesizer to your computer or you can download and run a software synthesizer such as SimpleSynth.

Also, if you have access to a MQTT broker that supports WebSockets you can enable and publish the positional data to the broker for other devices or applications to subscribe to.

Depending on your browser, you may need to access this application using the https protocol instead of the http.

Check out the README for more information.