Turn Hand And Body Movements Into Music With This Gesture-Based Instrument

When it comes to music we’re used to moving our body to dance to it (however badly), but not so much when it comes to creating it. But with the gesture-based Dodecaudion—shaped like a dodecahedron—hand and body movements are used to generate the sounds, rather than just respond to them.

The open source project, from Polish new media art collective panGenerator, uses infrared distance sensors, Arduino, Bluetooth, Processing, OSC, and a synthesizer to convert the user’s hand and body movements into music. It can also be used to create visuals along with the sounds, turning the user into some kind of magical audiovisual conjurer.

But the project is more than just an experimental AV instrument, instead the device turns the sometimes staid act of electronic music making into a performance art. Jakub Koźniewski, from panGenerator, explains this in the TEDTalk below, which starts with a performance from Madie Bovska. He explains that the collective wanted the gestures to be just as important as the music they created, saying: “The main concept, the key idea behind this project, was to create a new means of expression in electronic live music.”


Leave a Reply

Please log in using one of these methods to post your comment:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s