Computer Vision Gestures – Isaiah Fleischer
For this project I was inspired by my discover weekly playlist on Spotify. Every now and then a song will come on that’s just so good you want to play along with it. You’ll find yourself doing air-guitar, jamming on a drum kit, or even playing a theremin! A good example of a song like this is Weak by AJR:
My patch works identical to a real-life theremin, with the right hand controlling volume and the left hand controlling pitch. I was hoping to be able to actually play along with songs with this patch, but OpenCV wasn’t fast enough to maintain a lock on my hands when I moved them with a song. Regardless, it’s a lot of fun, and could serve as a nice break during homework sessions.
In the future it would be nice to add extra effects for the hands, such as drums playing when I open/release a fist.
Here is the patch. It’s cleaned up visually and functions the same as the one in the video.
Cool interactivity. Good use of commands we didn’t cover in class, it was very creative.
Cool use of both hand trackers in order to play a higher pitch.
Really cool project! Would be cool if this was adjusted to a beat that you could change and maybe that would make playing it along with songs easier.