{"id":1338,"date":"2018-11-28T22:39:05","date_gmt":"2018-11-29T03:39:05","guid":{"rendered":"http:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/?p=1338"},"modified":"2018-11-28T22:39:05","modified_gmt":"2018-11-29T03:39:05","slug":"isaiah-fleischer-computer-vision-gestures","status":"publish","type":"post","link":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/idfleischer\/isaiah-fleischer-computer-vision-gestures\/","title":{"rendered":"Isaiah Fleischer &#8211; Computer Vision Gestures"},"content":{"rendered":"<h5>Computer Vision Gestures &#8211; Isaiah Fleischer<\/h5>\n<p><iframe loading=\"lazy\" width=\"1000\" height=\"563\" src=\"https:\/\/www.youtube.com\/embed\/Btm3c4GWYBc?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/p>\n<p>For this project I was inspired by my discover weekly playlist on Spotify. Every now and then a song will come on that&#8217;s just so good you want to play along with it. You&#8217;ll find yourself doing air-guitar, jamming on a drum kit, or even playing a theremin! A good example of a song like this is\u00a0<em>Weak\u00a0<\/em>by AJR:<\/p>\n<p><iframe loading=\"lazy\" width=\"1000\" height=\"563\" src=\"https:\/\/www.youtube.com\/embed\/txCCYBMKdB0?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/p>\n<p>&nbsp;<\/p>\n<p>My patch works identical to a real-life theremin, with the right hand controlling volume and the left hand controlling pitch. I was hoping to be able to actually play along with songs with this patch, but OpenCV wasn&#8217;t fast enough to maintain a lock on my hands when I moved them with a song. Regardless, it&#8217;s a lot of fun, and could serve as a nice break during homework sessions.<\/p>\n<p>In the future it would be nice to add extra effects for the hands, such as drums playing when I open\/release a fist.<\/p>\n<p>Here is the patch. It&#8217;s cleaned up visually and functions the same as the one in the video.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-1339\" src=\"http:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/CV-800x620.png\" alt=\"\" width=\"800\" height=\"620\" srcset=\"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/CV-800x620.png 800w, https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/CV-768x596.png 768w, https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/CV-387x300.png 387w, https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/CV.png 967w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Computer Vision Gestures &#8211; Isaiah Fleischer For this project I was inspired by my discover weekly playlist on Spotify. Every now and then a song will come on that&#8217;s just so good you want to play along with it. You&#8217;ll find yourself doing air-guitar, jamming on a drum kit, or even playing a theremin! A&#8230; <\/p>\n<div class=\"link-more\"><a href=\"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/idfleischer\/isaiah-fleischer-computer-vision-gestures\/\">Read More<\/a><\/div>\n","protected":false},"author":100,"featured_media":1359,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"cybocfi_hide_featured_image":"","footnotes":""},"categories":[19],"tags":[],"class_list":["post-1338","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-computer-vision-gestures"],"jetpack_featured_media_url":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/theremine.jpg","_links":{"self":[{"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/posts\/1338","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/users\/100"}],"replies":[{"embeddable":true,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/comments?post=1338"}],"version-history":[{"count":1,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/posts\/1338\/revisions"}],"predecessor-version":[{"id":1360,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/posts\/1338\/revisions\/1360"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/media\/1359"}],"wp:attachment":[{"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/media?parent=1338"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/categories?post=1338"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/tags?post=1338"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}