{"id":1375,"date":"2018-11-29T05:22:52","date_gmt":"2018-11-29T10:22:52","guid":{"rendered":"http:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/?p=1375"},"modified":"2018-11-29T05:23:25","modified_gmt":"2018-11-29T10:23:25","slug":"aidan-sensiba-computer-vision-gestures","status":"publish","type":"post","link":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/alsensiba\/aidan-sensiba-computer-vision-gestures\/","title":{"rendered":"Aidan Sensiba &#8211; Computer Vision Gestures"},"content":{"rendered":"<p>This project is somewhat of a mix between a basic piano and a theremin. I enjoy playing the piano as a hobby, and I wanted to incorporate that into my work through physical movement and audio. In this, there are five tones ascending a musical scale that can be played by moving the orange paper note horizontally across the screen. This can be done in any order or rhythm, and the volume can be controlled by moving the note up and down.<\/p>\n<p>One of the challenges I faced was getting the computer vision to sync up correctly with a certain object. For this, I used the color tracking patch, where I selected the orange color of the note that the program would follow. I found that uniformly colored objects under bright, white lights were fairly easy to track. Another obstacle was getting the tones to change pitch and volume smoothly, which just took some tweaking to fix.<\/p>\n<p>&nbsp;<\/p>\n<p><iframe loading=\"lazy\" width=\"1000\" height=\"750\" src=\"https:\/\/www.youtube.com\/embed\/EZ5xRBpegWg?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/p>\n<p>&nbsp;<\/p>\n<p>The Max patch<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-1376\" src=\"http:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/Capture-computer-vision-800x430.png\" alt=\"\" width=\"800\" height=\"430\" srcset=\"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/Capture-computer-vision-800x430.png 800w, https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/Capture-computer-vision-768x413.png 768w, https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/Capture-computer-vision-1024x550.png 1024w, https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/Capture-computer-vision-559x300.png 559w, https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/Capture-computer-vision.png 1171w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><\/p>\n","protected":false},"excerpt":{"rendered":"<p>This project is somewhat of a mix between a basic piano and a theremin. I enjoy playing the piano as a hobby, and I wanted to incorporate that into my work through physical movement and audio. In this, there are five tones ascending a musical scale that can be played by moving the orange paper&#8230; <\/p>\n<div class=\"link-more\"><a href=\"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/alsensiba\/aidan-sensiba-computer-vision-gestures\/\">Read More<\/a><\/div>\n","protected":false},"author":109,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"cybocfi_hide_featured_image":"","footnotes":""},"categories":[19],"tags":[],"class_list":["post-1375","post","type-post","status-publish","format-standard","hentry","category-computer-vision-gestures"],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/posts\/1375","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/users\/109"}],"replies":[{"embeddable":true,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/comments?post=1375"}],"version-history":[{"count":1,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/posts\/1375\/revisions"}],"predecessor-version":[{"id":1377,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/posts\/1375\/revisions\/1377"}],"wp:attachment":[{"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/media?parent=1375"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/categories?post=1375"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/tags?post=1375"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}