{"id":1342,"date":"2018-11-28T22:16:37","date_gmt":"2018-11-29T03:16:37","guid":{"rendered":"http:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/?p=1342"},"modified":"2018-11-28T22:16:37","modified_gmt":"2018-11-29T03:16:37","slug":"nick-sorensen-computer-vision-gestures","status":"publish","type":"post","link":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/nasorensen\/nick-sorensen-computer-vision-gestures\/","title":{"rendered":"Nick Sorensen &#8211; Computer Vision Gestures"},"content":{"rendered":"<p>For this project I took inspiration from the meme assignment. I used faceOSC to track the height of my mouth to determine when my mouth was open or not. This information was used to either play or stop a sound file using the playlist object. I had to experiment a bit to get the constant updating from faceOSC to only play the sound once. I used two debouncers that had to reset each other. FaceOSC is not perfect and sometimes does not detect your face correctly which leads to your mouth not being scaled right.<\/p>\n<p>&nbsp;<\/p>\n<p>Below is the example template for faceOSC that was given. This just sends out the mouth height.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-1348\" src=\"http:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/faceosc-723x800.png\" alt=\"\" width=\"723\" height=\"800\" srcset=\"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/faceosc-723x800.png 723w, https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/faceosc-768x849.png 768w, https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/faceosc-926x1024.png 926w, https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/faceosc-271x300.png 271w, https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/faceosc.png 1152w\" sizes=\"auto, (max-width: 723px) 100vw, 723px\" \/><\/p>\n<p>Here is the max patch that reads the mouth height, compares it, and denounces it. When your mouth is detected as open it randomly selects one of the sound files.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-1349\" src=\"http:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/playback-800x571.png\" alt=\"\" width=\"800\" height=\"571\" srcset=\"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/playback-800x571.png 800w, https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/playback-768x548.png 768w, https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/playback-1024x730.png 1024w, https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/playback-421x300.png 421w, https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/playback.png 1378w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><\/p>\n<p>&nbsp;<\/p>\n<p>Here is a demo of the patch in action.<\/p>\n<p><iframe loading=\"lazy\" width=\"1000\" height=\"750\" src=\"https:\/\/www.youtube.com\/embed\/peLR-m9gShk?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/p>\n","protected":false},"excerpt":{"rendered":"<p>For this project I took inspiration from the meme assignment. I used faceOSC to track the height of my mouth to determine when my mouth was open or not. This information was used to either play or stop a sound file using the playlist object. I had to experiment a bit to get the constant&#8230; <\/p>\n<div class=\"link-more\"><a href=\"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/nasorensen\/nick-sorensen-computer-vision-gestures\/\">Read More<\/a><\/div>\n","protected":false},"author":97,"featured_media":1355,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"cybocfi_hide_featured_image":"","footnotes":""},"categories":[19],"tags":[],"class_list":["post-1342","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-computer-vision-gestures"],"jetpack_featured_media_url":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-content\/uploads\/sites\/8\/2018\/11\/thumbnail.png","_links":{"self":[{"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/posts\/1342","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/users\/97"}],"replies":[{"embeddable":true,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/comments?post=1342"}],"version-history":[{"count":2,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/posts\/1342\/revisions"}],"predecessor-version":[{"id":1356,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/posts\/1342\/revisions\/1356"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/media\/1355"}],"wp:attachment":[{"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/media?parent=1342"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/categories?post=1342"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/imgd3200-b18\/wp-json\/wp\/v2\/tags?post=1342"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}