{"id":3191,"date":"2025-04-08T13:36:21","date_gmt":"2025-04-08T17:36:21","guid":{"rendered":"https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/?p=3191"},"modified":"2025-04-10T11:12:30","modified_gmt":"2025-04-10T15:12:30","slug":"maquette","status":"publish","type":"post","link":"https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/nrgangaram\/maquette\/","title":{"rendered":"Maquette"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">A New Direction <\/h2>\n\n\n\n<p>Over the weekend, I was reminded of this project that I saw on Harvard&#8217;s campus: <\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Harvard Time Capsule (Interactive Kinetic Public Art)\" width=\"1000\" height=\"563\" src=\"https:\/\/www.youtube.com\/embed\/sPCaVPvJygM?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>I remember feeling the &#8220;I should make that&#8221; itch, prompting me to quickly forget about the other two projects and feel the need to run after this instead. To scope the project for the rest of the term, I started doing research into how this project was originally built. I believe it uses a camera to detect when a subject is in front of the panel, a machine learning model to detect the person, and a computer to run inference on the model and convert that into what dots need to be flipped to show the person. <\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Progress <\/h2>\n\n\n\n<p>In light of this, I started doing some work producing a version of the project that I could do using a lot of what I already have on hand. I believe I can use my laptop&#8217;s webcam (as well as its compute for the ML model), send the information to an ESP32, and then display the corresponding commands to an LED panel. I did some looking into making my own flip dot panel or buying one, and turns out they are super expensive (~250 on eBay) and convoluted to build (multiple youtube channels have spent months making their own, without much real progress). So I think for this project, I want to focus on developing a wireless LED panel that gets real-time depth information from your computer&#8217;s webcam. <\/p>\n\n\n\n<p>I got started messing with possible models and landed on DepthAnythingV2 for it&#8217;s size to performance ratio. I&#8217;m looking into getting it running faster, but I was super happy to get it running in real time: <\/p>\n\n\n\n<figure class=\"wp-block-video\"><video controls src=\"https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-content\/uploads\/sites\/37\/2025\/04\/IMG_0536.mov\"><\/video><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Shopping List <\/h2>\n\n\n\n<p>Like I mentioned before, I think this project can be done with an ESP32 and an LED panel. I&#8217;m lucky to have a spare ESP32 in my dorm, but needed to order the linked <a href=\"https:\/\/www.amazon.com\/5mm-Mini-Lights-16x32cm-Matrix\/dp\/B08LNYTHZH\/ref=sr_1_38?crid=1SBO5DFUAGG7R&amp;dib=eyJ2IjoiMSJ9.1jFwtpyLRnMlhG3Q0U_Aprnzb1KLibv-dfEIwTN4niWOIJsqoYTkJdG5J4mfH1XFPn8Ez-zoFN0YUTxg5ZNFK7Cbud1mmm6dhWp6Lcm7ou75s9FGmeML5n5LbD52YdnvV97ZakTk_HbXysOuDuFl-mX91cndGvFWpcX8I-6Jr1EZgv1pUA728ZCx4tVdRiVkF4opWHSDlJj0lR0Yl84f4ueB_pOdCQpFkjoEsm2pkOHQLNuYbinj-AOAysiOymMsIDXIG0CmDIsf8VUdiVr_FgzbHzIaETiaa7o8qLxIKwg.j5u06ZnJJazLXGWY5HC3cPAPROIOiYB9_LMTdp674BY&amp;dib_tag=se&amp;keywords=led%2Bmatrix&amp;qid=1743947695&amp;sprefix=3.3v%2Bled%2Bmatrix%2Caps%2C133&amp;sr=8-38&amp;th=1\" data-type=\"link\" data-id=\"https:\/\/www.amazon.com\/5mm-Mini-Lights-16x32cm-Matrix\/dp\/B08LNYTHZH\/ref=sr_1_38?crid=1SBO5DFUAGG7R&amp;dib=eyJ2IjoiMSJ9.1jFwtpyLRnMlhG3Q0U_Aprnzb1KLibv-dfEIwTN4niWOIJsqoYTkJdG5J4mfH1XFPn8Ez-zoFN0YUTxg5ZNFK7Cbud1mmm6dhWp6Lcm7ou75s9FGmeML5n5LbD52YdnvV97ZakTk_HbXysOuDuFl-mX91cndGvFWpcX8I-6Jr1EZgv1pUA728ZCx4tVdRiVkF4opWHSDlJj0lR0Yl84f4ueB_pOdCQpFkjoEsm2pkOHQLNuYbinj-AOAysiOymMsIDXIG0CmDIsf8VUdiVr_FgzbHzIaETiaa7o8qLxIKwg.j5u06ZnJJazLXGWY5HC3cPAPROIOiYB9_LMTdp674BY&amp;dib_tag=se&amp;keywords=led%2Bmatrix&amp;qid=1743947695&amp;sprefix=3.3v%2Bled%2Bmatrix%2Caps%2C133&amp;sr=8-38&amp;th=1\">LED PANEL<\/a> (which will hopefully be here later this week). The next step is to start messing with the communication protocol and getting the ESP to properly manipulate the LED panel. <\/p>\n\n\n\n<p>(Update) The LED panel came in broken&#8230; I love getting sketchy electronics from Amazon: <\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-content\/uploads\/sites\/37\/2025\/04\/image-18.png\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"768\" src=\"https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-content\/uploads\/sites\/37\/2025\/04\/image-18-1024x768.png\" alt=\"\" class=\"wp-image-3240\" srcset=\"https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-content\/uploads\/sites\/37\/2025\/04\/image-18-1024x768.png 1024w, https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-content\/uploads\/sites\/37\/2025\/04\/image-18-800x600.png 800w, https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-content\/uploads\/sites\/37\/2025\/04\/image-18-768x576.png 768w, https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-content\/uploads\/sites\/37\/2025\/04\/image-18-1536x1152.png 1536w, https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-content\/uploads\/sites\/37\/2025\/04\/image-18-2048x1536.png 2048w, https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-content\/uploads\/sites\/37\/2025\/04\/image-18-400x300.png 400w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-content\/uploads\/sites\/37\/2025\/04\/image-19.png\"><img loading=\"lazy\" decoding=\"async\" width=\"782\" height=\"1024\" src=\"https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-content\/uploads\/sites\/37\/2025\/04\/image-19-782x1024.png\" alt=\"\" class=\"wp-image-3241\" srcset=\"https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-content\/uploads\/sites\/37\/2025\/04\/image-19-782x1024.png 782w, https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-content\/uploads\/sites\/37\/2025\/04\/image-19-611x800.png 611w, https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-content\/uploads\/sites\/37\/2025\/04\/image-19-768x1005.png 768w, https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-content\/uploads\/sites\/37\/2025\/04\/image-19-1173x1536.png 1173w, https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-content\/uploads\/sites\/37\/2025\/04\/image-19-1564x2048.png 1564w, https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-content\/uploads\/sites\/37\/2025\/04\/image-19-229x300.png 229w\" sizes=\"auto, (max-width: 782px) 100vw, 782px\" \/><\/a><\/figure>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>A New Direction Over the weekend, I was reminded of this project that I saw on Harvard&#8217;s campus: I remember feeling the &#8220;I should make that&#8221; itch, prompting me to quickly forget about the other two projects and feel the need to run after this instead. To scope the project for the rest of the&#8230; <\/p>\n<div class=\"link-more\"><a href=\"https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/nrgangaram\/maquette\/\">Read More<\/a><\/div>\n","protected":false},"author":451,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"cybocfi_hide_featured_image":"","footnotes":""},"categories":[1],"tags":[],"class_list":["post-3191","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-json\/wp\/v2\/posts\/3191","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-json\/wp\/v2\/users\/451"}],"replies":[{"embeddable":true,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-json\/wp\/v2\/comments?post=3191"}],"version-history":[{"count":3,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-json\/wp\/v2\/posts\/3191\/revisions"}],"predecessor-version":[{"id":3243,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-json\/wp\/v2\/posts\/3191\/revisions\/3243"}],"wp:attachment":[{"href":"https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-json\/wp\/v2\/media?parent=3191"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-json\/wp\/v2\/categories?post=3191"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.joshuarosenstock.com\/teaching\/lightart-d25\/wp-json\/wp\/v2\/tags?post=3191"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}