Like I mentioned last week, the main upcoming goals were centered around translating the depth map into information that the esp32 could use and then giving it that information through wifi. Here’s a condensed version of the last week:

Converting the Depth Map into a Binary Matrix

The first step was translating the information into something that the ESP32 could use to command the LED panel. For this, I took the normalized values from the depth map and tested multiple thresholds for what LEDs would be turned on. I ended up settling on only showing the closest quarter of the scene. Here’s a video demo of the depth mask:

WiFi Communication w/ ESP32

Then I started the initial prototyping for how to send information to the ESP32 with wifi. I ended up just sending a test matrix for this and this was the result:

Integration

Then, I reconfigured the script to convert the binary depth map into a 20 x 16 matrix (the ratio that I think would look best on the LED panel) using a kernel method.

Sorry about that video, I had to slightly crop it to fit in the wordpress site.

The goal for the next week is to finally start hammering away on the LED panel controls. I wanted to make sure I got the wifi stuff figured out before messing with the LED panel since I’m assuming that won’t be the hard part (hopefully I didn’t just jinx myself).