Over the course of the week, my ultimate goal was to upgrade the color tracking software to the next tier. This constitutes more reliable and multicolor tracking, both of which initially failed. For the multicolored monitoring, I tried repeating the initial procedure twice, but this was so heavy on the machine that the program was too slow. I ended up reworking the algorithm, where instead of trying to find four points and creating a rectangle for each blob of color, it only finds the center point. This made it run much more smoothly.
To improve the reliability, I attempted to apply a gaussian blur over the image. A gaussian blur would help create smoother edges that are easier for the computer to process, however, this also made it run too slow, and instead of blurring the image it only made it darker. So instead of adding heavy code, I changed what was being tracked. Initially, I took some white cotton gloves and painted the fingers. The pain was not evenly coated and was shiny, this is very hard for a camera to pick up what is part of the same blob of color. I invested in some pre-colored gloves which work much better as they don’t reflect light, are evenly coated with color, and are much more vibrant than my attempt. Unfortunately, my initial attempt at the gloves was lost, presumably pulled into another dimension, but I can provide a picture of the new gloves:
