The goal of my project has not been solidified yet. I am still exploring vast possibilities of software and trying to establish limitations for the project and form realistic expectations. For my artist study, I picked japaneese multimedia artist Ryoji Ikeda. His attempts to recreate behaviors of nature through the use of theoretical mathematics are colossal and very inspiring. His methods are beyond understanding, and my work will pursuit to use the same philosophy and approaches, although with much simplier methodology.

Here is where my project proposal is currently at. I will have a projector, illuminating a dropdown with an image. Individually-addressable LEDs will bridge the control board with the dropdown, imitating active cords. LED strips will flash each time any of the controls are affected, visualizing that the signal is recieved and delivered to the image. The image on the dropdown will likely be slightly delayed accordingly. Here is a preliminary sketch of the setup with the components:

Quick overview of the model and current progress. Since I want to have an Audio Visual installation, I have to figure out how to synchronize the sound with light/image. I have so far learned how to use your own audio file as a separate MIDI channel and route is outside of the Max environment. Even though the plan is to use 2 softwares, Max and Touchdesigner, included visual operator in Max (Jitter) might be enough for my goals.
Main decisions to be made this week are:
- Decide what type(s) of external input there will be. I need something that can take human’s interaction with my model and make it respond sonically and visually. Right now, I am inclined to use IR (distance) or piezoelectric (bending, vibrations, etc.) sensors. Converted analog signals from these sensors produce practical digital data that can be used in both Max and Touchdesigner software. Also, there is a variety of ways to create controls using, for example, bending sensor. There can be a button that changes the intensity of light depending on the pressure exerted on it.
- Decide whether Touchdesigner software will be used or not. It will make the model more complex, allowing to experiment more with parameters and filters.
If anyone here has dealt with A/D stuff previously, I would love to hear your recommendations about sensors. I do not have a ton of experience there. Thanks!
I think your idea is really cool, I have no experience with audiovisual projects and I’m curious to see how you integrate control of the LEDs with your software. Ultrasonic range finders are pretty cheap and easy to use (and they have a digital output signal which might be helpful), you could also use a button as a sensor if you wanted to do something like trigger lights when people step on a panel.