I tried creating an audio visualizer for my sound-based animation. My idea was to create some sort of sheet or surface and have the sound deform that surface.
With the help of jit.multiple and a tutorial of manipulating shapes via jit.multiple (link here), I got a plane of square shapes that moved in a sin formation (that’s what I used from the tutorial). From there, I made all the squares very low poly to the point that they were 2D. Control wise, I made it such that the overall duplication spacing and sin transforming period/amplitude could be controlled together from outside.
The sound: I put song tracks through low-pass and high-pass filters to get two routes of control from the low and high frequencies. So Bass would trigger on one while high-hats would trigger on the other. The low-pass triggered the duplicate’s spacing / size and amplitude of the sin wave. The high-pass controls the color changing background and the shape of the 2D squares (lot of struggle to get that working, but I think it made a cool effect).
The songs I used to test were 1) It’s Your Move by Diana Ross, 2) Earth, Wind & Fire – September (gu-kun remix), and 3) Next To Blue – 1-800-friends. Each song I had “presents” for the frequency sensitivity since they were different volumes. Next To Blue’s song worked the best as it had more distinct low and high instruments. The full version of that song is visualized below!