Colin Ancalmo – Sound Animation

I tried creating an audio visualizer for my sound-based animation. My idea was to create some sort of sheet or surface and have the sound deform that surface.

With the help of jit.multiple and a tutorial of manipulating shapes via jit.multiple (link here), I got a plane of square shapes that moved in a sin formation (that’s what I used from the tutorial). From there, I made all the squares very low poly to the point that they were 2D. Control wise, I made it such that the overall duplication spacing and sin transforming period/amplitude could be controlled together from outside.

The sound: I put song tracks through low-pass and high-pass filters to get two routes of control from the low and high frequencies. So Bass would trigger on one while high-hats would trigger on the other. The low-pass triggered the duplicate’s spacing / size and amplitude of the sin wave. The high-pass controls the color changing background and the shape of the 2D squares (lot of struggle to get that working, but I think it made a cool effect).

The songs I used to test were 1) It’s Your Move by Diana Ross, 2) Earth, Wind & Fire – September (gu-kun remix), and 3) Next To Blue – 1-800-friends. Each song I had “presents” for the frequency sensitivity since they were different volumes. Next To Blue’s song worked the best as it had more distinct low and high instruments. The full version of that song is visualized below!

8 Comments Add yours

  1. Really nice visualization! I like the ways you’ve mapped the frequencies to the visual effects.

    Kind of reminds me of an abstracted speaker cone.

  2. Ryan Doyle says:

    Looks cool. I love the ripple pattern it has on it.

  3. Tom Towadros says:

    This is really mesmerizing to watch. I always love seeing math being in a visual way, and I think that’s exactly what you did here. I would love to see multiple of these oscillating cones being controlled by different tracks or different instruments within the same song. Very cool.

  4. Matt Johannesen says:

    This is a great implementation of jit.multiple! It’s cool that you were able to combine the squares’ position on the plane with the input signal to create smooth waves in the surface. I also thought it was really clever how you separated out the high and low frequencies of the songs to extract your own mix of data, instead of just measuring loudness of the full song.

  5. Joy Tartaglia says:

    You made a really cool ripple effect with all those objects. It was especially neat watching them move and shift with the music. Maybe the illusion of a ripple could move outward instead of inward? I guess it’s more of a design opinion. Great work!

  6. Daniel McDonough says:

    This is what I was attempting to do with my animation. This is a much better visualization. It looks as though the waves are speaking to you.

  7. Sylvia Lin says:

    I am intrigued by this rippling effect. I like how the color is being changed subtly yet noticeably. I can also see your attention to the details through these manipulations.
    I am also surprised to see that your patchers acutally are not that complicated but it probably took you a long time.

Leave a Reply