Nick Sorensen – Computer Vision Gestures

For this project I took inspiration from the meme assignment. I used faceOSC to track the height of my mouth to determine when my mouth was open or not. This information was used to either play or stop a sound file using the playlist object. I had to experiment a bit to get the constant updating from faceOSC to only play the sound once. I used two debouncers that had to reset each other. FaceOSC is not perfect and sometimes does not detect your face correctly which leads to your mouth not being scaled right.

 

Below is the example template for faceOSC that was given. This just sends out the mouth height.

Here is the max patch that reads the mouth height, compares it, and denounces it. When your mouth is detected as open it randomly selects one of the sound files.

 

Here is a demo of the patch in action.

4 Comments Add yours

  1. Thai Dao says:

    Love the song! And potential to put any song in here is great. Well done!

  2. Isaiah Fleischer says:

    Vitas is an amazing artist, I’m glad you chose him! He also has a song where he sings some really high notes, you might want to consider pairing that and an animation of a glass breaking if you open your mouth for long enough!

  3. Jarod Romankiw says:

    So beautiful. I laughed so hard when I saw this. This could work very well with the meme remix….

  4. Aidan Sensiba says:

    I think it would be fun to have visuals that appear when you start “singing,” as well as a few other songs to choose from. It’s already entertaining, though.

Leave a Reply