Jonathan Shiery – Augmented Selfies

For my project, I wanted to incorporate being able to control music with the camera. It gave me the idea of being the conductor of an orchestra, so I decided to make an interactive orchestra. Depending on the amount of movement happening on the camera, it correlates to changing the speed of the orchestra.

6 Comments Add yours

  1. Tom Towadros says:

    I like the idea of this project. You end up performing as a conductor, and like I said in class I think that that interacting has a lot of potential to scale. You could control different sections of the orchestra, and their volumes, using different motions in different parts of the screen. As far as I’m concerned conducting was the perfect template for this project.

  2. Colin Ancalmo says:

    This project is very intuitive to interact with and the camera placement really immerses you in the scene.
    Also the first thing that came to mind when I saw this was Mr Bean: https://youtu.be/Xzkm-kbx2T4?t=69

  3. Joy Tartaglia says:

    It’s really cool how your project creates the idea and illusion that you’re the one conducting the orchestra. It also works really well because the faster you move, the faster the video orchestra will play, which really goes hand in hand with the act of conducting.

  4. Daniel McDonough says:

    I love the interactivity between you as the conductor and the band. It would be interesting to see if you could implement cues for the band as well.

  5. Sylvia Lin says:

    This is a simple yet fun project. The idea of being a conductor yourself works great in this context. My only concern is that the music sounds a bit off. Is this sound effect from the original video? Have you thought of replacing it with some other music effects? Maybe you can even use gestures to trigger different instruments to play.

  6. Cem Alemdar says:

    Very interesting use of the motion aspect of the CV library. If you could figure out a way to not make it stop, maybe with a line~ object to smooth the input. I am curious if you could move your whole body instead of just your hands, to control the music by dancing.

Leave a Reply