I may have bitten off more than I could chew with this one. I decided to make my Augmented Selfie a reflection of my current state, very fuzzy and uncertain while still blocked in (it comes easy when one tries to overload and lead a new game development team simultaneously) – and to go about it, my first instinct was to make a large cube, with a static- covered view of the user’s face on all sides, follow the user around and rotate with them.
I first tried to use the standard [cv.jit.faces] patch to do some rudimentary tracking, but quickly realized that it didn’t output the rotation of a face, only the location. I then switched over to a FaceOSC patch I found, which did capture the rotation, location and scale of the user’s face map – but because FaceOSC is an external program, it hogs the webcam’s output stream, and prevents Max from accessing the video feed!
After trying in vain to extract the webcam data from FaceOSC, I ultimately just switched back to cv.jit.faces as the face detection method. I had a couple challenges with this: a) I had to force [cv.jit.faces.draw] to output the dimensions of the face to manually calculate scale, and b) I had to map the cube’s rotation to how far the face was from the center of the screen. As a result, lots of painful math trickery ensued. But this is the final result:
Impressive and creepy at the same time.
That’s pretty cool. You were able to capture the static vibe in the audio as well. I think one way to make it better would be to have some kind of of transition from your normal head to the cube head state.
Very neat vibe from this one. It’s like a selfie filter that turns you into a character from some retro horror game / creepypasta. The cube-to-head tracking is beautiful as well.
I like the overall visual style that you have created with the cube It’s very creepy and surreal. The audio, while fitting in with this style, in my head it makes me think that I’ve accidentally peaked my audio while editing. While it gives off a neat static audio effect, I think that using a different static audio effect would work much better.
This is a really cool idea and it sounds like it was a lot of work to pull it off as well as you did. The way the cube replaces your head and follows your movements is a very complicated and interesting effect. The camera texture on the cube doesn’t mirror your movements, though.
This does a good job of giving a creepy vibe. I love how the cube rotates with the angle of your head. It really gives it the aspect of the cube is consuming your head. The static effect on the cube with your actual face also brings a creepy atmosphere.
I am really curious how you got the cube to turn with your head. It looks very accurate. Texturing the camera to the cube looks really cool here because even though we can’t see your head, we get an idea of the shape it is supposed to be.
I really like the static effect on the brick as well, you never really get a chance to see your face, and it really matches the theme you were going for.