For my final project, I used MAX grid matrices, a heart rate sensor, and a camera to convey the metaphor/idea that “One need to be present to experience the Present“.
Description:
The user stands in front of a display and camera, and is presented with a prop “vine / tree branch” with a heart rate sensor embedded within it. When a heart rate is detected, the display (being a matrix of duplicated meshes), begins to react to the camera image and heart beat. This creates the effect of imprinting the physical world around the user on the digital scene, sustained by your heart rate.
Theme:
The users’ surrounds are only captured and reacted to with an active heart beat. Without that, the scene is left quiet and motionless, unable to sense the Present unfolding around it.
Camera – To – Max Images:
Regular Camera B/W and Contrasted Height Map Applying Height Map to 3D Plane Moving Z-translation to grid shape matrix
Hardware Image Dump:
Max Patch Screenshots:
Converting camera image to height / bump map Applying Z-deformation to grid matrix. For testing I added a fake BPM input Serial connection reading from Arduino Audio Control
External Content used: (Audio)
Heart Beat [edited]: http://soundbible.com/2162-Human-Heartbeat.html
Forest Birds: https://freesound.org/people/VKProduktion/sounds/231537/
Cicadas: https://freesound.org/people/Nimlos/sounds/422048/