For my final project, I used MAX grid matrices, a heart rate sensor, and a camera to convey the metaphor/idea that “One need to be present to experience the Present“.
Description:
The user stands in front of a display and camera, and is presented with a prop “vine / tree branch” with a heart rate sensor embedded within it. When a heart rate is detected, the display (being a matrix of duplicated meshes), begins to react to the camera image and heart beat. This creates the effect of imprinting the physical world around the user on the digital scene, sustained by your heart rate.
Theme:
The users’ surrounds are only captured and reacted to with an active heart beat. Without that, the scene is left quiet and motionless, unable to sense the Present unfolding around it.
Camera – To – Max Images:

Regular Camera 
B/W and Contrasted Height Map 
Applying Height Map to 3D Plane 
Moving Z-translation to grid shape matrix
Hardware Image Dump:
Max Patch Screenshots:

Converting camera image to height / bump map 
Applying Z-deformation to grid matrix. For testing I added a fake BPM input 
Serial connection reading from Arduino 
Audio Control
External Content used: (Audio)
Heart Beat [edited]: http://soundbible.com/2162-Human-Heartbeat.html
Forest Birds: https://freesound.org/people/VKProduktion/sounds/231537/
Cicadas: https://freesound.org/people/Nimlos/sounds/422048/







