Description

WebAR is a web technology that enables users to share cross-platform AR experience through the internet. Live coding is a creative practice of coding art. In live coding performances, performers create music and visuals through computer programming. My intention is to combine these two technologies and create an application to enable performers to create visuals in the AR environment. I’ve created a prototype before with ar.js for WebAR and A-frame for visual rendering. However, as a simple framework built based on HTML, A-frame limits the feasibility of some functionalities of the application. My intention is to rebuild the application with three.js, which is much more flexible than A-frame.

Tools

• ar.js for webAR
• three.js for visual programming using WebGL
• codemirror for live coding
• yjs for shared experience

Goals

• Create an application that enables performers to live code 3d visual effects in AR environment
• Support multiple performers to code at the meantime
• Create an artwork with the application