Zach Lieberman is an artist who is exploring how to create art using iPhone ARKit. His latest creation? Recording audio in space. In the demo video, Zach makes sounds like “woosh, psh, ah, click.” After each sound, a white blob bursts into the air, and as Zach walks backward, each blob is linked to the other blobs like a audio timeline. When he walks forward again through the trail, you hear each sound playing in reverse. Zach, who helps run the School For Poetic Computation in New York City, built the demo using Simultaneous Localization And Mapping (SLAM). It uses the iPhone’s sensors and camera to create a low-res map of the room. The app records sound with the microphone, processes and visualizes it, and then maps each sound blob to a location within the room.
Add a Comment