Zach Lieberman is an artist who is exploring how to create art using iPhone ARKit. His latest creation? Recording audio in space. In the demo video, Zach makes sounds like “woosh, psh, ah, click.” After each sound, a white blob bursts into the air, and as Zach walks backward, each blob is linked to the other blobs like a audio timeline. When he walks forward again through the trail, you hear each sound playing in reverse. Zach, who helps run the School For Poetic Computation in New York City, built the demo using Simultaneous Localization And Mapping (SLAM). It uses the iPhone’s sensors and camera to create a low-res map of the room. The app records sound with the microphone, processes and visualizes it, and then maps each sound blob to a location within the room.
Aside from ARKit, another API that Apple released to developers this summer is a Vision API which can “identify faces, detect features, and classify scenes in images and video.”
Apple offers these guidelines so that developers can meet the company’s expectations and also make the most out of their apps.
Check out this ARKit demo for a menu app called Kabaq. The idea for the app is that a restaurant builds their menus to show customers what their food would look like on the plate in front of them. And wowza, does it look real! At least in this demo video. AppleInsider found it, along with another great ARKit video, and they noted the developers see cookbooks using their technology, too. Either way, it’s a much more practical application of augmented reality (AR) than the games that have dominated early exposure so far. This app is made possible by ARKit in iOS 11, which is expected to ship in September.
Just because your iPhone or iPad can run iOS 11 doesn’t mean it supports ARKit. Check out TMO’s list of ARKit-capable devices.
ARKit, Apple’s answer to augmented reality (AR) on iOS, has become tremendously popular already. Folks have posted quite a few ARKit demos on YouTube since Apple’s announcement of of the software development kit at WWDC 2017. We’ve covered many of these demonstrations in previous articles. This morning, though, I needed a YouTube playlist of them for an article at AppAdvice about IDC’s report that Augmented and Virtual Reality are going to see some serious increase in revenues. Not finding one, I decided to create my own. Since I love all of you, I decided to share that YouTube playlist with you. Without further ado, here it is. We will add to it as more ARKit demonstrations come on our radar.
Loads of cool videos showing how compelling iOS 11’s ARKit is are popping up and the latest comes from Trixi Studios. They recreated the hand sketched style from the 1980’s A-ha “Take On Me” music video, but instead of working with a series of drawings they let ARKit do the heavy lifting. The result is a real-time version of the video you can walk through and watch as other people switch from themselves into drawings. It’s yet another example of the huge potential in ARKit.
One video shows how AR can point out major landmarks in your area, while the other video gives an example of how people will be able to navigate by following lines.
Maps gives us a taste of augmented reality in iOS 11 beta. Okay, Apple hasn’t made its ARKit technology fully available yet. Still, that can’t stop Cupertino from including the technology in the latest beta of iOS 11. To see it, you need only do a Flyover in one of the supported cities. Interestingly, not all of the listed cities are still available for Flyover – Akron, Ohio was not, but Cleveland, Ohio was. When you tap Flyover, you’ll enjoy an AR-fueled view. You’ll love flying over the buildings like a superhero as you walk around panning and tilting your iPhone camera. It’s definitely worthy of the name “Cool Stuff Found.” Watch it in action below, and be sure to look at our coverage of other ARKit demonstrations available. Tip o’ the hat to Leon Nisenfeld, a MGG listener and follower on Facebook, for cluing us into this find.
We found some more videos showing some really cool demonstrations of ARKit in action.
Augmented Reality is the visual marriage of the real world with its own metadata, and its potential is just starting to dawn on us.
Introduced at WWDC 2017 as part of iOS 11, Apple’s ARKit will provide the tools for developers to tap into the increasingly popular and important world of augmented reality. And now that the iOS 11 betas are in developers’ hands, we’re getting some amazing first looks at what AR on the iPhone and iPad will soon deliver. One of the coolest is AR Measure, a tape measuring app that is way cooler than it sounds. Check out the video demo, below.
Where’s Apple going with ARKit in iOS 11? Bryan and Jeff weigh the pros and cons of mobile-device AR versus goggle/glasses AR. They also talk about Bryan’s cockamamie idea for iBooks inside Apple Stores, and go deep on some listener email on HomePod and Apple Car.
The beta version of iOS 11 has been in developer’s hands for only a few days and we’re already seeing some impressive examples of what’s possible with ARKit augmented reality.
There were at least 11 software-related announcements during Apple’s World Wide Developer Conference (WWDC).