Now that the Augmented Reality cat is out of the bag, Magic Leap begins to learn a bit more about how some of his work came together in the years and months prior to the release of Magic Leap One earlier this month. On Wednesday, the company unveiled a "Behind the Scenes" video about how the ethereal music app AR-Tónandi was created in collaboration with the Icelandic music group Sigur Rós.
The mini-docu video also features band member Jónsi Birgisson as Magic Leap Studios lead creative and technical leads Stephen Mangiat and Mike Tucker, executive producer of Magic Leap Studios, Rebecca Barkin, and Sigur Rós & # 39; music director Paul Corley and Sarah Hooper, the band's art director.
"Together we have created a place in the here and now, where the" sound spirits "of Sigur Rós & # 39; music can be played and changed with the hands", it says on the website of the band, on the examples of App that has taken five years to produce. "[The app is a] Place where spatial sounds are visible all around you and ready to respond to any interaction."
In just over seven minutes, the video does not go into detail but shows us a new look The teams worked together, which is a completely new creative canvas for most music artists. From the development of interactive environmental aspects to hand-gesture interactions, the team explains how all the elements come together to create a truly unique experience.
And while the interactive visuals and spatial audio are stunning, it seems more like a developer Demo application as a fully-fledged entertainment product for repeated use. In fact, I'm not sure if it's the app that would delight the average user for AR on Magic Leap One.
Last week I wondered why I had not seen any more video footage of it The Tónandi app was shared on social media, as I have with other Magic Leap One apps like (admittedly less interactive) Create, Screens and Helio, and after spending some time with it, I can see why.
In short, it's more of a meditative experience that takes a relatively long time to complete completely digest. The problem with this time commitment (especially for today's attention-grabbing users) is that interactive payouts do not really match the time it takes to sit with the app.
When you open the Tónandi app, you'll soon see a message stating "the Control is no longer needed Now you are free to explore Tónandi with your hands, eyes and body … be curious. "
It is an exciting challenge, but what follows are long stretches of the movement of hands , Eyes and head to interact with abstract virtual objects. with interesting, but not "can not put off this app" effect. I know that this has taken a lot of work, so I am not happy to say that I have lost interest relatively quickly.
In honor of the app I was impressed by the ability to create a virtual To take an object, throw it against my real world wall, let that object stand against the wall, and then take another virtual object and throw it on the other and watch them react to each other as real objects (see video below). Overall, the app is a great demo, but it's not the stickiest app (by the way, it comes from a longtime fan of Sigur Rós).
In a sense, the Tónandi app would have brought more benefits from the involvement of another Icelandic artist – Björk, who is now very experienced in providing rousing music-meets-VR experiences ("Notget VR" for example). Speaking of VR, I think Tónandi would have worked better in this environment than in AR.
Sure, it's cool to see the abstract objects pulsing and interacting with the real world, but the fact that the real world is "still there". You're not really inspired to fall into the meditative state where the otherworldly aspects of the app seem to be inspired, something that is inspired by VR's locked dynamics is more immersive.
This is another example of this Creating experience for headworn AR devices poses new challenges that will make producers, artists, and developers completely redesign interface design and keep users as they really are World framed the virtual content.
But these points do not take Tónandi's app from the perspective of sowing the developer space, with an example of what's possible with the gesture controls, eye and head tracking and spatial audio of Magic Leap One.
It's great first effort and an exciting look at what could come next in the path of music experiences in AR.