Design ideas for Spatial Cinema and Location-based AR

Design ideas for Spatial Cinema and Location-based AR is something I have long considered, but last month the theoretical concern became a reality. I was fortunate to work with the largest location-based AR project in the world. This was in Bari, Italy where Augmented.City has created a digital twin linked to 100 square kilometers of the city. Another way to say this: Every building in a 100 square kilometer area of Bari has been created digitally.

A digital twin of the city of Helsinki, created by Immersal. Inset is Mikko Karvonen, the cofounder of Immersal. Both Immersal and Augmented.City have platforms that use GeoPose as well as conform to the ethics and privacy guidelines of the OARC(Open Augmented Reality Cloud). This is a screen capture from a video that is a must for anyone interested in the powerful possibilities of open, GeoPose-based large scale AR experiences.

There are countless advantages of the open, GeoPose-based system proposed by the OARC. Commercial uses, education, city administration, health, traffic and safety, tourism and research are some of the obvious uses. My main interest however, is in the possibilities of location-based AR for artistic expression and especially spatial cinema.

This video is the conclusion of my presentation at the 2020 VIEW Conference. The entire presentation explained the rapidly evolving relationship between AR and cinema. The conclusion introduced Bubiko: First Flight, the world's first example of spatial cinema. Bubiko: First Flight, a collaboration between Novaby, Augmented.City and myself, will be the topic of future posts.

This post is to bring attention to the need for design that acknowledges the unique properties of location based AR.

Screen capture from Jan-Erik Vijne's presentation at the 2020 Nordic VR Summit. The chart above gives us much to think about in terms of design.
Still from the Augmented.City video presenting their work in Bari. The design is functional; basically 2D. This project is a test bed, and design is just one of the many things being studied.
Still from Hyperreality, a short film by Keiichi Matsuda. Highly recommended. Although fictitious, the simulated AR is believable.
An AR "souvenir" from Bubiko: First Flight. The idea of creating AR backgrounds for tourists and visitors to the cafe was put into motion at the last minute, as I had hoped to do a test before I left Bari. This approach, typical 2D design, was used as there wasn't enough time to position components in the actual space. Also, we (later) found a better place to work with, in which the cameraperson and the model would not have to be bothered by passing cars. So, I did manage to get a souvenir-and on a Vespa! However, now that we have time, the elements can be rebuilt for the spatial possibilities of AR.
Bubiko appears here in AR, by means of the Facebook Spark app. The reflections of the lights are what I find interesting. This effect of rays emanating from the center is something I hope to apply to the AR souvenir idea for the cafe/Bubiko: First Flight. In other words, the text, logos and blimp need not all be on one plane. Just as dance and sculpture interact with space, so should AR design.

I will continue looking, but at the moment, the only information I have to share on spatial design for AR are two presentations by Alex Cho, who was working with Samsung at the time. Although his ideas and experiences are with VR, there is much that can be applied to AR. I will keep looking, but it seems that the areas that can help most with AR spatial design are VR and games.

This article analyzes some of Alex's work and there is also a video of another presentation by by Alex. Alex Chu's website.

I found some more! Thought-provoking(Angular Units!)

Eye candy or functional coolness?

Leave a Comment

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.