Bubiko is a little chef from Thailand. Her favorite food is mango sticky rice, and her favorite expression is "Aroi mak mak", which means very delicious in the Thai languge. Sayuri Okayama and I have been brainstorming about food and augmented reality since 2016, when we used a paper version of Bubiko.
Finally, in July 2019, we had a 3D version of Bubiko. Novaby did a great job, and using the Facebook Spark and Facebook Camera apps, we were ready to augment reality with our little chef. The Facebook Camera idea and tech support were thanks to Dana.
Whiting, Indiana is home to both the Mascot Hall of Fame, and the Pierogi Festival. We decided to visit both on the same weekend, and had Bubiko's balloons decorated accordingly. Later, we took Bubiko to pierogi festivals in Detroit, Michigan and Toledo, Ohio.
Food and AR
End User or End Product
Is AR being used to create a user experience or an image to be used for publicity, marketing or other purposes?
At present the following are only proposals. Of course we hope they happen. Please vote!
BONNETS! (My Powerpoint looks extremely low tech. As much as I like this look, I have to say I had no choice. I was using my Chromebook , and used the baked in slide show creator. Next time, I might actually have the time to do some design work.)
DC Rainmaker does his usually outstanding job of reviewing a bicycle-related product.Jump into the video at about the 4 minute mark to see some exemplary AR techniques. Click here to see more examples and ideas related to AR+ Bicycles.
Cannondale, for the win! A great example of functional AR in an everyday situation, as opposed to a factory or medical facility.
From a presentation I did on AR and bike safety. All of those concepts need to be unified and rethought for the age of AR.
An example of an organization that has information that would be useful for AR in Detroit. Geographic Information Services… How much of what is under the road do they have records of? This info would be necessary for many AR services,
How do they make pointclouds-or do they even do this yet?
One of Magic Leap's views on how the total AR world might look like.
The layers presented include IoT (the Internet of Things, as well as AI. Photo courtesy of Tony at the Skarred Ghost, another person I suggest serious AR/VR people support and follow.
Another presentation from Magic Leap on how the total AR Cloud might look. They use the term "Magicverse".
A representation by the OARC on what the layers of the cloud would be. My suggested terms would be REAL1 (R1), REAL2 (R2) and REAL3 (R3). R1=the physical world. R2; the layer with few changes; buildings, landmarks, geography. R3 being the part of the AR cloud that changes the most, and has the most segmentation.
This system also lends itself to further classification. R2C22 , for example, could refer to a specific block in Chicago for example, and R2C22E could be the collective "channel" for all organizations utilizing traffic emergency communications for that area.
Microsoft Azure Spatial anchor systems. 'Anchor systems' refers to geoposing. There can be an endless number of clouds. Interoperability... Machines reading the world for humans... A browser...AI assisted browsers.
This is from the State of the Open AR Cloud 2019 report by the Open Augmented Reality Cloud group. Already some governing bodies are being formed.
Shenzhen's celebration used the entire city as a canvas. Something like this could be done in Detroit with AR, for much less cost, and with greater detail. AVs could travel on programmed routes... a new form of musical is born!
My report on the maker culture of Shenzhen is here.
The Fox Theatre is one of Detroit's cultural assets that could be utilized. This slide shows some of the layers of creation and co-operation that need to be considered.
Back to bROADWAY… and we have "discovered" that the Fox Theater is geofenced. Geofencing is a blocking of AR access. Military bases, sensitive areas...the interior of homes. The Fox Theatre is copyrighted, I believe. In this fictional example, Fox may have geofenced their theater to prevent unauthorized AR usage.
Color correction was made, in both cases, with the 'auto' function. Spark is brighter than Camera.
Spark allows the camera person to move around the model, as though it were a physical object. Spark also allows the size of the model to become different sizes. With Facebook Camera, the position and size of the model are locked. Only the front of the model can be seen, like a 2D image. Like a postage stamp.
In this case, Dana positioned Bubiko on the bottom right. We checked this position so that it also works in landscape mode. However, landscape mode seems to be unstable, based on my experiences. Fb Camera often enlarges and turns the background scene, like this:
Note the size of the pictures in the last two examples. Spark uses the dimensions of a mobile phone, Camera produces a more conventional image.
Finally: saving images. Spark, in my case, saved images directly into the iPad photo album.
Facebook Camera, on the other hand... Unless you actively go into the Facebook Archive feature, and turn it on, the images are only stored for 24 hours! I am hoping there is a way to retrieve some images I made, but so far have not been able to find a way to bring them back. Frustrating, as I am 99.9% sure I pressed "save" on the Facebook Camera app.
All images were created with an iPad.
Happy to reply to any questions or comments. Thanks for stopping by!
I have to thank Dana Moreira S Hagan A LOT. For personal reasons, I unexpectedly found myself in Austin on a Tuesday, with the need to have the new version of Bubiko loaded in my tablet by 1PM the following Saturday.
On Wednesday, I went to Facebook, presented them with this letter:
Although I was told they would get back to me, they haven't. After constant searching, including meeting the very helpful PJ and Ramona at Impact Hub, I discovered Capital Factory. There were two events going on that night (Thursday), but two people, Brance Hudzietz and Erin Miller, put my request out on two different networks!
Finally, on Friday, about 6, I discovered Erin Ford at General Assembly. Thanks to Erin, about 7PM I started a phone conversation with Dana. Dana did not have the Mac-with-Mojave that was so desperately needed, but she did come through with the idea to use Facebook Camera which was an even better choice for testing.
As I become more involved AR's potential impact upon traffic, I see roads, vehicles, pedestrians and bicycles differently. The following documentary photographs are study aids; barely related to my previous street photography projects, such as the Bus Stopping series.