Category Archives: AR

Bubiko and the Pierogi

Bubiko's guide to AR is now available on Amazon!

Bubiko is a little chef from Thailand. Her favorite food is mango sticky rice, and her favorite expression is "Aroi mak mak", which means very delicious in the Thai languge. Sayuri Okayama and I have been brainstorming about food and augmented reality since 2016, when we used a paper version of Bubiko.

Augmented Reality in Asia
Ipoh, Malaysia and an article in the Malay Mail
paper doll grey boxing for AR
A baby picture.

Finally, in July 2019, we had a 3D version of Bubiko. Novaby did a great job, and using the Facebook Spark and Facebook Camera apps, we were ready to augment reality with our little chef. The Facebook Camera idea and tech support were thanks to Dana.

Whiting, Indiana is home to both the Mascot Hall of Fame, and the Pierogi Festival. We decided to visit both on the same weekend, and had Bubiko's balloons decorated accordingly. Later, we took Bubiko to pierogi festivals in Detroit, Michigan and Toledo, Ohio.

Bubiko at the Mascot Hall of Fame

Food and AR

End User or End Product

Is AR being used to create a user experience or an image to be used for publicity, marketing or other purposes?

Image made with Facebook Camera. Here Bubiko is promoting the event. Because this was made with FB Camera, Bubiko cannot be moved; once Dana set her position, she could not be moved.

Food close-up with Bubiko branding. Bubiko is our flagship, our beta tester. For now we have only one pose, but other poses and animated movements are in the works. Ultimately we aim to be the Pixar of AR; original characters, stories and software.
As seen on an iPhone 6 in Japan.
Scaling and size can be variable. This image was created with Spark AR which, unlike Facebook Camera, allows for different positioning and size of the model. Here Bubiko poses with the Licorice Guy and the Licorice Gal, one of the few non-pierogi vendors at the Pierogi Festival in Whiting.
To see more experiments in AR size, click here.
A small version of Bubiko with some of her favorite buscias at the Pierogi Fest in Whiting. Click here to learn about the buscias and other characters at the Pierogi Fest.
Bubiko is part Hello Kitty, part Anthony Bourdain. During our time in SE Asia, we did extensive research on local foods, as evidenced by Bubiko's Instagram account. Bubiko also did a photo book on the food of Ipoh, Malaysia and is planning one on Shenzhen, China.
Bubiko Foodtour
A guide to the food of Shenzhen. I Ate Tiong Bahru is my bestseller about the food and culture of Tiong Bahru, a community in Singapore.
As the population of "digital people", like Mike, continues to grow, some will become waiters, waitresses. maitre des and somelliers.

SXSW!

At present the following are only proposals. Of course we hope they happen. Please vote!

AUGMENTED REALITY AND FOOD: THE FUTURE OF DINING

This one is by my partner, Sayuri Okayama: AUGMENTED REALITY AND FOOD

This is my proposal, featuring Bubiko: XR: BIKE SAFETY, MUSIC AND BUBIKO FOODTOUR

Augmented Reality + Autonomous Vehicles: Stephen Black @ Collider

Bubiko's guide to AR is now available on Amazon!

The following are additions that were not discussed at the Detroit meetup.

https://www.forbes.com/sites/edgarsten/2019/08/12/turning-back-seat-boredom-into-a-virtual-theme-park/#712404fc6019

! https://www.thedrive.com/tech/9548/the-biggest-opportunity-everyone-is-missing-in-self-driving-cars

!! https://panelpicker.sxsw.com/vote/100430 (What Augmented Driving Will Feel Like, a SXSW presentation by Theo Calvin.)

I wish I had known about the projects and gentlemen above before my Detroit talk.

Do read the article by Alex Roy.

Please vote for Teo Calvin's SXSW proposal.

.......................

Presentation

Thank you very much to Jacob, Rahul and Altimetrik for making this happen. It was a blast! A description of the event, and an introduction to Collider is here.

SLIDE 2

Hyperreality by Keiichi Matsuda

https://www.rt.com/news/455341-chinese-hackers-tesla-autopilot/

https://mashable.com/article/nissan-ar-virtual-reality-windshield-display/

The Nissan video features outstanding visuals.

SLIDE 3

https://www.openarcloud.org/reports/sotarc-2019

The above link is a MUST for anyone with a serious investment in AR.

Novaby is the company that did/is doing a great job with Bubiko.

(Yes, all of the research you see is self-funded. If you can help with a donation or a job...get in touch, please. I am also a photographer, artist, videomaker and a writer.

SLIDE 4

You can see all of my adventures with Bubiko elsewhere on this blog. We would be grateful for your votes for two proposals for SXSW.

This is my proposal.

This is the proposal of Sayuri Okayama, my partner.

THANK YOU FOR YOUR VOTE!

SLIDE 5

This book is a "living" book. Meaning if you buy it, you will get the updated editions free.

SLIDE 7

BONNETS! (My Powerpoint looks extremely low tech. As much as I like this look, I have to say I had no choice. I was using my Chromebook , and used the baked in slide show creator. Next time, I might actually have the time to do some design work.)

SLIDE 8

Artivive One of my own Artivive demos is here. Another, here.

Leo

Bubiko Foodtour

Rouvy Augmented Reality Released: First Ride & Explainer.

DC Rainmaker does his usually outstanding job of reviewing a bicycle-related product.Jump into the video at about the 4 minute mark to see some exemplary AR techniques. Click here to see more examples and ideas related to AR+ Bicycles.

Cannondale, for the win! A great example of functional AR in an everyday situation, as opposed to a factory or medical facility.

SLIDE 9

From a presentation I did on AR and bike safety. All of those concepts need to be unified and rethought for the age of AR.

SLIDE 10

Mapillary

LADOT

Superworld

SLIDE 11

The Open Augmented Reality Cloud people are making efforts to establish a geopost standard. If you are serious about AR, follow their efforts, or better join them and let your voice be heard!

What you see is a test I did with Bubiko. While I was in a car, I positioned her in the road ahead. We then drove forward. It is not clear, and I will redo this test.

But what happened is that Bubiko was in front, then she appeared in the car, and then we saw her in the road behind us. She did not move with/in relationship to the car.

This was using Facebook Spark AR. Technical support: the amazing Dana.

Stunt driver: Norm Black.

No AR characters were harmed in the production of this rest.

SLIDE 12

OPEN AUGMENTED REALITY CLOUD

SLIDE 13

The AR Podcast is a must for anyone serious about AR. This is a link to the extremely informative and important interview with four of the people involved with OARC.

SLIDE 14

Thank you Sergei!

https://www.slideshare.net/sergiikozyrev?utm_campaign=profiletracking&utm_medium=sssite&utm_source=ssslideview

SLIDE 15

One style of point cloud rendering.

SLIDE 16

Another way to render a point cloud. There are many ways to create point clouds and they must be interoperable.

https://www.clarissewiki.com/3.6/creating_a_point_cloud.html

SLIDE 17

An example of an organization that has information that would be useful for AR in Detroit. Geographic Information Services… How much of what is under the road do they have records of? This info would be necessary for many AR services,

How do they make pointclouds-or do they even do this yet?

SLIDE 18

One of Magic Leap's views on how the total AR world might look like.

The layers presented include IoT (the Internet of Things, as well as AI. Photo courtesy of Tony at the Skarred Ghost, another person I suggest serious AR/VR people support and follow.

SLIDE 19

Another presentation from Magic Leap on how the total AR Cloud might look. They use the term "Magicverse".

SLIDE 20

A representation by the OARC on what the layers of the cloud would be. My suggested terms would be REAL1 (R1), REAL2 (R2) and REAL3 (R3). R1=the physical world. R2; the layer with few changes; buildings, landmarks, geography. R3 being the part of the AR cloud that changes the most, and has the most segmentation.

This system also lends itself to further classification. R2C22 , for example, could refer to a specific block in Chicago for example, and R2C22E could be the collective "channel" for all organizations utilizing traffic emergency communications for that area.

SLIDE 21

Microsoft Azure Spatial anchor systems. 'Anchor systems' refers to geoposing. There can be an endless number of clouds. Interoperability... Machines reading the world for humans... A browser...AI assisted browsers.

SLIDE 22

This is from the State of the Open AR Cloud 2019 report by the Open Augmented Reality Cloud group. Already some governing bodies are being formed.

The report is free. Get it here.

SLIDE 24

Ed Garten's article on AV safety, for Forbes magazine.

SLIDE 25

The League of American Bicyclists has an active interest in AR and AV.

https://www.bikeleague.org/content/automated-vehicle-overview-box

SLIDE 27

And the amazing BabbleRabbit! https://twitter.com/BabbleRabbit/status/1115271007315615750

SLIDE 28

https://www.researchgate.net/publication/314522858_Supporting_Trust_in_Autonomous_Driving

https://www.researchgate.net/publication/333645946_The_Impact_of_Autonomous_Vehicles'_Active_Feedback_on_Trust

SLIDE 30

An AV by May.

SLIDE 33

Shenzhen's celebration used the entire city as a canvas. Something like this could be done in Detroit with AR, for much less cost, and with greater detail. AVs could travel on programmed routes... a new form of musical is born!

My report on the maker culture of Shenzhen is here.

SLIDE 34

The Fox Theatre is one of Detroit's cultural assets that could be utilized. This slide shows some of the layers of creation and co-operation that need to be considered.

SLIDE 35

An example of an urban AR project, this one by Snapchat. This article also raises questions about AR in public spaces.

SLIDE 36

Diego! DIA! https://www.dia.org/art/rivera-court

SLIDE 37

http://amirbaradaran.com/2019/works-pages/fml.html

Go to the "0.52" mark to see the actual AR clip. It is very brief.

The video on this site by Artivive showcases some possibilities in regards to AR + flat art. https://artivive.com/walkietalkie/

SLIDE 38

Apple's AR Art program. https://www.apple.com/newsroom/2019/07/apple-offers-new-augmented-reality-art-sessions/

SLIDE 39

Back to bROADWAY… and we have "discovered" that the Fox Theater is geofenced. Geofencing is a blocking of AR access. Military bases, sensitive areas...the interior of homes. The Fox Theatre is copyrighted, I believe. In this fictional example, Fox may have geofenced their theater to prevent unauthorized AR usage.

SLIDE 40

MOTOWN!

SLIDE 42

Bose AR

So there ya go! Any questions ask below.

I am available for consultation and all kinds of AR producing, as well as photography, video, art and writing projects. Thank you for any ideas and/or opportunities.

And again, please consider voting for our two SXSW presentations:

XR: bike safety, music and Bubiko Foodtour

and

Augmented Reality and Food

THANKS!

onwARd,

Stephen Black

Bubiko at the Mascot Hall of Fame

Bubiko's guide to AR is now available on Amazon!

Bubiko stopped by the Mascot Hall of Fame to meet Reggy and his furtastic friends! She also made time to sample pierogis at the Pierogi Festival!

Bubiko at the Pierogi Festival

Bubiko's guide to AR is now available on Amazon!

Pierogis are Polish dumplings. Bubiko is a little chef from Thailand. Roll out the barrel and let the fun begin!

Bubiko’s Prizewinning Moments in Chicago and Whiting

Bubiko's guide to AR is now available on Amazon!

ATT. The plush but nonfunctional Magic Leap display.
This young woman WANTED to pose with Bubiko!
Cloud Gate, by Anish Kapoor, better known as The Bean.
The beat goes onwARd...
Hammond, Indiana. Muy mysterioso..
Midnight: Spanish karaoke
Trophies in the Purple Steer
Sunrise
The joys of not knowing where you are going...

Bubiko Foodtour test: Facebook Spark vs. Facebook Camera

Bubiko's guide to AR is now available on Amazon!

Novaby: 3D Model of Bubiko

Dana De Moreira S Hagan: Technical Support

Bubiko Foodtour's AR life began at the Tech in the Tenderloin event in San Francisco. Since that time, I have conducted tests like this, and this, in order to prepare for AR cinematography projects.

This post presents lessons learned with the Facebook Spark application, and compares Spark to a different AR application called Facebook Camera.

The 3D model of Bubiko is the same in both the Camera and Spark tests. The balloons were slightly modified, as one features Tech in the Tenderloin, and the other feature Reggy, the mascot of the Mascot Hall of Fame.

Color correction was made, in both cases, with the 'auto' function. Spark is brighter than Camera.

Spark allows the camera person to move around the model, as though it were a physical object. Spark also allows the size of the model to become different sizes. With Facebook Camera, the position and size of the model are locked. Only the front of the model can be seen, like a 2D image. Like a postage stamp.

In this case, Dana positioned Bubiko on the bottom right. We checked this position so that it also works in landscape mode. However, landscape mode seems to be unstable, based on my experiences. Fb Camera often enlarges and turns the background scene, like this:

Facebook Camera version (Sometimes using the landscape format works properly, sometimes it doesn't. In this case, I gave up after restarting five times.)
Spark version

Note the size of the pictures in the last two examples. Spark uses the dimensions of a mobile phone, Camera produces a more conventional image.

Finally: saving images. Spark, in my case, saved images directly into the iPad photo album.

Facebook Camera, on the other hand... Unless you actively go into the Facebook Archive feature, and turn it on, the images are only stored for 24 hours! I am hoping there is a way to retrieve some images I made, but so far have not been able to find a way to bring them back. Frustrating, as I am 99.9% sure I pressed "save" on the Facebook Camera app.

All images were created with an iPad.

Happy to reply to any questions or comments. Thanks for stopping by!

..............................................

I have to thank Dana Moreira S Hagan A LOT. For personal reasons, I unexpectedly found myself in Austin on a Tuesday, with the need to have the new version of Bubiko loaded in my tablet by 1PM the following Saturday.

On Wednesday, I went to Facebook, presented them with this letter:

Although I was told they would get back to me, they haven't. After constant searching, including meeting the very helpful PJ and Ramona at Impact Hub, I discovered Capital Factory. There were two events going on that night (Thursday), but two people, Brance Hudzietz and Erin Miller, put my request out on two different networks!

Finally, on Friday, about 6, I discovered Erin Ford at General Assembly. Thanks to Erin, about 7PM I started a phone conversation with Dana. Dana did not have the Mac-with-Mojave that was so desperately needed, but she did come through with the idea to use Facebook Camera which was an even better choice for testing.

Dana is great! https://dhagandev.github.io

San Francisco: Traffic Studies

There is a similar series of images about Detroit here.

The San Francisco Bicycle Coalition is one of the largest and most effective bicycle advocacy groups in the United States, and their efforts are impacting street usage.

Augmented Reality's impact upon the world of bicycling is of great interest to me, and this interest has, in turn, lead me to research street surfaces, traffic apps and autonomous vehicles. I am now working on a "live" book that summarizes my research. It is called AR on Wheels and it is on Amazon.

San Francisco
San Francisco signage
Stop light for bicycles.
Bike stoplight in action
A bicyclist, a pedestrian and vehicles sharing the street.
I am not sure how to read this...
Public transportation, vehicle of private enterprise.
An emergency and a man who is probably going to work.
Street cleaning is a part of traffic planing.
How well does that tree protector function as a bike rack?
Parking is king!
How do autonomous vehicles "see" these two?
Autonomous vehicles can shift gears perfectly... right?
One Sunday morning.
Road maintenance.
Streetlights: another part of transportation and urban life.


On the train from the airport into the Tenderloin, to see the premiere of Bubiko Foodtour!

Near the City Lights Bookstore. Beautiful, but it would seem that, at certain times of the day, anyone driving, riding or walking would be looking right into the sunset.


On August 8th, I will be giving a talk on Augmented Reality and Autonomous Vehicles at Altimetrik in Detroit. Stop by!

Detroit: Traffic Studies

As I become more involved AR's potential impact upon traffic, I see roads, vehicles, pedestrians and bicycles differently. The following documentary photographs are study aids; barely related to my previous street photography projects, such as the Bus Stopping series.

There is also a study of San Francisco here.

A terrible photograph, but a great example of the realities of the street. Glare attacks everyone. If there were a dependency upon a device displaying crucial information, what would happen in this situation?
Waze and other apps provide the latest info on detours, construction , travel times and more. With Waze, the data is crowdsourced. What relationships will be formed between these kinds of apps and autonomous vehicles?
The overall picture of bicycle parking in Detroit: what does it look like?
Ebike parking?
What is the future of the parking lot?
Detroit's original layout.
Dashboard of one of May's autonomous vehicles.
One of May's AVs moving out into traffic.
For nearly one hundred years, Detroit has created our perception of what a car is. Let's see what happens next...

I will be making a presentation about Augmented Reality and Autonomous Vehicles at Altimetrik, on August 8, 2019.

There are a number of posts about AR and bicycling here.

These photographs were taken during Detroit Startup Week.

Bubiko: one afternoon in Toledo

Bubiko's guide to AR is now available on Amazon!

San Francisco, Rose City MI, and soon the Pierogi Festival... Bubiko is on the go! In these photos, she hung out with some models at Rustbelt Coffee and then walked around downtown.

One of the hundreds of castles that comprise the Toledo cityscape.
Discussing nutrition at Rustbelt Coffee.
Stephen Black stopped by to take this photo.
Somebody was asked to stop dancing on tables...
Bubiko, contemplating a Rust Monkey Smoothie.
We'll always have pears.
Wow. Kenny at Jumpstart shared a lot of information on angel investors... so much to think about.
Believe it or not, someone was wearing this shirt!
The most famous mural in Toledo, right next to Jack Wilson's sculpture studio. Just down the street from Seed Coworking space.

More scenes of Toledo.

Bubiko was made by Novaby, based on ideas by Stephen Black and Sayuri Okayama.

Bubiko Garage Band Solo camera test

Bubiko's guide to AR is now available on Amazon!

More testing. Another test is here. Playing around for now, getting ready for when AR filmmaking gets serious.

Again, Bubiko's other camera test is here. Bubiko's activities, including her talk at MIT and appearance at SXSW are here.