Category Archives: Bubiko Foodtour

BLAM ! Bubiko Foodtour on the road!

Bubiko's schedule has been changing very rapidly in the past few days. Here is the latest:

Austin Startup Week: September 22-25 attendee

London: presentations date to be determined

Berlin: presentations date to be determined

Munich: presentation at Open Augmented Reality Cloud Symposium Oct 16

Munich: attending AWE October 17/18

Turin attending View October 21-24

Paris: presenting at PARIS October 25

2020

MIT Attending ARIA, where I presented this year

SXSW2020 Attending, Sayuri Okayama and I are possible presenting:  SB Proposal SO Proposal 

Shenzhen, China: March presenting at Trouble Maker      my article about Shenzhen

Singapore: Biennale November 22, 2019, through March 22, 2020

Shenzhen: March 28/29 attending AWE China

Tokyo: April Tama Art University

Ashiya,Japan: April date to be determined

....................

Bubiko is a little chef who has been having some exciting adventures in AR, Augmented Reality. Bubiko was born at Novaby and made her public debut at Tech in the Tenderloin.

Bubiko, in Detroit, thinking about her pierogi : steamed or fried?

Stephen Black is a writer, a visual artist and marching along the path of Spoken Word.

Ar entrepreneur Stephen Black interview
Kevin Turley, from Mount Bonnell Media, interviewing Stephen Black at SXSW2019. The video is here.

This post is exploratory.

Stephen Black and Bubiko Foodtour are now looking for opportunities to make presentations, or do collaborations with musicians, artists, writers or AR practitioners in these cities.

(BLAM is also a reference to SLAM: Simultaneous Localization And Mapping, a process associated with AR.)

Stephen Black has given presentations at Sasin School of Business, MIT Media Lab, Hong Kong PolyU, TechCrunch Shenzhen and the Collider at Alitimetrik (Detroit). This post is about his projects and this post is about Bubiko's.

What we hope to do, are open to:

  1. Find AR collaborators. Do you have an AR software that could use a cute little chef? (Bubiko has been in Facebook Spark and Facebook Camera projects, as well as an AR game demo made by Dominique Wu from Hummingbirdsday Studios. Two projects using Artive are here and here.
Image from game demo by Dominique Wu and Michael Stragey.
Bubiko's book is available on Amazon.

2. Consultations regarding AR, or projects needing a producer.

3. Meeting with galleries regarding an AR exhibition. Stephen Black curated SPOKEN with pioneering AR artist Eugene Soh.

www.gallery.sg

4. Meetups/ presentations about AR and its relationship with bicycles, Autonomous Vehicles, traffic and more. This presentation has been updated:

Autonomous Vehcles and Augmented Reality from stephen black

5. Readings: topics include Bali, Obama, Furikake, Singapore, Art and more. Fact-based poetic fiction...

a guitarist and a reader onstage
Stephen Black reads from Bali Wave Ghost, accompanied by Rizal Abdulhadi

6. Would be happy to chat with publishers about writing projects, cross-promotion, printing and distribution.

7. Publicity: any contacts with podcasters, bloggers ,newspapers, magazines etc. greatly appreciated.

Augmented Reality in Asia
article about Stephen Black, Sayuri Okayama and Bubiko Foodtour in Ipoh, Malaysia.

Thank you for your time and consideration!

Stephen Black and Bubiko Foodtour

Bubiko Foodtour’s Unusual Guide to Augmented Reality

This blog post is a sample of the guide, which is available on Amazon.

the cover

INTRODUCTION

Hi.

Welcome to R3.

This is a response to an urgent need to share information.

 Influences: a. “make it fast, not perfect” 

                    b. wabi-sabi

                    c. ash from chaos 

                    d. Chungking Express 

                    e. The Zone System by Ansel Adams and Minor White

No person or company has paid me to have their name or product included in this document.

I am now notifying the companies and individuals mentioned. If your work is here, and I have not yet contacted you, I apologize. If you prefer that I do not share your work, let me know and  I will remove it immediately.

No one has received a promotional copy. If you have bought this, and we meet, I will buy you a beverage. Or two. If you bought this and it seems unlikely that we will meet, I will send you my other ebooks or find a way to make sure this purchase is something you are very happy with. Hint, hint, Bubiko and I are working on an app. (Many times in the past, I  have given out free ebooks; only to be surprised that people did not even open them; even my bestseller.)

If you use photos or text from this document, please credit accordingly:

Photo by Stephen Black from Bubiko’s Unusual Guide to AR

Text by Stephen Black from  Bubiko’s Unusual Guide to AR

Have a nice day.

onwARd,

Stephen Black

9/3/2019 4th edition

A

Anchor  The three points used to describe the location, in the real world, where an AR object has been placed. The more one understands about 3D geometry, the more one is prepared for AR. See also billboarding, geopost.

AR Cinema  Soon! http://www.blacksteps.tv/towards-an-understanding-of-ar-cinema-possibilities/

Arbicle  Any piece of bicycle equipment with AR capability.

A list of articles and links about AR, arbicles and bicycles: http://www.blacksteps.tv/arbike/

ARCore  The platform used to make apps for Android mobile devices. Released in 2018.

ARKit  Apple released ARKit in 2017; it is the platform used to make apps for iOS mobile devices.

[AR]T https://news.artnet.com/opinion/apple-augmented-reality-art-1624540

Augmented Driving  AR will increase the amount of information available to drivers, thus increasing driving skills and traffic safety, especially when combined with AI.

www.thedrive.com/tech/9548/the-biggest-opportunity-everyone-is-missing-in-self-driving-cars

https://panelpicker.sxsw.com/vote/100430

What Augmented Driving Will Feel Like, a SXSW presentation by Theo Calvin.

Avatar  A digital creation used to represent a person, possibly resembling a human, possibly not.

Augmented Reality  To ‘augment’ means to make something greater; to give it more power. The platform called ‘augmented reality’ is a network that adds digital information to real objects. Machines are needed to do this, and  to see the results. Thus, augmented reality is the real world and the digital information added to it, as well as the machines enabling us to experience both at the same time.See R3

   Digital information could be in the form of a 3D model of a real object made by a computer, like the furniture in AR apps made by Ikea, Wayfair and other companies.  Pokemon Go and Snapchat are other examples of AR. However, the digital information could also be live or pre-recorded video, music, podcasts,medical imagery, industrial blueprints, text information or many other types of content.

   A mobile phone, tablet, HMD (head mounted device) or eyewear is needed  to see/hear/feel the digital content.

   AR will change everything, even more than radio, television, computers and mobile phones.

Autonomous Vehicles  Vehicles capable of sensing their environment, making decisions and navigating without human input. AVs require the safest, most efficient AR data networks possible.

Augmented World Expo (AWE)  Over ten years old and still visionary. Recommended: https://www.youtube.com/watch?v=WX-geVGmOvY

B

Billboarding The term used to describe a common procedure when positioning models in AR. Billboard means that the front view of the 3D model faces the viewer. Most AR apps allow the user to rotate the model so that another side of the model is presented to the viewer.

Bubiko in the starting position; ie billboarded.

Babble Rabbit The AR masterpiece of 2019.

Occlusion, light estimation, voice commands and more:

Patched Reality and 6d allow you to learn three years worth of ARness, and see the future: 

                                                                            https://patchedreality.com/                    https://www.6d.ai/

Bubiko Foodtour AR’s first superstar, a character created by Stephen Black and Sayuri Okayama. Bubiko is one of the results of a two year food/AR research trip in Southeast Asia. Bubiko is a trailblazer who shares her AR experiences with the general public as well as with AR practitioners. Bubiko often forms partnerships, such as one with Green Bean Boy, a character made by Dominique Wu at Hummingbirdsday Studios http://www.hummingbirdsday.com/. Other collaborations are planned with the Dundercats, by Six Cat Studios https://www.sixcatstudios.com/journal/2018/4/24/the-dundercats, and creations by David Severn http://david-severn.com/ . The 3D version of Bubiko was created by Novaby. https://www.novaby.com/

Bubiko at the Mascot Hall of Fame

                                                                                                     

Bubiko debuted at the Tech in the Tenderloin event. http://www.blacksteps.tv/tech-in-the-tenderloin-2019-salvation-army-kroc-center-san-francisco/

C

Cannondale AR for bikes https://www.youtube.com/watch?v=-F3jXZDNj38

Charlie Fink's Metaverse - An AR Enabled Guide to AR & VR

Cloud see R3

Computer vision Computers use lenses, radar and many kinds of sensors to learn about the world. These different ways of “seeing” are often combined with Artificial Intelligence(AI). The end result is that computers recognize objects as well as the many kinds of information connected to them.

Convergence

Convergence author and Forbes columnist Charlie Fink tells the story of Augmented Reality (AR), a new technology that's already seeping into every smartphone and every workplace. AR's merger with new 5G and AI technologies will unleash a wave of innovation that will enable wearable, invisible, latency-free and ubiquitous computing. The book uses a kind of mobile AR called "marker AR" to allow readers to use their smartphone to bring pages to life, demonstrating with art and entertainment how the world, and every person, place, and thing, will be painted with data. https://www.amazon.com/Convergence-World-Will-Painted-Data/dp/0578460556/

D

Depth sensing Recording scenes in 3D dimensions. See volumetric video

Debbie Ding An artist and a lecturer in Singapore. Some of Debbie’s students’ work can be seen here: http://www.blacksteps.tv/ar-hkpolyu-followup-2-students-work/

Dr. Ludo's Events on Hi-Techs4Humans: Workshops, Seminars, Lectures, etc. (Facebook)

E

Edge computing There are advantages to processing data as close to the user as possible, especially in regards to the Internet of Things. This means, to a large extent, a decentralized system. This localized/decentralized approach is called edge computing.

https://www.networkworld.com/article/3224893/what-is-edge-computing-and-how-it-s-changing-the-network.html

End User The person who uses the app or device. Always important, but especially when the product is meant for a specific demographic, like the elderly.

Eye Tracking The measurement of eye motion and activity.

Eugene Soh The Dude. Probably the first in Asia (who isn’t a Facebook employee) to create an Instagram Filter. https://www.dude.sg/    www.gallery.sg  

F

Facebook Spark vs. Facebook Camera http://www.blacksteps.tv/bubiko-foodtour-test-facebook-spark-vs-facebook-camera/ = �U0���

Thank you for your interest. The rest of the definitions are available at Amazon, in the guide itself.

Bubiko and the Pierogi

Bubiko's guide to AR is now available on Amazon!

Bubiko is a little chef from Thailand. Her favorite food is mango sticky rice, and her favorite expression is "Aroi mak mak", which means very delicious in the Thai languge. Sayuri Okayama and I have been brainstorming about food and augmented reality since 2016, when we used a paper version of Bubiko.

Augmented Reality in Asia
Ipoh, Malaysia and an article in the Malay Mail
paper doll grey boxing for AR
A baby picture.

Finally, in July 2019, we had a 3D version of Bubiko. Novaby did a great job, and using the Facebook Spark and Facebook Camera apps, we were ready to augment reality with our little chef. The Facebook Camera idea and tech support were thanks to Dana.

Whiting, Indiana is home to both the Mascot Hall of Fame, and the Pierogi Festival. We decided to visit both on the same weekend, and had Bubiko's balloons decorated accordingly. Later, we took Bubiko to pierogi festivals in Detroit, Michigan and Toledo, Ohio.

Bubiko at the Mascot Hall of Fame

Food and AR

End User or End Product

Is AR being used to create a user experience or an image to be used for publicity, marketing or other purposes?

Image made with Facebook Camera. Here Bubiko is promoting the event. Because this was made with FB Camera, Bubiko cannot be moved; once Dana set her position, she could not be moved.

Food close-up with Bubiko branding. Bubiko is our flagship, our beta tester. For now we have only one pose, but other poses and animated movements are in the works. Ultimately we aim to be the Pixar of AR; original characters, stories and software.
As seen on an iPhone 6 in Japan.
Scaling and size can be variable. This image was created with Spark AR which, unlike Facebook Camera, allows for different positioning and size of the model. Here Bubiko poses with the Licorice Guy and the Licorice Gal, one of the few non-pierogi vendors at the Pierogi Festival in Whiting.
To see more experiments in AR size, click here.
A small version of Bubiko with some of her favorite buscias at the Pierogi Fest in Whiting. Click here to learn about the buscias and other characters at the Pierogi Fest.
Bubiko is part Hello Kitty, part Anthony Bourdain. During our time in SE Asia, we did extensive research on local foods, as evidenced by Bubiko's Instagram account. Bubiko also did a photo book on the food of Ipoh, Malaysia and is planning one on Shenzhen, China.
Bubiko Foodtour
A guide to the food of Shenzhen. I Ate Tiong Bahru is my bestseller about the food and culture of Tiong Bahru, a community in Singapore.
As the population of "digital people", like Mike, continues to grow, some will become waiters, waitresses. maitre des and somelliers.

SXSW!

At present the following are only proposals. Of course we hope they happen. Please vote!

AUGMENTED REALITY AND FOOD: THE FUTURE OF DINING

This one is by my partner, Sayuri Okayama: AUGMENTED REALITY AND FOOD

This is my proposal, featuring Bubiko: XR: BIKE SAFETY, MUSIC AND BUBIKO FOODTOUR

Bubiko at the Mascot Hall of Fame

Bubiko's guide to AR is now available on Amazon!

Bubiko stopped by the Mascot Hall of Fame to meet Reggy and his furtastic friends! She also made time to sample pierogis at the Pierogi Festival!

Bubiko at the Pierogi Festival

Bubiko's guide to AR is now available on Amazon!

Pierogis are Polish dumplings. Bubiko is a little chef from Thailand. Roll out the barrel and let the fun begin!

Bubiko Foodtour test: Facebook Spark vs. Facebook Camera

Bubiko's guide to AR is now available on Amazon!

Novaby: 3D Model of Bubiko

Dana De Moreira S Hagan: Technical Support

Bubiko Foodtour's AR life began at the Tech in the Tenderloin event in San Francisco. Since that time, I have conducted tests like this, and this, in order to prepare for AR cinematography projects.

This post presents lessons learned with the Facebook Spark application, and compares Spark to a different AR application called Facebook Camera.

The 3D model of Bubiko is the same in both the Camera and Spark tests. The balloons were slightly modified, as one features Tech in the Tenderloin, and the other feature Reggy, the mascot of the Mascot Hall of Fame.

Color correction was made, in both cases, with the 'auto' function. Spark is brighter than Camera.

Spark allows the camera person to move around the model, as though it were a physical object. Spark also allows the size of the model to become different sizes. With Facebook Camera, the position and size of the model are locked. Only the front of the model can be seen, like a 2D image. Like a postage stamp.

In this case, Dana positioned Bubiko on the bottom right. We checked this position so that it also works in landscape mode. However, landscape mode seems to be unstable, based on my experiences. Fb Camera often enlarges and turns the background scene, like this:

Facebook Camera version (Sometimes using the landscape format works properly, sometimes it doesn't. In this case, I gave up after restarting five times.)
Spark version

Note the size of the pictures in the last two examples. Spark uses the dimensions of a mobile phone, Camera produces a more conventional image.

Finally: saving images. Spark, in my case, saved images directly into the iPad photo album.

Facebook Camera, on the other hand... Unless you actively go into the Facebook Archive feature, and turn it on, the images are only stored for 24 hours! I am hoping there is a way to retrieve some images I made, but so far have not been able to find a way to bring them back. Frustrating, as I am 99.9% sure I pressed "save" on the Facebook Camera app.

All images were created with an iPad.

Happy to reply to any questions or comments. Thanks for stopping by!

..............................................

I have to thank Dana Moreira S Hagan A LOT. For personal reasons, I unexpectedly found myself in Austin on a Tuesday, with the need to have the new version of Bubiko loaded in my tablet by 1PM the following Saturday.

On Wednesday, I went to Facebook, presented them with this letter:

Although I was told they would get back to me, they haven't. After constant searching, including meeting the very helpful PJ and Ramona at Impact Hub, I discovered Capital Factory. There were two events going on that night (Thursday), but two people, Brance Hudzietz and Erin Miller, put my request out on two different networks!

Finally, on Friday, about 6, I discovered Erin Ford at General Assembly. Thanks to Erin, about 7PM I started a phone conversation with Dana. Dana did not have the Mac-with-Mojave that was so desperately needed, but she did come through with the idea to use Facebook Camera which was an even better choice for testing.

Dana is great! https://dhagandev.github.io

Bubiko in Lawnspace screen test

Bubiko's guide to AR is now available on Amazon!

Bubiko: what is a stage?

The goal is to prepare for the possibilities of AR cinema.

This post documents a simple test. The Bubiko model used for the Tech in the Tenderloin event was used. Two locations: a garage and an open piece of land. The objective: to gain an understanding of what a “stage” can be in AR. AR is a new medium; to use the established techniques of theatre, television and movie is to fail to grasp the uniqueness of AR. Performance art and dance provide clues.

Notes: Spark used

  • Occlusion not a concern at this time
  • Ambient light a constant
  • Size and scaling of Bubiko purposely varied

Bubiko was created by Stephen Black and Sayuri Okayama

  • iPad used; no manual controls nor color correction
This is Bubiko Foodtour, still with the balloons and banner she used for her debut in San Francisco, at Tech in the Tenderloin’s 2019 TNT Tech Fest,  Bubiko is a work in progress, this is not her final version.
Bubiko is a 3D model made by Novaby, based on ideas by Stephen Black and Sayuri Okayama.
These images are a screen test of sorts, a way of documenting the possibilities and challenges of AR cinematography.
AR cinematography is one of my AR goals, especially making content for autonomous vehicles.
In these images. Bubiko was positioned near the white log. Only the camera (an iPad) moved. The software used was Spark. It was stable, except when used at long distances, in which case Bubiko appeared some distance away from the post.
The camera automatically controlled exposure. The light was even, the time being late afternoon/early twilight.
Occlusion was not important in this test, but I would love to use a software like 6D for testing.
Again, Bubiko did not move, but her size was changed in camera. AR cinema reminds me of machinima. There is another test of Bubiko HERE.
The format of the screen size is both an opportunity and a challenge.
Bubiko Foodtour models for some AR camera tests.
Interesting that the same model can have the size of a mouse, or a giant, or anything in between. Size in AR was the topic of this blog post. Thanks again to Fabian Winkler.
Bubiko is actually closer to the stump than this image suggests.
Sparks had some difficulty as I moved away from Bubiko's position. For this experiment it was simply an interesting development. If this were actually part of an movie shoot, I would reposition her, or do testing. It should be noted that wifi was not needed to create these images.

Stephen Black’s AR/VR/spatial computing experiences

SB with Bubiko Foodtour

Stephen Black: This post is a breakdown of my experiences with AR/VR/Spatial Computing. It starts with 2002, though I received a BFA in Photographic Illustration from the Rochester Institute of Technology  well before that.

Before 2002, I lived in Tokyo, Manhattan, Paris and Hong Kong, and worked in network TV, fine arts, photography and music. A fuller biography can be found here. But AR is the topic of this post...

2002-2007. In Singapore I worked as a creative director for a 3D game making company that was also doing something like Youtube,-- but three years before Youtube. Although I was not a developer, I learned a great deal about spatial computing, and taught 3D gamemaking in Singapore, including classes at the Singapore Science Center. It was during this time, that David Severn and I developed the Secret Donut World characters.

Vance

2007- 2014 Singapore/Bali: wrote novels, including a bestseller, was involved with 3how and researched VR and AR.

2014 SPOKEN, with Eugene Soh; a curation of a wide range of artists.

SPOKEN, a virtual gallery

2014 The Oculus signaled the emergence of VR, and I began notes for a book about VR cinematography.

2015 In Singapore, a chance meeting with Ender Jiang, the founder of Hiverlab, resulted in the opportunity to make my first 360 film.  Ender provided me with technical support and creative freedom and I am extremely grateful for that opportunity. The resulting film, Beach Road, featured a soundtrack by Bani Haykal and Chen Yi Qi, and was selected as a demo VR film in the Hybrid Arcade session of the Brisbane Asia Pacific Film Festival in November 2015, and was nominated as the Best Experimental VR Film in the VR Fest Las Vegas 2016. It was also fetured in a VR film festival at the Singapore national Museum. Beach Road was receiving a healthy number of views and comments before a technical change in Google Play took it off. At the time of this writing, Beach Road is on Veer and has received almost 5000 views.

360 films
Stephen Black, in the film he co-produced with Hiverlab

2016 The year began with discussing a VR startup idea with VCs in Singapore. Though the discussions went well, the lack of a prototype slowed things down. Shortly after, the release of ARCore and ARKit resulted in a halt to VR the possibilities of AR were assessed.

By April, AR had become the focus and the decision was made to become the "Pixar of AR": original characters, stories and software. With Sayuri Okayama, Bubiko Foodtour was originated.

Sayuri Okayama with a prototype of Bubiko

2017 Ipoh: demonstrations of AR, including what is probably the world’s first photo exhibition in AR. The photos also appeared in an ebook by Bubiko Foodtour.

Augmented Reality in Asia
article about Stephen Black/Sayuri Okayama/Bubiko Foodtour in Ipoh

2018 A presentation about AR was given at Sasin School of Business in Bangkok, later followed by two presentations and two workshops at Hong Kong PolyU, all at 80% capacity or higher.

Augmented Reality Stephen Black in Thailand
poster for Stephen Black's presentation about AR at Sasin School of Business
Presentations and workshops by Stephen Black
Stephen Black holding a Qoocam 360VR camera, as part of his presentation at the 2018 Maker Faire at HK PolyU.

2018 Lotus Mountain, a 360 film was shot and post production began including VR art contributions from Scobot and a soundtrack by Rei Shimizu. The film is at least 80% done and finishing funds are now being searched for. Lotus Mountain was supported by Kando, and 8K Obsidians were used for most of the shooting. Noted Chinese VR filmmaker Leo Wei co-directed and produced.

Chinese city landmarks
Shenzhen Civic Center at night, primary location for Lotus Mountain.
from Lotus Mountain

Bubiko at the Rise festival in HK

Hong Kong Comicon

2018 Cross-promotional and development partnership with Six Cats Studios (HK), focusing on their original IPs, Ollie and Charlie.

AR in musical education
The Dundercats, by Six Cat Studios.

2018 Presentations in Shenzhen, including Le Wagon and Tech Crunch Shenzhen.

Hummingbirdsday
Screen capture from an AR game by Dominique Wu.

2018 In a partnership with Hummingbirdsday Studios, Bubiko appears in an AR game demo with Green Bean Boy.

2019 Presentation at ARIA, MIT, resulting in, among others, working relationship with Novaby and UARexperience

2019 Toledo, Ohio. Presentations, including coffee shops, libraries and a collaboration with sculptor Jack Wilson for the Old West End Festival.

2019 SXSW during the 10 day event attended seminars and developed personal connections with AR and VR practitioners.

W
With WWE championship belt

2019 AR presentation as part of GOBA-the Great Ohio Bicycle Adventure. Premier of the AR and Bicycle Safety ebook.

bicycle safety
Bubiko Foodtour looks up while thinking about what to order

2019 As part of  Novaby’s presentation in the Tech in the Tenderloin Festival, the 3D version Bubiko will be making her public debut. The Black Hawk Jazz Club AR project by Novaby will also be presented-not to be missed!

We are now looking for funding for the Bubiko app... Stay tuned!

Preliminary metacarpal results

Hi! Stephen Black here!

Following are works in progress for a project for a health provider. This is a very basic TEST for a short film and far from complete. Bubiko's mouth for example, does not properly move yet.

Simply, please do not share with anyone unless they are a professional.

Our partner, the 3D model making company, NOVABY, is doing a superb job, but the newer versions of these scenes are confidential.

Drop me a line if you would like to know how Bubiko could help your business in terms of video, animation, AR and VR...

Also, I would like to thank Vik at Evoaura Records for the music and Alexis Smith for her vocal performance. Hats off to Six Cats Studio as well, for technical guidance.

SXSW Overview by Bubiko Foodtour

Wild, informative and fun, SXSW 2019 was ten days of chaos of the best possible kind. Bubiko was there!

Austin Chronicle, Bubiko Foodtour
Big yellow sign, little Bubiko

Gaming and VR blog post

Overall Impressions Photo Essay

Bubiko's Adventures at SXSW!

Music

radiocassette player art
Art by Slep

Stephen Black at SXSW

Food at SXSW coming soon!

Bubiko's Instagram has a few posts about SXSW and Austin, like this one.

Bubiko's adventures at MIT and beyond

Who is Stephen Black?

man with VR headset and AR on his tee shirt

3how Riverwalk Session

NOVABY!