Category Archives: AR

Bubiko Foodtour test: Facebook Spark vs. Facebook Camera

Bubiko's guide to AR is now available on Amazon!

Novaby: 3D Model of Bubiko

Dana De Moreira S Hagan: Technical Support

Bubiko Foodtour's AR life began at the Tech in the Tenderloin event in San Francisco. Since that time, I have conducted tests like this, and this, in order to prepare for AR cinematography projects.

This post presents lessons learned with the Facebook Spark application, and compares Spark to a different AR application called Facebook Camera.

The 3D model of Bubiko is the same in both the Camera and Spark tests. The balloons were slightly modified, as one features Tech in the Tenderloin, and the other feature Reggy, the mascot of the Mascot Hall of Fame.

Color correction was made, in both cases, with the 'auto' function. Spark is brighter than Camera.

Spark allows the camera person to move around the model, as though it were a physical object. Spark also allows the size of the model to become different sizes. With Facebook Camera, the position and size of the model are locked. Only the front of the model can be seen, like a 2D image. Like a postage stamp.

In this case, Dana positioned Bubiko on the bottom right. We checked this position so that it also works in landscape mode. However, landscape mode seems to be unstable, based on my experiences. Fb Camera often enlarges and turns the background scene, like this:

Facebook Camera version (Sometimes using the landscape format works properly, sometimes it doesn't. In this case, I gave up after restarting five times.)
Spark version

Note the size of the pictures in the last two examples. Spark uses the dimensions of a mobile phone, Camera produces a more conventional image.

Finally: saving images. Spark, in my case, saved images directly into the iPad photo album.

Facebook Camera, on the other hand... Unless you actively go into the Facebook Archive feature, and turn it on, the images are only stored for 24 hours! I am hoping there is a way to retrieve some images I made, but so far have not been able to find a way to bring them back. Frustrating, as I am 99.9% sure I pressed "save" on the Facebook Camera app.

All images were created with an iPad.

Happy to reply to any questions or comments. Thanks for stopping by!

..............................................

I have to thank Dana Moreira S Hagan A LOT. For personal reasons, I unexpectedly found myself in Austin on a Tuesday, with the need to have the new version of Bubiko loaded in my tablet by 1PM the following Saturday.

On Wednesday, I went to Facebook, presented them with this letter:

Although I was told they would get back to me, they haven't. After constant searching, including meeting the very helpful PJ and Ramona at Impact Hub, I discovered Capital Factory. There were two events going on that night (Thursday), but two people, Brance Hudzietz and Erin Miller, put my request out on two different networks!

Finally, on Friday, about 6, I discovered Erin Ford at General Assembly. Thanks to Erin, about 7PM I started a phone conversation with Dana. Dana did not have the Mac-with-Mojave that was so desperately needed, but she did come through with the idea to use Facebook Camera which was an even better choice for testing.

Dana is great! https://dhagandev.github.io

San Francisco: Traffic Studies

There is a similar series of images about Detroit here.

The San Francisco Bicycle Coalition is one of the largest and most effective bicycle advocacy groups in the United States, and their efforts are impacting street usage.

Augmented Reality's impact upon the world of bicycling is of great interest to me, and this interest has, in turn, lead me to research street surfaces, traffic apps and autonomous vehicles. I am now working on a "live" book that summarizes my research. It is called AR on Wheels and it is on Amazon.

San Francisco
San Francisco signage
Stop light for bicycles.
Bike stoplight in action
A bicyclist, a pedestrian and vehicles sharing the street.
I am not sure how to read this...
Public transportation, vehicle of private enterprise.
An emergency and a man who is probably going to work.
Street cleaning is a part of traffic planing.
How well does that tree protector function as a bike rack?
Parking is king!
How do autonomous vehicles "see" these two?
Autonomous vehicles can shift gears perfectly... right?
One Sunday morning.
Road maintenance.
Streetlights: another part of transportation and urban life.


On the train from the airport into the Tenderloin, to see the premiere of Bubiko Foodtour!

Near the City Lights Bookstore. Beautiful, but it would seem that, at certain times of the day, anyone driving, riding or walking would be looking right into the sunset.


On August 8th, I will be giving a talk on Augmented Reality and Autonomous Vehicles at Altimetrik in Detroit. Stop by!

Detroit: Traffic Studies

As I become more involved AR's potential impact upon traffic, I see roads, vehicles, pedestrians and bicycles differently. The following documentary photographs are study aids; barely related to my previous street photography projects, such as the Bus Stopping series.

There is also a study of San Francisco here.

A terrible photograph, but a great example of the realities of the street. Glare attacks everyone. If there were a dependency upon a device displaying crucial information, what would happen in this situation?
Waze and other apps provide the latest info on detours, construction , travel times and more. With Waze, the data is crowdsourced. What relationships will be formed between these kinds of apps and autonomous vehicles?
The overall picture of bicycle parking in Detroit: what does it look like?
Ebike parking?
What is the future of the parking lot?
Detroit's original layout.
Dashboard of one of May's autonomous vehicles.
One of May's AVs moving out into traffic.
For nearly one hundred years, Detroit has created our perception of what a car is. Let's see what happens next...

I will be making a presentation about Augmented Reality and Autonomous Vehicles at Altimetrik, on August 8, 2019.

There are a number of posts about AR and bicycling here.

These photographs were taken during Detroit Startup Week.

Bubiko: one afternoon in Toledo

Bubiko's guide to AR is now available on Amazon!

San Francisco, Rose City MI, and soon the Pierogi Festival... Bubiko is on the go! In these photos, she hung out with some models at Rustbelt Coffee and then walked around downtown.

One of the hundreds of castles that comprise the Toledo cityscape.
Discussing nutrition at Rustbelt Coffee.
Stephen Black stopped by to take this photo.
Somebody was asked to stop dancing on tables...
Bubiko, contemplating a Rust Monkey Smoothie.
We'll always have pears.
Wow. Kenny at Jumpstart shared a lot of information on angel investors... so much to think about.
Believe it or not, someone was wearing this shirt!
The most famous mural in Toledo, right next to Jack Wilson's sculpture studio. Just down the street from Seed Coworking space.

More scenes of Toledo.

Bubiko was made by Novaby, based on ideas by Stephen Black and Sayuri Okayama.

Bubiko Garage Band Solo camera test

Bubiko's guide to AR is now available on Amazon!

More testing. Another test is here. Playing around for now, getting ready for when AR filmmaking gets serious.

Again, Bubiko's other camera test is here. Bubiko's activities, including her talk at MIT and appearance at SXSW are here.

Bubiko in Lawnspace screen test

Bubiko's guide to AR is now available on Amazon!

Bubiko: what is a stage?

The goal is to prepare for the possibilities of AR cinema.

This post documents a simple test. The Bubiko model used for the Tech in the Tenderloin event was used. Two locations: a garage and an open piece of land. The objective: to gain an understanding of what a “stage” can be in AR. AR is a new medium; to use the established techniques of theatre, television and movie is to fail to grasp the uniqueness of AR. Performance art and dance provide clues.

Notes: Spark used

  • Occlusion not a concern at this time
  • Ambient light a constant
  • Size and scaling of Bubiko purposely varied

Bubiko was created by Stephen Black and Sayuri Okayama

  • iPad used; no manual controls nor color correction
This is Bubiko Foodtour, still with the balloons and banner she used for her debut in San Francisco, at Tech in the Tenderloin’s 2019 TNT Tech Fest,  Bubiko is a work in progress, this is not her final version.
Bubiko is a 3D model made by Novaby, based on ideas by Stephen Black and Sayuri Okayama.
These images are a screen test of sorts, a way of documenting the possibilities and challenges of AR cinematography.
AR cinematography is one of my AR goals, especially making content for autonomous vehicles.
In these images. Bubiko was positioned near the white log. Only the camera (an iPad) moved. The software used was Spark. It was stable, except when used at long distances, in which case Bubiko appeared some distance away from the post.
The camera automatically controlled exposure. The light was even, the time being late afternoon/early twilight.
Occlusion was not important in this test, but I would love to use a software like 6D for testing.
Again, Bubiko did not move, but her size was changed in camera. AR cinema reminds me of machinima. There is another test of Bubiko HERE.
The format of the screen size is both an opportunity and a challenge.
Bubiko Foodtour models for some AR camera tests.
Interesting that the same model can have the size of a mouse, or a giant, or anything in between. Size in AR was the topic of this blog post. Thanks again to Fabian Winkler.
Bubiko is actually closer to the stump than this image suggests.
Sparks had some difficulty as I moved away from Bubiko's position. For this experiment it was simply an interesting development. If this were actually part of an movie shoot, I would reposition her, or do testing. It should be noted that wifi was not needed to create these images.

Tech in the Tenderloin 2019. Salvation Army Kroc Center, San Francisco

Bubiko's guide to AR is now available on Amazon!

We were honored that Bubiko Foodtour could make her public debut at Tech in the Tenderloin’s 2019 TNT Tech Fest, a very special event in a very special venue in a very special city.

Bubiko went outside for a minute! She was hungry. She found corn dogs. Aroi mak mak!

Niantic, the company that made Pokemon Go and Wizards Unite (the Harry Potter game) was the Community Champion Sponsor!

Tech in the Tenderloin is much more than a one day event.

Exhibitors:

Black Girls Code Imagine. Build. Create.

Techtonica Fintech training for women and NB adults with low incomes

Code Tenderloin

Novaby is a global digital art production company.

TERC Because math and science build futures

Unconscious Bias Project 100% empowerment, 0% guilt trip. Reducing unconscious bias in STEM with fact, tact, art and activism

Tinkertech

Roybi Robot Innovative learning for children. The world's first AI-powered educational robot that makes learning fun for ages 3-7.

Inspire Me Box (website coming soon)

TinkerTech teaches early design and engineering skills through hands-on activities to students ages 4-12 including those from low income communities.

Teentend builds better communities.

NapTime Studio game development

Cookie Run is an online mobile endless running game in the Cookie Run series created by Devsisters. 

DaVinci Club AR makes kids move and explore the real world.

Electronic Frontier Foundation The leading nonprofit defending digital privacy, free speech, and innovation.

SF Environment Getting Food out of the Waste Stream and Into Hungry Households—Where It Belongs.

Recology A World Without Waste

Book Merah

Mission Bit courses are project-based semester-long coding courses, taught by college computer science majors and supported by volunteers who are professional software engineers.

ThrowMotion Bringing the excitement of world sports... home.

NewPathVR VR and AI solutions for psychological and emotional wellness.

Larkin Street Youth Services Since 1984, Larkin Street Youth Services has given more than 75,000 young people a safe place to rebuild their lives.

The Hidden Genius Project trains and mentors black male youth in technology creation, entrepreneurship, and leadership skills to transform their lives and communities.

Academy of Art University

California Community Colleges

Singularity University

With Sayuri Okayama, I would like to thank Novaby for doing such a great job in creating the 3D version of Bubiko. The version on display is a work in progress, and already the reception has been very positive.Thank you Novaby!

logo

independent publisher's logo

A logo designed by Stephen Black for Book Merah and other projects.

Bubiko Foodtour’s debut at Tech in the Tenderloin

Bubiko's guide to AR is now available on Amazon!

After three years+... the first baby steps of Bubiko Foodtour. Tech in the Tenderloin is an amazing event, this year again sponsored by Niantic. TNT was co-founded by June Sargent and Julia Beabout and we (Sayuri and Stephen) cannot thank them, and all involved, enough.

NEWS COVERAGE VIDEO HERE.

ANOTHER POST ABOUT THIS EVENT

We will write more about Tech in the Tenderloin, for now, I just want to share these.

3D models of chefs
Bubiko Foodtour's debut in the Tech in the Tenderloin

Obviously, many of these were shot off of a video monitor. With an older iPad. In low light. And, later the glaring green will be replaced with an interesting background.

FOR NOW, THESE PICTURES ARE PERFECT.

Here's a link to Bubiko at SXSW

When Harry Met Bubi

On Friday, June 28th, Bubiko Foodtour will make her debut in 3D/AR, at the Tech in the Tenderloin Event in San Francisco.

My background in TV, AR, VR and more.

This is exciting to me for two reasons.

It will be my first time to work with young American people...

In Singapore, I taught with this software, over ten years ago.
Teaching gamemaking in Singapore (This was a project led by Kerr Sun, now a top property agent in SE Asia/China.)
At the 2018 Maker Faire at Hong Kong PolyU.
computer users having fun
With Suphakorn Traisrisin testing the HP Reveal AR software with Bubiko Foodtour. Chiang Rai, Thailand.

Second, it will be my first time in San Francisco/the Silicon Valley with someone to bring to the IT/AR table... Bubiko Foodtour, the flagship character for our AR startup.

We need to make our MVP, Minimum Viable Product. Hire, or partner with a developer, OR find an angel investor to cover the 10K needed. The 10K,and a construction time of one month, are based on quotations from three AR experts.

Bubiko has paid her dues, and we think our MVP will do "alright " financially. Not only will our MVP scale, but we have other characters, like Secret Donut World and the Dundercats. We want to become the Pixar of AR +.

Stop by Tech in the Tenderloin and say hi! There are lots of great companies introducing their tech to the kids. Niantic will most likely be presenting their Harry Potter AR project.

Thank you very much for any ideas or contacts.

Bubiko Foodtour, thinking about the future-and what to eat! (Photo courtesy UARexplorer)
Bubiko Foodtour
One of Bubiko's book projects. She has also created a book of photographs of Ipoh, Malaysia. Bubiko's Instagram.
Austin Chronicle, Bubiko Foodtour
In the beginning, we used a paper doll to visualize what Bubiko could be.

Augmented Reality in Asia
article about Stephen Black in the Malay Mail
ARIA, at MIT, January 2019. It was here that we met Julia Beabout, from Novaby, the company that specializes in 3D models.
Invited to pitch to VCs at TechCrunch Shenzhen. It went extremely well; as far as these things can go when one has only a paper doll and an idea.
"Bubiko! You are not completely dressed yet! We're still fixing your hat!"

More info on Stephen Black here, including his bestselling book, his VR movies and a Unity-based online gallery project.

#whenharrymetbubi is, of course a reference to this classic movie.

Sayuri Okayama, co-creator of Bubiko.

Hummingbirdsday
Green Bean Boy is one of Bubiko's best friends. This image is from a test by Dominique Wu, the founder of the amazing Hummingbirdsday Studios, builders of apps, websites, AR and more.
Anger management
...and nice.