Category Archives: collaborations

Bubiko Scrapbook September 2019

Bubiko is a little chef from Thailand who loves AR. Her unusual guide to Augmented Reality is now on Amazon.

This post is an introduction to Bubiko's world.

July, 2017 Kuala Lumpur, Malaysia. Bubiko, the first paper version, based on a doll from Thailand. Bubiko is very knowledgeable about the food of Southeast Asia. Here she studies thunder tea rice.

July 2019 Pierogi Festival, Detroit. Bubiko. 3D version made by Novaby. In the summer of 2019, Bubiko debuted in two formats: Facebook Spark and Facebook Camera. Facebook Camera support by Dana Hagan.

doll with colorful drink
2017: At the Penang Food Festival in Kuala Lumpur. Bandung is the name of a popular drink. Aroi mak mak is Bubiko's favorite phrase. It means "very delicious"" in the Thai language.


https://www.instagram.com/p/Bs4hK_hH8cV/

Bubiko has an Instagram account. She also made one book:

Available on Amazon




Bubiko Foodtour
A guide to the food of Shenzhen, a work in progress.
Shenzhen is the Silicon Valley of China. A story about Shenzhen , written and photographed by Stephen Black for makermag.

ARKit games made with Unity
Presentation at Le Wagon, Shenzhen December 26, 2018 Pictured is an AR game collaborative test with Green Bean Boy, a character by Dominique Wu/Hummingbirdsday Studios.

November, 2018 Shenzhen. Stephen Black, pitching his unicorn idea to VCs at TechCrunch Shenzhen. (The unicorn idea is a separate idea from Bubiko/the Pixar of AR)

Sayuri Okayama, at the 2019 Reality Virtually Hackathon at the MIT Media Lab, sponsored by Magic Leap. 

S O with an early paper mockup of Bubiko. Ipoh Malaysia

A demonstration by Google in Kuala Lumpur.
computer users having fun
Chiang Rai, Thailand May 2018. Stephen Black and Suphakorn Traisrisin testing the HP Reveal AR software with Bubiko Foodtour.
Austin Chronicle, Bubiko Foodtour
A collection of Bubiko's 2019 SXSW blog posts are here.
Stephen Black's Bubiko-themed proposal for SXSW 2020 is here.
Sayuri Okayama's (Food + AR) proposal for SXSW 2020 is here.

Get behind it before it gets past you
Now on tour....Bubiko, Eggy, Ollie and Obasan A! R! Let's go!
Green Bean Boy and other AR characters
The plan: a tour of the US and Canada: readings, food tastings and AR, AR, AR.

SB at MIT. Next presentation by SB: OARC (Open Augmented Reality, Cloud) Munich, October 16, 2019.

Augmented Reality in Asia
Malay Mail article explaining Bubiko and her research about Southeast Asian food.
Bubiko is looking forward to the future, meeting other chefs and discovering new foods.

Bubiko's app is on its way! If you would like to be among the first to play with it, leave a message in the comment section. See you on Twitter , Facebook and Instagram!
BYE!

https://www.instagram.com/p/Bs4hK_hH8cV

Augmented Reality + Autonomous Vehicles: Stephen Black @ Collider

Bubiko's guide to AR is now available on Amazon!

The following are additions that were not discussed at the Detroit meetup.

https://www.forbes.com/sites/edgarsten/2019/08/12/turning-back-seat-boredom-into-a-virtual-theme-park/#712404fc6019

! https://www.thedrive.com/tech/9548/the-biggest-opportunity-everyone-is-missing-in-self-driving-cars

!! https://panelpicker.sxsw.com/vote/100430 (What Augmented Driving Will Feel Like, a SXSW presentation by Theo Calvin.)

I wish I had known about the projects and gentlemen above before my Detroit talk.

Do read the article by Alex Roy.

Please vote for Teo Calvin's SXSW proposal.

.......................

Presentation

Thank you very much to Jacob, Rahul and Altimetrik for making this happen. It was a blast! A description of the event, and an introduction to Collider is here.

SLIDE 2

Hyperreality by Keiichi Matsuda

https://www.rt.com/news/455341-chinese-hackers-tesla-autopilot/

https://mashable.com/article/nissan-ar-virtual-reality-windshield-display/

The Nissan video features outstanding visuals.

SLIDE 3

https://www.openarcloud.org/reports/sotarc-2019

The above link is a MUST for anyone with a serious investment in AR.

Novaby is the company that did/is doing a great job with Bubiko.

(Yes, all of the research you see is self-funded. If you can help with a donation or a job...get in touch, please. I am also a photographer, artist, videomaker and a writer.

SLIDE 4

You can see all of my adventures with Bubiko elsewhere on this blog. We would be grateful for your votes for two proposals for SXSW.

This is my proposal.

This is the proposal of Sayuri Okayama, my partner.

THANK YOU FOR YOUR VOTE!

SLIDE 5

This book is a "living" book. Meaning if you buy it, you will get the updated editions free.

SLIDE 7

BONNETS! (My Powerpoint looks extremely low tech. As much as I like this look, I have to say I had no choice. I was using my Chromebook , and used the baked in slide show creator. Next time, I might actually have the time to do some design work.)

SLIDE 8

Artivive One of my own Artivive demos is here. Another, here.

Leo

Bubiko Foodtour

Rouvy Augmented Reality Released: First Ride & Explainer.

DC Rainmaker does his usually outstanding job of reviewing a bicycle-related product.Jump into the video at about the 4 minute mark to see some exemplary AR techniques. Click here to see more examples and ideas related to AR+ Bicycles.

Cannondale, for the win! A great example of functional AR in an everyday situation, as opposed to a factory or medical facility.

SLIDE 9

From a presentation I did on AR and bike safety. All of those concepts need to be unified and rethought for the age of AR.

SLIDE 10

Mapillary

LADOT

Superworld

SLIDE 11

The Open Augmented Reality Cloud people are making efforts to establish a geopost standard. If you are serious about AR, follow their efforts, or better join them and let your voice be heard!

What you see is a test I did with Bubiko. While I was in a car, I positioned her in the road ahead. We then drove forward. It is not clear, and I will redo this test.

But what happened is that Bubiko was in front, then she appeared in the car, and then we saw her in the road behind us. She did not move with/in relationship to the car.

This was using Facebook Spark AR. Technical support: the amazing Dana.

Stunt driver: Norm Black.

No AR characters were harmed in the production of this rest.

SLIDE 12

OPEN AUGMENTED REALITY CLOUD

SLIDE 13

The AR Podcast is a must for anyone serious about AR. This is a link to the extremely informative and important interview with four of the people involved with OARC.

SLIDE 14

Thank you Sergei!

https://www.slideshare.net/sergiikozyrev?utm_campaign=profiletracking&utm_medium=sssite&utm_source=ssslideview

SLIDE 15

One style of point cloud rendering.

SLIDE 16

Another way to render a point cloud. There are many ways to create point clouds and they must be interoperable.

https://www.clarissewiki.com/3.6/creating_a_point_cloud.html

SLIDE 17

An example of an organization that has information that would be useful for AR in Detroit. Geographic Information Services… How much of what is under the road do they have records of? This info would be necessary for many AR services,

How do they make pointclouds-or do they even do this yet?

SLIDE 18

One of Magic Leap's views on how the total AR world might look like.

The layers presented include IoT (the Internet of Things, as well as AI. Photo courtesy of Tony at the Skarred Ghost, another person I suggest serious AR/VR people support and follow.

SLIDE 19

Another presentation from Magic Leap on how the total AR Cloud might look. They use the term "Magicverse".

SLIDE 20

A representation by the OARC on what the layers of the cloud would be. My suggested terms would be REAL1 (R1), REAL2 (R2) and REAL3 (R3). R1=the physical world. R2; the layer with few changes; buildings, landmarks, geography. R3 being the part of the AR cloud that changes the most, and has the most segmentation.

This system also lends itself to further classification. R2C22 , for example, could refer to a specific block in Chicago for example, and R2C22E could be the collective "channel" for all organizations utilizing traffic emergency communications for that area.

SLIDE 21

Microsoft Azure Spatial anchor systems. 'Anchor systems' refers to geoposing. There can be an endless number of clouds. Interoperability... Machines reading the world for humans... A browser...AI assisted browsers.

SLIDE 22

This is from the State of the Open AR Cloud 2019 report by the Open Augmented Reality Cloud group. Already some governing bodies are being formed.

The report is free. Get it here.

SLIDE 24

Ed Garten's article on AV safety, for Forbes magazine.

SLIDE 25

The League of American Bicyclists has an active interest in AR and AV.

https://www.bikeleague.org/content/automated-vehicle-overview-box

SLIDE 27

And the amazing BabbleRabbit! https://twitter.com/BabbleRabbit/status/1115271007315615750

SLIDE 28

https://www.researchgate.net/publication/314522858_Supporting_Trust_in_Autonomous_Driving

https://www.researchgate.net/publication/333645946_The_Impact_of_Autonomous_Vehicles'_Active_Feedback_on_Trust

SLIDE 30

An AV by May.

SLIDE 33

Shenzhen's celebration used the entire city as a canvas. Something like this could be done in Detroit with AR, for much less cost, and with greater detail. AVs could travel on programmed routes... a new form of musical is born!

My report on the maker culture of Shenzhen is here.

SLIDE 34

The Fox Theatre is one of Detroit's cultural assets that could be utilized. This slide shows some of the layers of creation and co-operation that need to be considered.

SLIDE 35

An example of an urban AR project, this one by Snapchat. This article also raises questions about AR in public spaces.

SLIDE 36

Diego! DIA! https://www.dia.org/art/rivera-court

SLIDE 37

http://amirbaradaran.com/2019/works-pages/fml.html

Go to the "0.52" mark to see the actual AR clip. It is very brief.

The video on this site by Artivive showcases some possibilities in regards to AR + flat art. https://artivive.com/walkietalkie/

SLIDE 38

Apple's AR Art program. https://www.apple.com/newsroom/2019/07/apple-offers-new-augmented-reality-art-sessions/

SLIDE 39

Back to bROADWAY… and we have "discovered" that the Fox Theater is geofenced. Geofencing is a blocking of AR access. Military bases, sensitive areas...the interior of homes. The Fox Theatre is copyrighted, I believe. In this fictional example, Fox may have geofenced their theater to prevent unauthorized AR usage.

SLIDE 40

MOTOWN!

SLIDE 42

Bose AR

So there ya go! Any questions ask below.

I am available for consultation and all kinds of AR producing, as well as photography, video, art and writing projects. Thank you for any ideas and/or opportunities.

And again, please consider voting for our two SXSW presentations:

XR: bike safety, music and Bubiko Foodtour

and

Augmented Reality and Food

THANKS!

onwARd,

Stephen Black

Tech in the Tenderloin 2019. Salvation Army Kroc Center, San Francisco

Bubiko's guide to AR is now available on Amazon!

We were honored that Bubiko Foodtour could make her public debut at Tech in the Tenderloin’s 2019 TNT Tech Fest, a very special event in a very special venue in a very special city.

Bubiko went outside for a minute! She was hungry. She found corn dogs. Aroi mak mak!

Niantic, the company that made Pokemon Go and Wizards Unite (the Harry Potter game) was the Community Champion Sponsor!

Tech in the Tenderloin is much more than a one day event.

Exhibitors:

Black Girls Code Imagine. Build. Create.

Techtonica Fintech training for women and NB adults with low incomes

Code Tenderloin

Novaby is a global digital art production company.

TERC Because math and science build futures

Unconscious Bias Project 100% empowerment, 0% guilt trip. Reducing unconscious bias in STEM with fact, tact, art and activism

Tinkertech

Roybi Robot Innovative learning for children. The world's first AI-powered educational robot that makes learning fun for ages 3-7.

Inspire Me Box (website coming soon)

TinkerTech teaches early design and engineering skills through hands-on activities to students ages 4-12 including those from low income communities.

Teentend builds better communities.

NapTime Studio game development

Cookie Run is an online mobile endless running game in the Cookie Run series created by Devsisters. 

DaVinci Club AR makes kids move and explore the real world.

Electronic Frontier Foundation The leading nonprofit defending digital privacy, free speech, and innovation.

SF Environment Getting Food out of the Waste Stream and Into Hungry Households—Where It Belongs.

Recology A World Without Waste

Book Merah

Mission Bit courses are project-based semester-long coding courses, taught by college computer science majors and supported by volunteers who are professional software engineers.

ThrowMotion Bringing the excitement of world sports... home.

NewPathVR VR and AI solutions for psychological and emotional wellness.

Larkin Street Youth Services Since 1984, Larkin Street Youth Services has given more than 75,000 young people a safe place to rebuild their lives.

The Hidden Genius Project trains and mentors black male youth in technology creation, entrepreneurship, and leadership skills to transform their lives and communities.

Academy of Art University

California Community Colleges

Singularity University

With Sayuri Okayama, I would like to thank Novaby for doing such a great job in creating the 3D version of Bubiko. The version on display is a work in progress, and already the reception has been very positive.Thank you Novaby!

Stephen Black’s AR/VR/spatial computing experiences

SB with Bubiko Foodtour

Stephen Black: This post is a breakdown of my experiences with AR/VR/Spatial Computing. It starts with 2002, though I received a BFA in Photographic Illustration from the Rochester Institute of Technology  well before that.

Before 2002, I lived in Tokyo, Manhattan, Paris and Hong Kong, and worked in network TV, fine arts, photography and music. A fuller biography can be found here. But AR is the topic of this post...

2002-2007. In Singapore I worked as a creative director for a 3D game making company that was also doing something like Youtube,-- but three years before Youtube. Although I was not a developer, I learned a great deal about spatial computing, and taught 3D gamemaking in Singapore, including classes at the Singapore Science Center. It was during this time, that David Severn and I developed the Secret Donut World characters.

Vance

2007- 2014 Singapore/Bali: wrote novels, including a bestseller, was involved with 3how and researched VR and AR.

2014 SPOKEN, with Eugene Soh; a curation of a wide range of artists.

SPOKEN, a virtual gallery

2014 The Oculus signaled the emergence of VR, and I began notes for a book about VR cinematography.

2015 In Singapore, a chance meeting with Ender Jiang, the founder of Hiverlab, resulted in the opportunity to make my first 360 film.  Ender provided me with technical support and creative freedom and I am extremely grateful for that opportunity. The resulting film, Beach Road, featured a soundtrack by Bani Haykal and Chen Yi Qi, and was selected as a demo VR film in the Hybrid Arcade session of the Brisbane Asia Pacific Film Festival in November 2015, and was nominated as the Best Experimental VR Film in the VR Fest Las Vegas 2016. It was also fetured in a VR film festival at the Singapore national Museum. Beach Road was receiving a healthy number of views and comments before a technical change in Google Play took it off. At the time of this writing, Beach Road is on Veer and has received almost 5000 views.

360 films
Stephen Black, in the film he co-produced with Hiverlab

2016 The year began with discussing a VR startup idea with VCs in Singapore. Though the discussions went well, the lack of a prototype slowed things down. Shortly after, the release of ARCore and ARKit resulted in a halt to VR the possibilities of AR were assessed.

By April, AR had become the focus and the decision was made to become the "Pixar of AR": original characters, stories and software. With Sayuri Okayama, Bubiko Foodtour was originated.

Sayuri Okayama with a prototype of Bubiko

2017 Ipoh: demonstrations of AR, including what is probably the world’s first photo exhibition in AR. The photos also appeared in an ebook by Bubiko Foodtour.

Augmented Reality in Asia
article about Stephen Black/Sayuri Okayama/Bubiko Foodtour in Ipoh

2018 A presentation about AR was given at Sasin School of Business in Bangkok, later followed by two presentations and two workshops at Hong Kong PolyU, all at 80% capacity or higher.

Augmented Reality Stephen Black in Thailand
poster for Stephen Black's presentation about AR at Sasin School of Business
Presentations and workshops by Stephen Black
Stephen Black holding a Qoocam 360VR camera, as part of his presentation at the 2018 Maker Faire at HK PolyU.

2018 Lotus Mountain, a 360 film was shot and post production began including VR art contributions from Scobot and a soundtrack by Rei Shimizu. The film is at least 80% done and finishing funds are now being searched for. Lotus Mountain was supported by Kando, and 8K Obsidians were used for most of the shooting. Noted Chinese VR filmmaker Leo Wei co-directed and produced.

Chinese city landmarks
Shenzhen Civic Center at night, primary location for Lotus Mountain.
from Lotus Mountain

Bubiko at the Rise festival in HK

Hong Kong Comicon

2018 Cross-promotional and development partnership with Six Cats Studios (HK), focusing on their original IPs, Ollie and Charlie.

AR in musical education
The Dundercats, by Six Cat Studios.

2018 Presentations in Shenzhen, including Le Wagon and Tech Crunch Shenzhen.

Hummingbirdsday
Screen capture from an AR game by Dominique Wu.

2018 In a partnership with Hummingbirdsday Studios, Bubiko appears in an AR game demo with Green Bean Boy.

2019 Presentation at ARIA, MIT, resulting in, among others, working relationship with Novaby and UARexperience

2019 Toledo, Ohio. Presentations, including coffee shops, libraries and a collaboration with sculptor Jack Wilson for the Old West End Festival.

2019 SXSW during the 10 day event attended seminars and developed personal connections with AR and VR practitioners.

W
With WWE championship belt

2019 AR presentation as part of GOBA-the Great Ohio Bicycle Adventure. Premier of the AR and Bicycle Safety ebook.

bicycle safety
Bubiko Foodtour looks up while thinking about what to order

2019 As part of  Novaby’s presentation in the Tech in the Tenderloin Festival, the 3D version Bubiko will be making her public debut. The Black Hawk Jazz Club AR project by Novaby will also be presented-not to be missed!

We are now looking for funding for the Bubiko app... Stay tuned!

Old West End

Hello to all.

The following image, when viewed with the free Artivive app, reveals "another dimension", a collaboration with the sculptor Jack Wilson.

The title: Falling Leaves in Spring.

Are you a resident of the Old West End?

Question: would you support a book about the Old West Side?

As you know, the Old West Side is a historical community full of distinctive architecture. Well... I have written a bestselling book about another historical community full of distinctive architecture.

That book is entitled i ate tiong bahru. It is one of my eight books. You can learn more about those books, and i ate tiong bahru, here. I should also mention Bus Stopping, a book of photographs.

Those books were written and self-published, mainly while I was living in Bali. To write about the Old West End would require time, and that means money. Do you think there could enough support for crowdfunding or other forms of support?

Also, any ideas on unusual exhibition spaces? I have a series of prints combine photography with text, and would like to present them to the public.

Thank you for your time and suggestions.

This is a collection of posts about Toledo: 419ness.

Happy to talk to anyone about video, photography, writing and AR.

onwARd,

Stephen Black

about me

A Victorian house in Toledo's Old West End

Bicycle, Art and AR experience

This is a simple demo of Augmented Reality.

To do this, two things are needed.

  1. A free download of the Artivive app. This should go on a mobile phone or tablet. Either Android or iOs will work.
  2. A copy of the 2019 Ohio Bicycle Events calendar. If you do not have a printed copy, you can get the same effect by pointing your phone or tablet at this image, featuring "Tour Legs", an artwork by Sassan Filsoof.

To see the AR in action, simply point your phone at the image above or the cover of the printed Ohio Bicycle Events Calendar.

Please note: This project was self-initiated and NOT endorsed by the Ohio Bicycle Event Calendar nor the Ohio Bicycle Federation.

The Ohio Bicycle Events Calendar can be found here.

Thanks to David Black, the rider.

Information on my presentation at the Great Ohio Bike adventure can be found here.

If you are interested in how AR can improve bike safety, click here.

My books can be found here.

Shadows of Mobiles

Jackwilsonsculpture.com

Games: Does anybody remember laughter?

Laughter makes us feel better. It's cheaper than chocolate and needs no prescription. 

I googled "humor in gamemaking". Not a lot of posts, and most were not new. It seems no one shares my dream of 25 million Fortnite players laughing so hard they shoot milk through their noses. Or spaghetti.

The first suggestion from Google was from Makansutra, a great article by Bob Mackey

Forget photorealism and perfected motion controls; if there's anything we need to aspire to in video games, it's simply being funnier.

Bob Mackey

Bob is on twitter: @bobservo. He co-hosts Retronauts and hosts Talking Simpsons and What a Cartoon!

The second post-- from 2012, is also on Gamasutra. Written by Dan Cook, it is very informative, and full of links. It also includes the world's funniest joke (according to American men).

Two hunters are out in the woods when one of them collapses. He doesn't seem to be breathing and his eyes are glazed. The other guy takes out his phone and calls the emergency services.

He gasps: "My friend is dead! What can I do?" The operator says: "Calm down, I can help. First, let's make sure he's dead." There is a silence, then a gunshot is heard.

Back on the phone, the guy says: "OK, now what?"

Dan Cook is on twitter: danctheduck, and the Chief Creative officer of Spryfox.  Blog

There are games that are obviously flat-out comedies, like the Borderlands series. Other titles, like Left 4 Dead, feature constant quipping by characters, and by movie standards could easily be described as comedic.
But looking at games you'll notice that, by their very nature, they are comedic. Even ultra-serious dramas can become comedic by virtue of allowing you, the player, to do things that go against their style...

The quote above is from Matthias Zarzecki's excellent article, What Makes Games Funny? A Look at Comedy and Humour in Video Games. Another one of the top Google suggestions, another one that is not current.Matthias' website is surprising and impressive: it's full of coding mathematics related to iOS and Unity Development.

So there you have it. I am a writer, a creative guy, a gamemaker and very interested in AR. Would be very happy to work with people to make game players laugh. I am serious.

Bubiko Foodtour tests the WordPress Gutenberg Editor

What's cooking in Shenzhen!?

Bubiko Foodtour Update

This new Gutenberg editor for WordPress is fun and full of options.  This is a "block". (The colored background was easy to do, as was the drop cap.)

This is a block for quotes. And you can quote me on that.

  • This is the list block.
  • I should write what I have been doing lately.
  • Like: singing opera
  • and studying the great cuisines of China
  • and researching Chinese restaurants in Shenzhen
  • Did I tell you that I want to be a superstAR?
  • My book about Ipoh, on Amazon.

I like these blocks! The VR block didn't seem to be ready yet, so I cannot show this yet, but soon! And how about a block for us AR people? 🙂

Support? VR films about relationships and China’s Silicon Valley

Hello! An update... and a request for support. I know the world is a goofy place and that a film is a luxury, in many ways. But I am now, with a great team, making a short 360VR film. The setting is the city of Shenzhen, the Silicon Valley of China. The film is about a couple, one of whom is a robot, but the film is ultimately about relationships.

Additionally, we are also in postproduction for a documentary on the city of Shenzhen itself.

Your help would make these two projects the best that they can be. We documented Shenzhen for 24 hours on August 18th. The documentation actually started on the 17th, which was Chinese Valentine's Day. That inspired the second short film, called Lotus Mountain.

I will write and do some Facebook Live broadcasts soon. If there were more time, I would do a crowdfunding campaign.

Stephen Black holding a Qoocam 360VR camera at the 2018 Maker Faire in Hong Kong.

Leo Wei, on the left, demonstrating a Kandao camera at Hong Kong Polytechnic

But we discovered the deadline for the Sundance Film Festival is this month, as is the deadline for a major European VR festival.

>

We are looking for sponsors and perhaps there is a way to sell it later. VR is a frontier, and there is no way to predict what will happen. For what it is worth, my first VR film was shown at festivals in Brisbane, Las Vegas and Singapore.

If you would like to support, the easiest action with the most value is to buy one of my books, probably i ate tiong bahru. It is a bestseller in Singapore.The paperback version is 17.88, and the ebook and audiobook versions are less than that. If you want to support more, please send me a private message. If you have a company that has a product that could appear in the movie, I am very happy to talk about that as well. Thank you very much for reading this!

At the 2018 Maker Faire at Hong Kong Polytechnic

Stephen Black holding a Qoocam 360VR camera at the 2018 Maker Faire at HK PolyU.

In the next post I will write about the great production, music, art and acting talents who are involved.

Oh yes... Beach Road, my first VR film, was a co-production with Hiverlab that has been featured in VR film festivals in Las Vegas, Singapore and Brisbane.