Category Archives: AR

Bubiko in Lawnspace screen test

Bubiko's guide to AR is now available on Amazon!

Bubiko: what is a stage?

The goal is to prepare for the possibilities of AR cinema.

This post documents a simple test. The Bubiko model used for the Tech in the Tenderloin event was used. Two locations: a garage and an open piece of land. The objective: to gain an understanding of what a “stage” can be in AR. AR is a new medium; to use the established techniques of theatre, television and movie is to fail to grasp the uniqueness of AR. Performance art and dance provide clues.

Notes: Spark used

  • Occlusion not a concern at this time
  • Ambient light a constant
  • Size and scaling of Bubiko purposely varied

Bubiko was created by Stephen Black and Sayuri Okayama

  • iPad used; no manual controls nor color correction
This is Bubiko Foodtour, still with the balloons and banner she used for her debut in San Francisco, at Tech in the Tenderloin’s 2019 TNT Tech Fest,  Bubiko is a work in progress, this is not her final version.
Bubiko is a 3D model made by Novaby, based on ideas by Stephen Black and Sayuri Okayama.
These images are a screen test of sorts, a way of documenting the possibilities and challenges of AR cinematography.
AR cinematography is one of my AR goals, especially making content for autonomous vehicles.
In these images. Bubiko was positioned near the white log. Only the camera (an iPad) moved. The software used was Spark. It was stable, except when used at long distances, in which case Bubiko appeared some distance away from the post.
The camera automatically controlled exposure. The light was even, the time being late afternoon/early twilight.
Occlusion was not important in this test, but I would love to use a software like 6D for testing.
Again, Bubiko did not move, but her size was changed in camera. AR cinema reminds me of machinima. There is another test of Bubiko HERE.
The format of the screen size is both an opportunity and a challenge.
Bubiko Foodtour models for some AR camera tests.
Interesting that the same model can have the size of a mouse, or a giant, or anything in between. Size in AR was the topic of this blog post. Thanks again to Fabian Winkler.
Bubiko is actually closer to the stump than this image suggests.
Sparks had some difficulty as I moved away from Bubiko's position. For this experiment it was simply an interesting development. If this were actually part of an movie shoot, I would reposition her, or do testing. It should be noted that wifi was not needed to create these images.

Tech in the Tenderloin 2019. Salvation Army Kroc Center, San Francisco

Bubiko's guide to AR is now available on Amazon!

We were honored that Bubiko Foodtour could make her public debut at Tech in the Tenderloin’s 2019 TNT Tech Fest, a very special event in a very special venue in a very special city.

Bubiko went outside for a minute! She was hungry. She found corn dogs. Aroi mak mak!

Niantic, the company that made Pokemon Go and Wizards Unite (the Harry Potter game) was the Community Champion Sponsor!

Tech in the Tenderloin is much more than a one day event.

Exhibitors:

Black Girls Code Imagine. Build. Create.

Techtonica Fintech training for women and NB adults with low incomes

Code Tenderloin

Novaby is a global digital art production company.

TERC Because math and science build futures

Unconscious Bias Project 100% empowerment, 0% guilt trip. Reducing unconscious bias in STEM with fact, tact, art and activism

Tinkertech

Roybi Robot Innovative learning for children. The world's first AI-powered educational robot that makes learning fun for ages 3-7.

Inspire Me Box (website coming soon)

TinkerTech teaches early design and engineering skills through hands-on activities to students ages 4-12 including those from low income communities.

Teentend builds better communities.

NapTime Studio game development

Cookie Run is an online mobile endless running game in the Cookie Run series created by Devsisters. 

DaVinci Club AR makes kids move and explore the real world.

Electronic Frontier Foundation The leading nonprofit defending digital privacy, free speech, and innovation.

SF Environment Getting Food out of the Waste Stream and Into Hungry Households—Where It Belongs.

Recology A World Without Waste

Book Merah

Mission Bit courses are project-based semester-long coding courses, taught by college computer science majors and supported by volunteers who are professional software engineers.

ThrowMotion Bringing the excitement of world sports... home.

NewPathVR VR and AI solutions for psychological and emotional wellness.

Larkin Street Youth Services Since 1984, Larkin Street Youth Services has given more than 75,000 young people a safe place to rebuild their lives.

The Hidden Genius Project trains and mentors black male youth in technology creation, entrepreneurship, and leadership skills to transform their lives and communities.

Academy of Art University

California Community Colleges

Singularity University

With Sayuri Okayama, I would like to thank Novaby for doing such a great job in creating the 3D version of Bubiko. The version on display is a work in progress, and already the reception has been very positive.Thank you Novaby!

logo

independent publisher's logo

A logo designed by Stephen Black for Book Merah and other projects.

Bubiko Foodtour’s debut at Tech in the Tenderloin

Bubiko's guide to AR is now available on Amazon!

After three years+... the first baby steps of Bubiko Foodtour. Tech in the Tenderloin is an amazing event, this year again sponsored by Niantic. TNT was co-founded by June Sargent and Julia Beabout and we (Sayuri and Stephen) cannot thank them, and all involved, enough.

NEWS COVERAGE VIDEO HERE.

We will write more about Tech in the Tenderloin, for now, I just want to share these.

3D models of chefs
Bubiko Foodtour's debut in the Tech in the Tenderloin

Obviously, many of these were shot off of a video monitor. With an older iPad. In low light. And, later the glaring green will be replaced with an interesting background.

FOR NOW, THESE PICTURES ARE PERFECT.

Here's a link to Bubiko at SXSW

When Harry Met Bubi

On Friday, June 28th, Bubiko Foodtour will make her debut in 3D/AR, at the Tech in the Tenderloin Event in San Francisco.

My background in TV, AR, VR and more.

This is exciting to me for two reasons.

It will be my first time to work with young American people...

In Singapore, I taught with this software, over ten years ago.
Teaching gamemaking in Singapore (This was a project led by Kerr Sun, now a top property agent in SE Asia/China.)
At the 2018 Maker Faire at Hong Kong PolyU.
computer users having fun
With Suphakorn Traisrisin testing the HP Reveal AR software with Bubiko Foodtour. Chiang Rai, Thailand.

Second, it will be my first time in San Francisco/the Silicon Valley with someone to bring to the IT/AR table... Bubiko Foodtour, the flagship character for our AR startup.

We need to make our MVP, Minimum Viable Product. Hire, or partner with a developer, OR find an angel investor to cover the 10K needed. The 10K,and a construction time of one month, are based on quotations from three AR experts.

Bubiko has paid her dues, and we think our MVP will do "alright " financially. Not only will our MVP scale, but we have other characters, like Secret Donut World and the Dundercats. We want to become the Pixar of AR +.

Stop by Tech in the Tenderloin and say hi! There are lots of great companies introducing their tech to the kids. Niantic will most likely be presenting their Harry Potter AR project.

Thank you very much for any ideas or contacts.

Bubiko Foodtour, thinking about the future-and what to eat! (Photo courtesy UARexplorer)
Bubiko Foodtour
One of Bubiko's book projects. She has also created a book of photographs of Ipoh, Malaysia. Bubiko's Instagram.
Austin Chronicle, Bubiko Foodtour
In the beginning, we used a paper doll to visualize what Bubiko could be.

Augmented Reality in Asia
article about Stephen Black in the Malay Mail
ARIA, at MIT, January 2019. It was here that we met Julia Beabout, from Novaby, the company that specializes in 3D models.
Invited to pitch to VCs at TechCrunch Shenzhen. It went extremely well; as far as these things can go when one has only a paper doll and an idea.
"Bubiko! You are not completely dressed yet! We're still fixing your hat!"

More info on Stephen Black here, including his bestselling book, his VR movies and a Unity-based online gallery project.

#whenharrymetbubi is, of course a reference to this classic movie.

Sayuri Okayama, co-creator of Bubiko.

Hummingbirdsday
Green Bean Boy is one of Bubiko's best friends. This image is from a test by Dominique Wu, the founder of the amazing Hummingbirdsday Studios, builders of apps, websites, AR and more.
Anger management
...and nice.

Great Ohio Bicycle Adventure 2019 (GOBA) 1 of 2

I recently connected with GOBA, and it was great. I attended the first day, hung around, met some nice people and learned a lot about bicycle safety. Important research for my book.

My presentation about augmented reality and the world of bicycling was on June 18th, 2019.

Information about the many uses of AR in the world of bicycling can be found here.

Information about GOBA

Part 2, click here: MORE GOBA

Comments welcome!

Arbicles

A list of all of my AR+bike blog posts is here.

The future of AR in the world of bicycling
A chart depicting the hypothetical uses of augmented reality in the world of bicycling.

ARBICLE- A piece of bicycle equipment, with partial or total augmented reality functionality. A bicycle light with some AR functions is an arbicle. A device which acts as a "AR computer", exclusively managing AR functions for the bike, traffic and rider is also an arbicle.

The word "arbicle" was coined by Stephen Black in 2019, in response to a perceived need for AR-compatible bicycle gear.Stephen Black is a writer, a visual artist and an AR/VR producer.

The chart above is a hypothetical overview and no such network or devices now exist. LIDAR is used an example of a traffic monitoring system. In reality, LIDAR is heavy, delicate and extremely expensive. Unlike autonomous vehicles, bicycles must have an attentive human steering and braking. Thus,LIDAR would be unnecessary. However. sensors detecting objects within a range of 50 feet around the bike would be advantageous. An arbicle featuring a rear view camera with a feed into the visor or smartglasses is an obvious need. ARbicles specializing in emergencies would be another obvious need.

This chart is a result of research and thought related to the book I am working on about AR and traffic safety, focusing on bicycles. The working title is AR on Wheels.

I will be making a presentation about AR at the Great Ohio Bicycle Adventure, in Port Clinton, on June 18. I

Also, if you are near San Francisco's Tenderloin District on June 28th, you are warmly invited to the world premier of Bubiko Foodtour!

Bubiko will be at the Novaby booth at the Tech in the Tenderloin Fair! her app will not be on dispaly, as we haven't made it yet, but Bubiko will be hosting an interactive event that is sure to be a crowdpleaser.

Grudge match: Bubiko Foodtour vs. Jackie Chan
Grudge match

Cloudy Traffic

A collection of posts regarding AR and Bicycling can be found here.

Traffic planning in the age of the cloud. I have read a lot and talked to many experts, but the questions in this little chart still are unanswered. To me, at least. Any ideas or thoughts are welcome; just use the comments section. Thank you! If you are an expert and want to be credited, or interviewed for my upcoming books just let me know. One book is about AR and bicycle safety. the other is about AR and traffic. (Have not yet finalized the titles.)

Obviously, the following is hypothetical; I can't think of any existing city which could accommodate five one-way lanes of traffic.

CURB ACTIVITY: Pedestrians. Parking spots for ebikes,bikes, scooters, fire hydrants, subterranean electricty and water lines, wheelchair access, bus stops, taxi/Uber/Lyft pick up and drop off areas

BIKE LANE: Individual and groups of riders, ll requiring two-way communication for weather, traffic patterns etc.

AV LANE small and large vehicles, some functioning as mobile rooms (classrooms with remote teachers, discussion rooms, meeting rooms, chill rooms, even mobile workout spaces with offsite trainers)

EMERGENCY LANE/DELIVERY LANE/BUS LANE Could something like this be managed? By whom? Would involve communicating with AVs.

TRAFFIC SIGNAL With proper traffic planning, autonomous vehicles would not need to "see" a physical light. and in this slightly futuristic scenario, could the traditional red/green/yellow lights be replaced by screens? Not just colors could be displayed, but traffic information.

WHO IS USING WHAT KIND OF AR?
Pedestrians- shopping, entertainment and internet services/information and maps for walking.

Bicyclists- maps and traffic information, internet services, including music.

Autonomous Vehicle 1 Kids using smartglasses to watch Bubiko Foodtour AR movies, one parent uses smartglasses to plan the day's activities, the other parent, also with smartglasses, attends an AR meeting conference call.

Autonomous Vehicle 2 A regularly scheduled "classroom mobile"with four students, a human teacher and AR educational materials.

QUESTIONS/THOUGHTS:

Vehicle 1: the Bubiko AR movie is on Google Cloud, the AR meeting is hosted on Apple's iCloud service, the other parent is using Facebook's cloud service. The windshield display is by WayRay and hosted on Microsoft's Azure cloud service.

Vehicle 2 is fitted with a Sony mobile AR classroom and the windshield AR hosting software is by Kamatera.

Emergency Vehicles: capable of seeing and interacting with emergency situations before arriving. Connected to a central traffic planning system, emergency vehicles and AVs are capable of maneuvering so that emergency vehicles get to their destination as quickly as possible.

Autonomous Delivery vehicles can be programmed to deliver with minimum traffic interference; for example at specific low traffic times.

Curb Activity is monitored by Open Curbs, Populus and Remix, all of whom feed information into private and government service providers who then use AR to provide information to those in traffic.

Road surface conditions: Potholes, floods, ice and snow. Monitored and then delivered to a central traffic planning agency.

Underground: sewers, flood control, power cables and more. Information available by AR

Drones: somehow drones will enter into the mobile AR picture...

In researching the above, I just discovered n excellent article about MDS, Mobiliy Data Specification.Here is a excellent article by David Zipper about MDS. Also highly recommended: this presentation by Regina Clewlows and Don MacKenzie.

................................

AR and bicycle interaction: a collection of posts on this topic is here.

If you happen to be in Port Clinton, for the Great Ohio Bicycle Adventure, stop by!

Bubiko's public AR debut! San Francisco! June 28! Bubiko's very, very excited! Tech in the Tenderloin

Thanks for leaving a comment!

Stephen Black’s AR/VR/spatial computing experiences

SB with Bubiko Foodtour

Stephen Black: This post is a breakdown of my experiences with AR/VR/Spatial Computing. It starts with 2002, though I received a BFA in Photographic Illustration from the Rochester Institute of Technology  well before that.

Before 2002, I lived in Tokyo, Manhattan, Paris and Hong Kong, and worked in network TV, fine arts, photography and music. A fuller biography can be found here. But AR is the topic of this post...

2002-2007. In Singapore I worked as a creative director for a 3D game making company that was also doing something like Youtube,-- but three years before Youtube. Although I was not a developer, I learned a great deal about spatial computing, and taught 3D gamemaking in Singapore, including classes at the Singapore Science Center. It was during this time, that David Severn and I developed the Secret Donut World characters.

Vance

2007- 2014 Singapore/Bali: wrote novels, including a bestseller, was involved with 3how and researched VR and AR.

2014 SPOKEN, with Eugene Soh; a curation of a wide range of artists.

SPOKEN, a virtual gallery

2014 The Oculus signaled the emergence of VR, and I began notes for a book about VR cinematography.

2015 In Singapore, a chance meeting with Ender Jiang, the founder of Hiverlab, resulted in the opportunity to make my first 360 film.  Ender provided me with technical support and creative freedom and I am extremely grateful for that opportunity. The resulting film, Beach Road, featured a soundtrack by Bani Haykal and Chen Yi Qi, and was selected as a demo VR film in the Hybrid Arcade session of the Brisbane Asia Pacific Film Festival in November 2015, and was nominated as the Best Experimental VR Film in the VR Fest Las Vegas 2016. It was also fetured in a VR film festival at the Singapore national Museum. Beach Road was receiving a healthy number of views and comments before a technical change in Google Play took it off. At the time of this writing, Beach Road is on Veer and has received almost 5000 views.

360 films
Stephen Black, in the film he co-produced with Hiverlab

2016 The year began with discussing a VR startup idea with VCs in Singapore. Though the discussions went well, the lack of a prototype slowed things down. Shortly after, the release of ARCore and ARKit resulted in a halt to VR the possibilities of AR were assessed.

By April, AR had become the focus and the decision was made to become the "Pixar of AR": original characters, stories and software. With Sayuri Okayama, Bubiko Foodtour was originated.

Sayuri Okayama with a prototype of Bubiko

2017 Ipoh: demonstrations of AR, including what is probably the world’s first photo exhibition in AR. The photos also appeared in an ebook by Bubiko Foodtour.

Augmented Reality in Asia
article about Stephen Black/Sayuri Okayama/Bubiko Foodtour in Ipoh

2018 A presentation about AR was given at Sasin School of Business in Bangkok, later followed by two presentations and two workshops at Hong Kong PolyU, all at 80% capacity or higher.

Augmented Reality Stephen Black in Thailand
poster for Stephen Black's presentation about AR at Sasin School of Business
Presentations and workshops by Stephen Black
Stephen Black holding a Qoocam 360VR camera, as part of his presentation at the 2018 Maker Faire at HK PolyU.

2018 Lotus Mountain, a 360 film was shot and post production began including VR art contributions from Scobot and a soundtrack by Rei Shimizu. The film is at least 80% done and finishing funds are now being searched for. Lotus Mountain was supported by Kando, and 8K Obsidians were used for most of the shooting. Noted Chinese VR filmmaker Leo Wei co-directed and produced.

Chinese city landmarks
Shenzhen Civic Center at night, primary location for Lotus Mountain.
from Lotus Mountain

Bubiko at the Rise festival in HK

Hong Kong Comicon

2018 Cross-promotional and development partnership with Six Cats Studios (HK), focusing on their original IPs, Ollie and Charlie.

AR in musical education
The Dundercats, by Six Cat Studios.

2018 Presentations in Shenzhen, including Le Wagon and Tech Crunch Shenzhen.

Hummingbirdsday
Screen capture from an AR game by Dominique Wu.

2018 In a partnership with Hummingbirdsday Studios, Bubiko appears in an AR game demo with Green Bean Boy.

2019 Presentation at ARIA, MIT, resulting in, among others, working relationship with Novaby and UARexperience

2019 Toledo, Ohio. Presentations, including coffee shops, libraries and a collaboration with sculptor Jack Wilson for the Old West End Festival.

2019 SXSW during the 10 day event attended seminars and developed personal connections with AR and VR practitioners.

W
With WWE championship belt

2019 AR presentation as part of GOBA-the Great Ohio Bicycle Adventure. Premier of the AR and Bicycle Safety ebook.

bicycle safety
Bubiko Foodtour looks up while thinking about what to order

2019 As part of  Novaby’s presentation in the Tech in the Tenderloin Festival, the 3D version Bubiko will be making her public debut. The Black Hawk Jazz Club AR project by Novaby will also be presented-not to be missed!

We are now looking for funding for the Bubiko app... Stay tuned!

Tour de France: AR for the Win #1: Fatigue Hawks

A slightly futuristic, highly realistic series of posts…


Arbicle- a piece of bicycling equipment utilizing AR, augmented reality.
I created the word above. In this post, a number of possible ideas and technologies are mentioned. Some may already be in use. However, now, there are no pieces of equipment designed specifically for the uses I mention. So, I have created the word “arbicle”, a combination of AR and bicycle. A small word and easy to "handle", it resembles the word ‘article’: arbicle.

What I am imagining are devices (arbicles) built specifically for the purpose of displaying or generating digital information related to bicycling. (This series of posts focuses upon racing.)

Note: I am not a medical specialist of any sort, and the following are not to be taken as anything more than theoretical exercises.

AR for the win #1: Fatigue Hawks

In this theoretical situation, we assume the following:

  • There are extensive performance, muscle fiber and blood analysis records for all racers. Data related to performance on similar roads and inclines is especially valuable.
  • Blood, saliva, and possibly urine tests can be quickly and periodically be conducted on racers for such things as: myoglobin levels, lactate clearance rate and other biochemical markers related to fatigue.
  • The above information can be combined with live feeds of: the peloton, wind and weather information, road gradient information.
  • Two way communication exists between the fatigue hawk and team members.

The fatigue hawk analyzes all of the data that is presented. Customized algorithms are used.

Communicating with voice, symbols and messages, the fatigue hawk offers suggestions on how to maximize strengths and minimize weaknesses of the team itself. Equally important, the fatigue hawk identifies opportunities, and weaknesses of opposing teams.

Data may reveal the leading team's difficulty with hills for example. By monitoring his/her own team's performance, the wind conditions and the gradient of an upcoming hill, the fatigue hawk can strategize and communicate so that advancement upon the leader can be made.

There are many uncontrollable factors in the Tour de France, but a strong collection of live data is information; and information is power. In the case of the Tour de France, the power is that of an athlete who cannot afford to waste a single kilojoule.

Studying the 1989 Tour de France, much can be learned about efficiency and power; the difference between first place and second was eight seconds.

The rider's arbicles would include a GPS tracking device and a visor capable of displaying the fatigue hawk's symbols and messages. Rearview and frontview cameras are also possibilities.

The fatigue hawk would need an arbicle capable of processing all incoming live data, storing records and communicating audio/visual data to the team members, individually and as a whole.

................................

I am a writer, researcher, AR producer and artist. No one is sponsoring this; I am now preparing a book on AR and Bicycle Safety. My other books are here.

.........

For further information:

https://www.dimensiondata.com/believe-in-greatness/tour-de-france

What is Fatigue? New Yorker article by Alex Hutchison

The Science of Running: How to Find Your Limit and Train to Maximize Your Performance by Steve Magness