Category Archives: AR

When Harry Met Bubi

On Friday, June 28th, Bubiko Foodtour will make her debut in 3D/AR, at the Tech in the Tenderloin Event in San Francisco.

My background in TV, AR, VR and more.

This is exciting to me for two reasons.

It will be my first time to work with young American people...

In Singapore, I taught with this software, over ten years ago.
Teaching gamemaking in Singapore (This was a project led by Kerr Sun, now a top property agent in SE Asia/China.)
At the 2018 Maker Faire at Hong Kong PolyU.
computer users having fun
With Suphakorn Traisrisin testing the HP Reveal AR software with Bubiko Foodtour. Chiang Rai, Thailand.

Second, it will be my first time in San Francisco/the Silicon Valley with someone to bring to the IT/AR table... Bubiko Foodtour, the flagship character for our AR startup.

We need to make our MVP, Minimum Viable Product. Hire, or partner with a developer, OR find an angel investor to cover the 10K needed. The 10K,and a construction time of one month, are based on quotations from three AR experts.

Bubiko has paid her dues, and we think our MVP will do "alright " financially. Not only will our MVP scale, but we have other characters, like Secret Donut World and the Dundercats. We want to become the Pixar of AR +.

Stop by Tech in the Tenderloin and say hi! There are lots of great companies introducing their tech to the kids. Niantic will most likely be presenting their Harry Potter AR project.

Thank you very much for any ideas or contacts.

Bubiko Foodtour, thinking about the future-and what to eat! (Photo courtesy UARexplorer)
Bubiko Foodtour
One of Bubiko's book projects. She has also created a book of photographs of Ipoh, Malaysia. Bubiko's Instagram.
Austin Chronicle, Bubiko Foodtour
In the beginning, we used a paper doll to visualize what Bubiko could be.

Augmented Reality in Asia
article about Stephen Black in the Malay Mail
ARIA, at MIT, January 2019. It was here that we met Julia Beabout, from Novaby, the company that specializes in 3D models.
Invited to pitch to VCs at TechCrunch Shenzhen. It went extremely well; as far as these things can go when one has only a paper doll and an idea.
"Bubiko! You are not completely dressed yet! We're still fixing your hat!"

More info on Stephen Black here, including his bestselling book, his VR movies and a Unity-based online gallery project.

#whenharrymetbubi is, of course a reference to this classic movie.

Sayuri Okayama, co-creator of Bubiko.

Hummingbirdsday
Green Bean Boy is one of Bubiko's best friends. This image is from a test by Dominique Wu, the founder of the amazing Hummingbirdsday Studios, builders of apps, websites, AR and more.
Anger management
...and nice.

Great Ohio Bicycle Adventure 2019 (GOBA) 1 of 2

I recently connected with GOBA, and it was great. I attended the first day, hung around, met some nice people and learned a lot about bicycle safety. Important research for my book.

My presentation about augmented reality and the world of bicycling was on June 18th, 2019.

Information about the many uses of AR in the world of bicycling can be found here.

Information about GOBA

Part 2, click here: MORE GOBA

Comments welcome!

Arbicles

A list of all of my AR+bike blog posts is here.

The future of AR in the world of bicycling
A chart depicting the hypothetical uses of augmented reality in the world of bicycling.

ARBICLE- A piece of bicycle equipment, with partial or total augmented reality functionality. A bicycle light with some AR functions is an arbicle. A device which acts as a "AR computer", exclusively managing AR functions for the bike, traffic and rider is also an arbicle.

The word "arbicle" was coined by Stephen Black in 2019, in response to a perceived need for AR-compatible bicycle gear.Stephen Black is a writer, a visual artist and an AR/VR producer.

The chart above is a hypothetical overview and no such network or devices now exist. LIDAR is used an example of a traffic monitoring system. In reality, LIDAR is heavy, delicate and extremely expensive. Unlike autonomous vehicles, bicycles must have an attentive human steering and braking. Thus,LIDAR would be unnecessary. However. sensors detecting objects within a range of 50 feet around the bike would be advantageous. An arbicle featuring a rear view camera with a feed into the visor or smartglasses is an obvious need. ARbicles specializing in emergencies would be another obvious need.

This chart is a result of research and thought related to the book I am working on about AR and traffic safety, focusing on bicycles. The working title is AR on Wheels.

I will be making a presentation about AR at the Great Ohio Bicycle Adventure, in Port Clinton, on June 18. I

Also, if you are near San Francisco's Tenderloin District on June 28th, you are warmly invited to the world premier of Bubiko Foodtour!

Bubiko will be at the Novaby booth at the Tech in the Tenderloin Fair! her app will not be on dispaly, as we haven't made it yet, but Bubiko will be hosting an interactive event that is sure to be a crowdpleaser.

Grudge match: Bubiko Foodtour vs. Jackie Chan
Grudge match

Cloudy Traffic

A collection of posts regarding AR and Bicycling can be found here.

Traffic planning in the age of the cloud. I have read a lot and talked to many experts, but the questions in this little chart still are unanswered. To me, at least. Any ideas or thoughts are welcome; just use the comments section. Thank you! If you are an expert and want to be credited, or interviewed for my upcoming books just let me know. One book is about AR and bicycle safety. the other is about AR and traffic. (Have not yet finalized the titles.)

Obviously, the following is hypothetical; I can't think of any existing city which could accommodate five one-way lanes of traffic.

CURB ACTIVITY: Pedestrians. Parking spots for ebikes,bikes, scooters, fire hydrants, subterranean electricty and water lines, wheelchair access, bus stops, taxi/Uber/Lyft pick up and drop off areas

BIKE LANE: Individual and groups of riders, ll requiring two-way communication for weather, traffic patterns etc.

AV LANE small and large vehicles, some functioning as mobile rooms (classrooms with remote teachers, discussion rooms, meeting rooms, chill rooms, even mobile workout spaces with offsite trainers)

EMERGENCY LANE/DELIVERY LANE/BUS LANE Could something like this be managed? By whom? Would involve communicating with AVs.

TRAFFIC SIGNAL With proper traffic planning, autonomous vehicles would not need to "see" a physical light. and in this slightly futuristic scenario, could the traditional red/green/yellow lights be replaced by screens? Not just colors could be displayed, but traffic information.

WHO IS USING WHAT KIND OF AR?
Pedestrians- shopping, entertainment and internet services/information and maps for walking.

Bicyclists- maps and traffic information, internet services, including music.

Autonomous Vehicle 1 Kids using smartglasses to watch Bubiko Foodtour AR movies, one parent uses smartglasses to plan the day's activities, the other parent, also with smartglasses, attends an AR meeting conference call.

Autonomous Vehicle 2 A regularly scheduled "classroom mobile"with four students, a human teacher and AR educational materials.

QUESTIONS/THOUGHTS:

Vehicle 1: the Bubiko AR movie is on Google Cloud, the AR meeting is hosted on Apple's iCloud service, the other parent is using Facebook's cloud service. The windshield display is by WayRay and hosted on Microsoft's Azure cloud service.

Vehicle 2 is fitted with a Sony mobile AR classroom and the windshield AR hosting software is by Kamatera.

Emergency Vehicles: capable of seeing and interacting with emergency situations before arriving. Connected to a central traffic planning system, emergency vehicles and AVs are capable of maneuvering so that emergency vehicles get to their destination as quickly as possible.

Autonomous Delivery vehicles can be programmed to deliver with minimum traffic interference; for example at specific low traffic times.

Curb Activity is monitored by Open Curbs, Populus and Remix, all of whom feed information into private and government service providers who then use AR to provide information to those in traffic.

Road surface conditions: Potholes, floods, ice and snow. Monitored and then delivered to a central traffic planning agency.

Underground: sewers, flood control, power cables and more. Information available by AR

Drones: somehow drones will enter into the mobile AR picture...

In researching the above, I just discovered n excellent article about MDS, Mobiliy Data Specification.Here is a excellent article by David Zipper about MDS. Also highly recommended: this presentation by Regina Clewlows and Don MacKenzie.

................................

AR and bicycle interaction: a collection of posts on this topic is here.

If you happen to be in Port Clinton, for the Great Ohio Bicycle Adventure, stop by!

Bubiko's public AR debut! San Francisco! June 28! Bubiko's very, very excited! Tech in the Tenderloin

Thanks for leaving a comment!

Stephen Black’s AR/VR/spatial computing experiences

SB with Bubiko Foodtour

Stephen Black: This post is a breakdown of my experiences with AR/VR/Spatial Computing. It starts with 2002, though I received a BFA in Photographic Illustration from the Rochester Institute of Technology  well before that.

Before 2002, I lived in Tokyo, Manhattan, Paris and Hong Kong, and worked in network TV, fine arts, photography and music. A fuller biography can be found here. But AR is the topic of this post...

2002-2007. In Singapore I worked as a creative director for a 3D game making company that was also doing something like Youtube,-- but three years before Youtube. Although I was not a developer, I learned a great deal about spatial computing, and taught 3D gamemaking in Singapore, including classes at the Singapore Science Center. It was during this time, that David Severn and I developed the Secret Donut World characters.

Vance

2007- 2014 Singapore/Bali: wrote novels, including a bestseller, was involved with 3how and researched VR and AR.

2014 SPOKEN, with Eugene Soh; a curation of a wide range of artists.

SPOKEN, a virtual gallery

2014 The Oculus signaled the emergence of VR, and I began notes for a book about VR cinematography.

2015 In Singapore, a chance meeting with Ender Jiang, the founder of Hiverlab, resulted in the opportunity to make my first 360 film.  Ender provided me with technical support and creative freedom and I am extremely grateful for that opportunity. The resulting film, Beach Road, featured a soundtrack by Bani Haykal and Chen Yi Qi, and was selected as a demo VR film in the Hybrid Arcade session of the Brisbane Asia Pacific Film Festival in November 2015, and was nominated as the Best Experimental VR Film in the VR Fest Las Vegas 2016. It was also fetured in a VR film festival at the Singapore national Museum. Beach Road was receiving a healthy number of views and comments before a technical change in Google Play took it off. At the time of this writing, Beach Road is on Veer and has received almost 5000 views.

360 films
Stephen Black, in the film he co-produced with Hiverlab

2016 The year began with discussing a VR startup idea with VCs in Singapore. Though the discussions went well, the lack of a prototype slowed things down. Shortly after, the release of ARCore and ARKit resulted in a halt to VR the possibilities of AR were assessed.

By April, AR had become the focus and the decision was made to become the "Pixar of AR": original characters, stories and software. With Sayuri Okayama, Bubiko Foodtour was originated.

Sayuri Okayama with a prototype of Bubiko

2017 Ipoh: demonstrations of AR, including what is probably the world’s first photo exhibition in AR. The photos also appeared in an ebook by Bubiko Foodtour.

Augmented Reality in Asia
article about Stephen Black/Sayuri Okayama/Bubiko Foodtour in Ipoh

2018 A presentation about AR was given at Sasin School of Business in Bangkok, later followed by two presentations and two workshops at Hong Kong PolyU, all at 80% capacity or higher.

Augmented Reality Stephen Black in Thailand
poster for Stephen Black's presentation about AR at Sasin School of Business
Presentations and workshops by Stephen Black
Stephen Black holding a Qoocam 360VR camera, as part of his presentation at the 2018 Maker Faire at HK PolyU.

2018 Lotus Mountain, a 360 film was shot and post production began including VR art contributions from Scobot and a soundtrack by Rei Shimizu. The film is at least 80% done and finishing funds are now being searched for. Lotus Mountain was supported by Kando, and 8K Obsidians were used for most of the shooting. Noted Chinese VR filmmaker Leo Wei co-directed and produced.

Chinese city landmarks
Shenzhen Civic Center at night, primary location for Lotus Mountain.
from Lotus Mountain

Bubiko at the Rise festival in HK

Hong Kong Comicon

2018 Cross-promotional and development partnership with Six Cats Studios (HK), focusing on their original IPs, Ollie and Charlie.

AR in musical education
The Dundercats, by Six Cat Studios.

2018 Presentations in Shenzhen, including Le Wagon and Tech Crunch Shenzhen.

Hummingbirdsday
Screen capture from an AR game by Dominique Wu.

2018 In a partnership with Hummingbirdsday Studios, Bubiko appears in an AR game demo with Green Bean Boy.

2019 Presentation at ARIA, MIT, resulting in, among others, working relationship with Novaby and UARexperience

2019 Toledo, Ohio. Presentations, including coffee shops, libraries and a collaboration with sculptor Jack Wilson for the Old West End Festival.

2019 SXSW during the 10 day event attended seminars and developed personal connections with AR and VR practitioners.

W
With WWE championship belt

2019 AR presentation as part of GOBA-the Great Ohio Bicycle Adventure. Premier of the AR and Bicycle Safety ebook.

bicycle safety
Bubiko Foodtour looks up while thinking about what to order

2019 As part of  Novaby’s presentation in the Tech in the Tenderloin Festival, the 3D version Bubiko will be making her public debut. The Black Hawk Jazz Club AR project by Novaby will also be presented-not to be missed!

We are now looking for funding for the Bubiko app... Stay tuned!

Tour de France: AR for the Win #1: Fatigue Hawks

A slightly futuristic, highly realistic series of posts…


Arbicle- a piece of bicycling equipment utilizing AR, augmented reality.
I created the word above. In this post, a number of possible ideas and technologies are mentioned. Some may already be in use. However, now, there are no pieces of equipment designed specifically for the uses I mention. So, I have created the word “arbicle”, a combination of AR and bicycle. A small word and easy to "handle", it resembles the word ‘article’: arbicle.

What I am imagining are devices (arbicles) built specifically for the purpose of displaying or generating digital information related to bicycling. (This series of posts focuses upon racing.)

Note: I am not a medical specialist of any sort, and the following are not to be taken as anything more than theoretical exercises.

AR for the win #1: Fatigue Hawks

In this theoretical situation, we assume the following:

  • There are extensive performance, muscle fiber and blood analysis records for all racers. Data related to performance on similar roads and inclines is especially valuable.
  • Blood, saliva, and possibly urine tests can be quickly and periodically be conducted on racers for such things as: myoglobin levels, lactate clearance rate and other biochemical markers related to fatigue.
  • The above information can be combined with live feeds of: the peloton, wind and weather information, road gradient information.
  • Two way communication exists between the fatigue hawk and team members.

The fatigue hawk analyzes all of the data that is presented. Customized algorithms are used.

Communicating with voice, symbols and messages, the fatigue hawk offers suggestions on how to maximize strengths and minimize weaknesses of the team itself. Equally important, the fatigue hawk identifies opportunities, and weaknesses of opposing teams.

Data may reveal the leading team's difficulty with hills for example. By monitoring his/her own team's performance, the wind conditions and the gradient of an upcoming hill, the fatigue hawk can strategize and communicate so that advancement upon the leader can be made.

There are many uncontrollable factors in the Tour de France, but a strong collection of live data is information; and information is power. In the case of the Tour de France, the power is that of an athlete who cannot afford to waste a single kilojoule.

Studying the 1989 Tour de France, much can be learned about efficiency and power; the difference between first place and second was eight seconds.

The rider's arbicles would include a GPS tracking device and a visor capable of displaying the fatigue hawk's symbols and messages. Rearview and frontview cameras are also possibilities.

The fatigue hawk would need an arbicle capable of processing all incoming live data, storing records and communicating audio/visual data to the team members, individually and as a whole.

................................

I am a writer, researcher, AR producer and artist. No one is sponsoring this; I am now preparing a book on AR and Bicycle Safety. My other books are here.

.........

For further information:

https://www.dimensiondata.com/believe-in-greatness/tour-de-france

What is Fatigue? New Yorker article by Alex Hutchison

The Science of Running: How to Find Your Limit and Train to Maximize Your Performance by Steve Magness

Old West End

Hello to all.

The following image, when viewed with the free Artivive app, reveals "another dimension", a collaboration with the sculptor Jack Wilson.

The title: Falling Leaves in Spring.

Are you a resident of the Old West End?

Question: would you support a book about the Old West Side?

As you know, the Old West Side is a historical community full of distinctive architecture. Well... I have written a bestselling book about another historical community full of distinctive architecture.

That book is entitled i ate tiong bahru. It is one of my eight books. You can learn more about those books, and i ate tiong bahru, here. I should also mention Bus Stopping, a book of photographs.

Those books were written and self-published, mainly while I was living in Bali. To write about the Old West End would require time, and that means money. Do you think there could enough support for crowdfunding or other forms of support?

Also, any ideas on unusual exhibition spaces? I have a series of prints combine photography with text, and would like to present them to the public.

Thank you for your time and suggestions.

This is a collection of posts about Toledo: 419ness.

Happy to talk to anyone about video, photography, writing and AR.

onwARd,

Stephen Black

about me

A Victorian house in Toledo's Old West End

419ness

A collection of blog posts about Toledo, Ohio

The Maumee River

About Stephen Black

Stephen Black's books

Bicycle, Art and AR experience

This is a simple demo of Augmented Reality.

To do this, two things are needed.

  1. A free download of the Artivive app. This should go on a mobile phone or tablet. Either Android or iOs will work.
  2. A copy of the 2019 Ohio Bicycle Events calendar. If you do not have a printed copy, you can get the same effect by pointing your phone or tablet at this image, featuring "Tour Legs", an artwork by Sassan Filsoof.

To see the AR in action, simply point your phone at the image above or the cover of the printed Ohio Bicycle Events Calendar.

Please note: This project was self-initiated and NOT endorsed by the Ohio Bicycle Event Calendar nor the Ohio Bicycle Federation.

The Ohio Bicycle Events Calendar can be found here.

Thanks to David Black, the rider.

Information on my presentation at the Great Ohio Bike adventure can be found here.

If you are interested in how AR can improve bike safety, click here.

My books can be found here.

Lenovo ThinkReality A6 headset: an inspiration for bicycle safety?

Lenovo ThinkReality A6 headset: an inspiration for bicycle safety?

I am independent; Lenovo is not sponsoring this; the following is simply a way for me to introduce AR to people. I am now working on a book about the impact AR is having on the world of bicycling, especially safety. I am not crowdfunding the book. An early version is now on Amazon. If you would like to support this project, it would be much appreciated.

A list of all of teh AR+bike posts on this blog can be found here.

The Lenovo ThinkReality A6, is a state of the art head mounted device, designed for industrial and medical uses. By looking at its features, we can gain insights into how to use AR to improve bicycling, especially safety.

The A6 was announced by Lenovo in the middle of May, 2019.

The A6 is NOT designed for bicycling. Battery power is an obvious example of why the A6 is not likely to be used on the road. The A6 is claimed to have four hours of power. Bike trips longer than four hours would require consideration for recharging and/or batteries (and their weight). The A6 is not even being offered to individual consumers; it is a B2B product.

An excellent overview of all of the features of the A6 is here.

The A6 features worth discussing are:

RESOLUTION

This refers to the quality of the image. The A6 provides 1080 lines of resolution, which is very good, like a high definition television. A discussion of image quality must include the brightness of outdoor scenes. You cannot see any kind of information if it is lost in the brightness of the sun.

VOICE RECOGNITION

The advantage of voice control is obvious. Just say "Display an alternative route" and see the suggestion appear on your visor (or smart glasses). Safer and faster than pushing buttons, or even stopping to look at a phone or other device. The audio requirements that are unique to bicycling need to be considered.

OBJECT RECOGNITION

The A6 can be "trained" to recognize specific components used in industrial or medical applications. For example, a connecting rod, or a femur. With bicycling, the ability to detect cars, pedestrians and other bicycles is advantageous, especially when combined with tracking. Imagine knowing that an 18 wheeler, traveling 80 miles an hour is 100 yards behind you- without having to turn your head or use your mirror.

Parents could be aware of where their children are. Bike team members can monitor their teammates and competitors.

HEAD GAZE TRACKING

This allows the digital information you are looking at to be properly positioned in your viewing area no matter where you are looking.

GESTURE CONTROLS and THREE DEGREES OF FREEDOM HAND CONTROLLER

These two functions may have no importance while riding, but once off the bike, the ability to control functions and displays by hand could be important for maintenance and repair.

BARCODE READER

At races and tournaments, barcodes could enable quickly changing information to be shared easily. A barcode could be designated for weather updates for example. A rider looking at that barcode would immediately know what to expect, as the weather information is automatically displayed in his or her viewing area.

A6

CAMERAS

The A6 has two fisheye cameras on the front. For bicyclist, one camera on the back is hugely advantageous, as the need to see what is behind is a primary concern.

LIGHT

The A6 has a light. Probably not powerful enough for bicycling, but worth thinking about. Like all things related to bicycles, weight and comfort are issues, as well as price, of course.

These are just some of the ways bike enjoyment and safety can be increased. When we add GPS and impact sensors, we create the opportunity for first responders to immediately know the location of the incident. Two way communication via cameras and voice allow for decisions and preparations to be made in the shortest time possible.

One last point: AR is just starting, which increases the chances of bicyclists having their needs met. If individuals, bike organizations and traffic regulatory agencies and bike equipment manufacturers start communicating now, the shorter the path towards increased AR-enhanced safety will be.

I welcome any questions or comments. Feel free to post below.

PS. I don't want to confuse things, but if you want to see how information might be displayed in visors or smart glasses, take a look at indoor bicycle training. The Rouvy system is full of examples. Look here. (Rouvy is not paying me!)

PSS This blog post is full of examples of AR+bicycling.

Book on Augmented Reality and Safety, the introduction

I will be giving a presentation at the Great Ohio Bike Adventure in June.(Scroll down halfway.)

FWIW, when the Oculus was released, I wrote this blog post about it.