Category Archives: Bicycling

What is Augmented Reality?

The following video is a rehearsal. The starting point is a presentation I did in Detroit in July 2019. That presentation was about Autonomous Vehicles and Augmented Reality. Eventually I will have about eight videos based on that Detroit presentation. You can find the Powerpoint for that here.

It will be obvious that I am not the smoothest person to ever be on a stage. I am a photographer, a cinematographer, an artist and a writer. I am used to having time to think about what I am expressing. As I will soon be making presentations in Europe, I am trying to get through the learning curve of being onstage, asap.

In this presentation, I often refer to the Open Augmented Reality Cloud. If you are serious about AR, you must learn about their work, and download the free State of the Augmented Reality Cloud Report which is available on their website. (I am honored and humbled to say that I will be speaking about Bubiko at the OARC Symposium in Munich on October 16!)

The ARShow produced this informative podcast with Jan-Erik Vinje, Christine Perey, Jason Fox and Colin Steinman, the key cotributors to the OARC

Thank you for any suggestions. And your patience!

Oh yes... Bubiko's Unusual Guide to Augmented Reality is now available on Amazon.

Yes, the lighting is not great. This is a rehearsal, albeit an informative one.

AR + Tour de France Notes

I am now working on a book about AR, roads and transportation. The following is from a section about AR and the Tour de France.

Hello reader.

So...

In Spring of 2019, I was excited to discover that the world of cycling had a growing number of AR apps and products. Excited because, previous to these discoveries, I could only find three successful examples of AR.

The first was Pokemon Go but, as huge as it was, it created the misleading impression that AR was only for games. Next: 19 Crimes, an Australian wine company that achieved massive success largely due to their series of AR "living wine labels”. The third example was Ikea, whose AR app allowed buyers to "insert" digital models of furniture into their real homes, so as to visualise the ideal purchase.

Also, there were many exciting AR projects in medicine and industry, but these uses required expensive viewing devices, like the Hololens.

So, when I discovered cycling goggles with AR functionality? Great! An AR app that allowed users to customize a bike and then order it? Yes! An AR bike repair manual? Yes, again! These  simple uses were practical, but with hints of openness, adventure and excitement. Vitality!

By July 2019, when I gave a presentation at the Great Ohio Bicycle Adventure (GOBA),  I thought I had discovered all that there was in the world of (AR +bicycles). I invented the word “arbicle”, defined as bicycle devices utilizing AR. I learned that the safest, most successful AR/bicycle interactions would require an AR network that includes vehicles, drivers, pedestrians and everything connected with roads. I began a book about bikes and AR.

And then I thought I had a good idea. To break up all of the technical ideas, and to inject some excitement into the book, I decided to write about futuristic uses of AR in the Tour de France. I came up with ideas like “fatigue hawks”, “blood hawks” and “wind hawks", terms that would be applied to specialized data scientists who coached cycling teams.

So...

After writing a  blog post about “fatigue hawks” and then writing about theoretical uses of AR at the Tour de France, I discovered the NTT website, outlining what they had done for the 2019 Tour de France, and what their future plans were.

Although the NTT website doesn’t use exciting names like “blood hawks”, they do use data in exciting ways, especially in the areas of data collection/processing, AR, 3D mapping and AI. NTT is making media history. Pioneers, they are leaving the safe continent of broadcast television to venture into the uncharted islands of billions of mobile devices.

NTT’s advancements will continue to have huge effects upon the Tour de France and beyond. Much more info at https://hello.global.ntt/en-us/tourdefrance

And no, NTT is not sponsoring this (nor is anyone else). Having said that I would be happy to write about NTT's London headquarters, or their facility dedicated to the Tour de France, in Mulhouse, in eastern France.

TO BE CONTINUED

Augmented Reality + Autonomous Vehicles: Stephen Black @ Collider

Bubiko's guide to AR is now available on Amazon!

The following are additions that were not discussed at the Detroit meetup.

https://www.forbes.com/sites/edgarsten/2019/08/12/turning-back-seat-boredom-into-a-virtual-theme-park/#712404fc6019

! https://www.thedrive.com/tech/9548/the-biggest-opportunity-everyone-is-missing-in-self-driving-cars

!! https://panelpicker.sxsw.com/vote/100430 (What Augmented Driving Will Feel Like, a SXSW presentation by Theo Calvin.)

I wish I had known about the projects and gentlemen above before my Detroit talk.

Do read the article by Alex Roy.

Please vote for Teo Calvin's SXSW proposal.

.......................

Presentation

Thank you very much to Jacob, Rahul and Altimetrik for making this happen. It was a blast! A description of the event, and an introduction to Collider is here.

SLIDE 2

Hyperreality by Keiichi Matsuda

https://www.rt.com/news/455341-chinese-hackers-tesla-autopilot/

https://mashable.com/article/nissan-ar-virtual-reality-windshield-display/

The Nissan video features outstanding visuals.

SLIDE 3

https://www.openarcloud.org/reports/sotarc-2019

The above link is a MUST for anyone with a serious investment in AR.

Novaby is the company that did/is doing a great job with Bubiko.

(Yes, all of the research you see is self-funded. If you can help with a donation or a job...get in touch, please. I am also a photographer, artist, videomaker and a writer.

SLIDE 4

You can see all of my adventures with Bubiko elsewhere on this blog. We would be grateful for your votes for two proposals for SXSW.

This is my proposal.

This is the proposal of Sayuri Okayama, my partner.

THANK YOU FOR YOUR VOTE!

SLIDE 5

This book is a "living" book. Meaning if you buy it, you will get the updated editions free.

SLIDE 7

BONNETS! (My Powerpoint looks extremely low tech. As much as I like this look, I have to say I had no choice. I was using my Chromebook , and used the baked in slide show creator. Next time, I might actually have the time to do some design work.)

SLIDE 8

Artivive One of my own Artivive demos is here. Another, here.

Leo

Bubiko Foodtour

Rouvy Augmented Reality Released: First Ride & Explainer.

DC Rainmaker does his usually outstanding job of reviewing a bicycle-related product.Jump into the video at about the 4 minute mark to see some exemplary AR techniques. Click here to see more examples and ideas related to AR+ Bicycles.

Cannondale, for the win! A great example of functional AR in an everyday situation, as opposed to a factory or medical facility.

SLIDE 9

From a presentation I did on AR and bike safety. All of those concepts need to be unified and rethought for the age of AR.

SLIDE 10

Mapillary

LADOT

Superworld

SLIDE 11

The Open Augmented Reality Cloud people are making efforts to establish a geopost standard. If you are serious about AR, follow their efforts, or better join them and let your voice be heard!

What you see is a test I did with Bubiko. While I was in a car, I positioned her in the road ahead. We then drove forward. It is not clear, and I will redo this test.

But what happened is that Bubiko was in front, then she appeared in the car, and then we saw her in the road behind us. She did not move with/in relationship to the car.

This was using Facebook Spark AR. Technical support: the amazing Dana.

Stunt driver: Norm Black.

No AR characters were harmed in the production of this rest.

SLIDE 12

OPEN AUGMENTED REALITY CLOUD

SLIDE 13

The AR Podcast is a must for anyone serious about AR. This is a link to the extremely informative and important interview with four of the people involved with OARC.

SLIDE 14

Thank you Sergei!

https://www.slideshare.net/sergiikozyrev?utm_campaign=profiletracking&utm_medium=sssite&utm_source=ssslideview

SLIDE 15

One style of point cloud rendering.

SLIDE 16

Another way to render a point cloud. There are many ways to create point clouds and they must be interoperable.

https://www.clarissewiki.com/3.6/creating_a_point_cloud.html

SLIDE 17

An example of an organization that has information that would be useful for AR in Detroit. Geographic Information Services… How much of what is under the road do they have records of? This info would be necessary for many AR services,

How do they make pointclouds-or do they even do this yet?

SLIDE 18

One of Magic Leap's views on how the total AR world might look like.

The layers presented include IoT (the Internet of Things, as well as AI. Photo courtesy of Tony at the Skarred Ghost, another person I suggest serious AR/VR people support and follow.

SLIDE 19

Another presentation from Magic Leap on how the total AR Cloud might look. They use the term "Magicverse".

SLIDE 20

A representation by the OARC on what the layers of the cloud would be. My suggested terms would be REAL1 (R1), REAL2 (R2) and REAL3 (R3). R1=the physical world. R2; the layer with few changes; buildings, landmarks, geography. R3 being the part of the AR cloud that changes the most, and has the most segmentation.

This system also lends itself to further classification. R2C22 , for example, could refer to a specific block in Chicago for example, and R2C22E could be the collective "channel" for all organizations utilizing traffic emergency communications for that area.

SLIDE 21

Microsoft Azure Spatial anchor systems. 'Anchor systems' refers to geoposing. There can be an endless number of clouds. Interoperability... Machines reading the world for humans... A browser...AI assisted browsers.

SLIDE 22

This is from the State of the Open AR Cloud 2019 report by the Open Augmented Reality Cloud group. Already some governing bodies are being formed.

The report is free. Get it here.

SLIDE 24

Ed Garten's article on AV safety, for Forbes magazine.

SLIDE 25

The League of American Bicyclists has an active interest in AR and AV.

https://www.bikeleague.org/content/automated-vehicle-overview-box

SLIDE 27

And the amazing BabbleRabbit! https://twitter.com/BabbleRabbit/status/1115271007315615750

SLIDE 28

https://www.researchgate.net/publication/314522858_Supporting_Trust_in_Autonomous_Driving

https://www.researchgate.net/publication/333645946_The_Impact_of_Autonomous_Vehicles'_Active_Feedback_on_Trust

SLIDE 30

An AV by May.

SLIDE 33

Shenzhen's celebration used the entire city as a canvas. Something like this could be done in Detroit with AR, for much less cost, and with greater detail. AVs could travel on programmed routes... a new form of musical is born!

My report on the maker culture of Shenzhen is here.

SLIDE 34

The Fox Theatre is one of Detroit's cultural assets that could be utilized. This slide shows some of the layers of creation and co-operation that need to be considered.

SLIDE 35

An example of an urban AR project, this one by Snapchat. This article also raises questions about AR in public spaces.

SLIDE 36

Diego! DIA! https://www.dia.org/art/rivera-court

SLIDE 37

http://amirbaradaran.com/2019/works-pages/fml.html

Go to the "0.52" mark to see the actual AR clip. It is very brief.

The video on this site by Artivive showcases some possibilities in regards to AR + flat art. https://artivive.com/walkietalkie/

SLIDE 38

Apple's AR Art program. https://www.apple.com/newsroom/2019/07/apple-offers-new-augmented-reality-art-sessions/

SLIDE 39

Back to bROADWAY… and we have "discovered" that the Fox Theater is geofenced. Geofencing is a blocking of AR access. Military bases, sensitive areas...the interior of homes. The Fox Theatre is copyrighted, I believe. In this fictional example, Fox may have geofenced their theater to prevent unauthorized AR usage.

SLIDE 40

MOTOWN!

SLIDE 42

Bose AR

So there ya go! Any questions ask below.

I am available for consultation and all kinds of AR producing, as well as photography, video, art and writing projects. Thank you for any ideas and/or opportunities.

And again, please consider voting for our two SXSW presentations:

XR: bike safety, music and Bubiko Foodtour

and

Augmented Reality and Food

THANKS!

onwARd,

Stephen Black

Detroit: Traffic Studies

As I become more involved AR's potential impact upon traffic, I see roads, vehicles, pedestrians and bicycles differently. The following documentary photographs are study aids; barely related to my previous street photography projects, such as the Bus Stopping series.

There is also a study of San Francisco here.

A terrible photograph, but a great example of the realities of the street. Glare attacks everyone. If there were a dependency upon a device displaying crucial information, what would happen in this situation?
Waze and other apps provide the latest info on detours, construction , travel times and more. With Waze, the data is crowdsourced. What relationships will be formed between these kinds of apps and autonomous vehicles?
The overall picture of bicycle parking in Detroit: what does it look like?
Ebike parking?
What is the future of the parking lot?
Detroit's original layout.
Dashboard of one of May's autonomous vehicles.
One of May's AVs moving out into traffic.
For nearly one hundred years, Detroit has created our perception of what a car is. Let's see what happens next...

I will be making a presentation about Augmented Reality and Autonomous Vehicles at Altimetrik, on August 8, 2019.

There are a number of posts about AR and bicycling here.

These photographs were taken during Detroit Startup Week.

Bicycle, Art and AR experience

This is a simple demo of Augmented Reality.

To do this, two things are needed.

  1. A free download of the Artivive app. This should go on a mobile phone or tablet. Either Android or iOs will work.
  2. A copy of the 2019 Ohio Bicycle Events calendar. If you do not have a printed copy, you can get the same effect by pointing your phone or tablet at this image, featuring "Tour Legs", an artwork by Sassan Filsoof.

To see the AR in action, simply point your phone at the image above or the cover of the printed Ohio Bicycle Events Calendar.

Please note: This project was self-initiated and NOT endorsed by the Ohio Bicycle Event Calendar nor the Ohio Bicycle Federation.

The Ohio Bicycle Events Calendar can be found here.

Thanks to David Black, the rider.

Information on my presentation at the Great Ohio Bike adventure can be found here.

If you are interested in how AR can improve bike safety, click here.

My books can be found here.

Lenovo ThinkReality A6 headset: an inspiration for bicycle safety?

Lenovo ThinkReality A6 headset: an inspiration for bicycle safety?

I am independent; Lenovo is not sponsoring this; the following is simply a way for me to introduce AR to people. I am now working on a book about the impact AR is having on the world of bicycling, especially safety. I am not crowdfunding the book. An early version is now on Amazon. If you would like to support this project, it would be much appreciated.

A list of all of teh AR+bike posts on this blog can be found here.

The Lenovo ThinkReality A6, is a state of the art head mounted device, designed for industrial and medical uses. By looking at its features, we can gain insights into how to use AR to improve bicycling, especially safety.

The A6 was announced by Lenovo in the middle of May, 2019.

The A6 is NOT designed for bicycling. Battery power is an obvious example of why the A6 is not likely to be used on the road. The A6 is claimed to have four hours of power. Bike trips longer than four hours would require consideration for recharging and/or batteries (and their weight). The A6 is not even being offered to individual consumers; it is a B2B product.

An excellent overview of all of the features of the A6 is here.

The A6 features worth discussing are:

RESOLUTION

This refers to the quality of the image. The A6 provides 1080 lines of resolution, which is very good, like a high definition television. A discussion of image quality must include the brightness of outdoor scenes. You cannot see any kind of information if it is lost in the brightness of the sun.

VOICE RECOGNITION

The advantage of voice control is obvious. Just say "Display an alternative route" and see the suggestion appear on your visor (or smart glasses). Safer and faster than pushing buttons, or even stopping to look at a phone or other device. The audio requirements that are unique to bicycling need to be considered.

OBJECT RECOGNITION

The A6 can be "trained" to recognize specific components used in industrial or medical applications. For example, a connecting rod, or a femur. With bicycling, the ability to detect cars, pedestrians and other bicycles is advantageous, especially when combined with tracking. Imagine knowing that an 18 wheeler, traveling 80 miles an hour is 100 yards behind you- without having to turn your head or use your mirror.

Parents could be aware of where their children are. Bike team members can monitor their teammates and competitors.

HEAD GAZE TRACKING

This allows the digital information you are looking at to be properly positioned in your viewing area no matter where you are looking.

GESTURE CONTROLS and THREE DEGREES OF FREEDOM HAND CONTROLLER

These two functions may have no importance while riding, but once off the bike, the ability to control functions and displays by hand could be important for maintenance and repair.

BARCODE READER

At races and tournaments, barcodes could enable quickly changing information to be shared easily. A barcode could be designated for weather updates for example. A rider looking at that barcode would immediately know what to expect, as the weather information is automatically displayed in his or her viewing area.

A6

CAMERAS

The A6 has two fisheye cameras on the front. For bicyclist, one camera on the back is hugely advantageous, as the need to see what is behind is a primary concern.

LIGHT

The A6 has a light. Probably not powerful enough for bicycling, but worth thinking about. Like all things related to bicycles, weight and comfort are issues, as well as price, of course.

These are just some of the ways bike enjoyment and safety can be increased. When we add GPS and impact sensors, we create the opportunity for first responders to immediately know the location of the incident. Two way communication via cameras and voice allow for decisions and preparations to be made in the shortest time possible.

One last point: AR is just starting, which increases the chances of bicyclists having their needs met. If individuals, bike organizations and traffic regulatory agencies and bike equipment manufacturers start communicating now, the shorter the path towards increased AR-enhanced safety will be.

I welcome any questions or comments. Feel free to post below.

PS. I don't want to confuse things, but if you want to see how information might be displayed in visors or smart glasses, take a look at indoor bicycle training. The Rouvy system is full of examples. Look here. (Rouvy is not paying me!)

PSS This blog post is full of examples of AR+bicycling.

Book on Augmented Reality and Safety, the introduction

I will be giving a presentation at the Great Ohio Bike Adventure in June.(Scroll down halfway.)

FWIW, when the Oculus was released, I wrote this blog post about it.

Augmented Reality and Bicycle Safety ebook, introductory notes

Here is a collection of videos and links about AR/Bike applications.

Following is the brief introduction to a collection of notes, links and thoughts related to AR/bike safety.

AR’s future is very bright but, presently, it is barely known by the general public. This is surprising, as AR is the most magical part of Pokemon Go, an app that has been downloaded over a billion times, and earned over $200 million its first month. AR is also widely used in military, scientific and industrial applications. Boeing, for example, has been using AR for jet engine maintenance since the late 1980s. With AR, Ikea revolutionized shopping for furniture. Facebook and Apple are both producing smart glasses specifically for AR. But my opinion, based on my own research, and many discussions with AR professionals in Asia, at MIT, at SXSW, and online, is that AR is not yet widely known. AR is not yet like TV.

My own experiences with AR began in 2003, when I was a creative director with a 3D gamemaking company in Singapore. In 2016, with Sayuri Okayama, I began to act upon ideas for a startup that aims to be the “Pixar of AR”. Our first character, Bubiko Foodtour, will soon have her own AR app.

Discovering the existing, and future, AR/cycling app possibilities is exciting and important to me. My own experiences may allow me to see parts of the AR/bicycling picture that others may possibly not.

An important part of this ebook is to clarify, and raise questions about, the technical interactions between autonomous vehicles, human controlled vehicles, traffic controllers, GPS and bike/AR apps. A woman pushing a bicycle was the first fatality involving an autonomous vehicle: what have we learned from this tragedy?

Bicyclists gather for a memorial service

This is an ebook; it can be easily updated. The interactions between AR and bicycling will only increase, and this project will be updated. If you would like a free copy of the latest edition, send an email to the address below.

Finally, I should say that the AR apps shown within are not paid endorsements. If, in the future, sponsorship occurs, it will be made very clear. If a product appears within these pages, it is because it seems to be a good example.

I welcome your comments, critiques, suggestions and questions.

OnwARd,

Stephen Black

ar2wheels at gmail dottcom

ARbike

A compilation of posts-and an ebook- related to Augmented Reality, Bicycling and Bicycle Safety.

Stephen Black will be making a presentation at the Great Ohio Bike Adventure in June. About Stephen Black

Ride of Silence, Toledo

This event was organized by We Are Traffic.org.

The evening was full of the beautiful light of Spring, and the best of humanity was in abundance. Bicyclists from all over the Toledo area gathered for a memorial service.

from the Ride of Silence website:

THE RIDE OF SILENCE WILL NOT BE QUIET

On May 15, 2019 at 7:00 PM, the Ride of Silence will traverse and unite the globe as nothing before it. Cyclists will take to the roads in a silent procession to honor cyclists who have been killed or injured while cycling on public roadways. Although cyclists have a legal right to share the road with motorists, the motoring public often isn't aware of these rights, and sometimes not aware of the cyclists themselves.

...................................30..............................

I will soon be doing presentations about Augmented Reality and Bicycling. The first is at Rustbelt Coffee, on Tuesday, May 21, from 5:30-6:30. The other presentation is part of GOBA, and will take place June 18. AR and bicycle safety is part of the presentation.

Click here for more information, as well as to see a collection of videos and links illustrating the impact AR is having on the world of bicycling.