Tag Archives: autonomous vehicles

Autonomous Vehicles and Augmented Reality (1/23/20 Collider presentation follow up)

stephen black will be giving presentations in Toledo OH, MIT and elsewhere. Details here.

Facial scan of Stephen Black by Chiaki Williams, using Scandy + iPhone 11 Pro Max

A TEAM OF HACKERS, MINUTES AFTER A MASSIVE EARTHQUAKE. Their mission: study car navigation usage to identify surviving roads, and the traffic upon them. Location: Tokyo, immediately after the 2011 Tohoku Earthquake and Tsunami. The team: members from Toyota, Honda and Nissan; the first time in history the car manufacturers worked together.

This was one of the pieces of information shared by an attendee of my presentation about Autonomous Vehicles and AR. The point of the Japanese automaker story was to illustrate the powerful advantages of interoperable standards. For AR to reach its full potential, AR service providers like Microsoft, Amazon, Apple and others must agree upon standards that are interoperable and respectful of privacy. In other words, a GeoPose standard must be established.

GeoPose is a term given to a 6DoF geospatial reference or link of  an object (physical or digital) to the real world. It can be used to anything from visual positioning systems for AR to self driving cars or flying drones. As URL are vital to the internet, GeoPose will be to AR and real-world spatial computing.

GeoPose is a part of a larger vision for an Open Spatial Computing Platform (OSCP) inspired by the web, but for the era of real-world spatial computing.

At the bottom of this post is an update from Jan-Erik Vinje, regarding the recent activities of the OGC GeoPose Standards Working Group.

Imagine an eight story industrial building which houses 20 large workshops, six of which belong to one company and two workshops are shared by all. Question: will each company have an independent AR guidance system? Will visitors have to switch AR apps when going from one workshop to another? Will inventory suppliers have to download apps for the building and for each workshop? Will repair and maintenance crews have access to one AR system that shows wiring, water, conduits, etc? In emergencies, will fire fighters, police and first responders be able to use one system that indicates where all occupants are, where all combustibles are, where the fire escapes are?

There are countless reasons why GeoPose should be standardized, but emergency responses, medical and traffic regulation are the most obvious. On my website are three posts regarding GeoPose, my ”favorite” being one on the difference between GeopPose and GPS. I am very appreciative of the time and thoughtful explanations of the Open Augmented Reality Cloud team, especially Jan-Erik Vinje, OARC’s managing director.

OARC is a volunteer-run dynamic group who are now working on how to create GeoPose standards that are open to all. If you are serious about AR, please consider joining OARC.

Kura Gallium: Thunderbirds are go!

The talk popped from topic to topic, driven by audience questions and observations, with videos providing starting points.

Hyperreality short film by Keiichi Matsuda

Navdy- Look Forward and experience the future of driving

Tencent Keen Security Lab Experimental Security Research of Tesla Autopilot

PyTorch at Tesla- Andrej Karpathy, Tesla

Transportation Paradigms at the Intersection of Post Industrial Quantum Manifestations

Cannondale Simon Service AR

Nissan Invisible-to-Visible Technology@ CES2019

Bubiko Foodtour Meets Tranzient 1.0

Civil Maps Augmented Reality Maps and Localization

A volumetric scan from the presentation. And yes, he is single. And intelligent: he described how years ago he hacked a turntable so it would rotate slowly enough for him to do a 3D scan. (The image was created in the presentation with an iPhone 11 Max Pro and Scandy software.)

Jeff Koons Art installations in AR

I hope that Dan, who shared the story about the automakers' response to the earthquake, posts the link.

I enjoyed the presentation very much. Thanks to Altimetrik and all who attended.

Next stop Toledo, then MIT.

My two part article about the future of AR on the AIXR website. 

There was one thing I forgot to mention in the presentation: Bubiko Foodtour’s Unusual Guide to Augmented Reality. ARPost wrote this about it:

There’s a great ebook out there that’ll introduce you to all the jargon you need. Whether you want to understand an article better, contribute more to a conversation, or start developing with AR technology, this is a good place to start.

The guide will be updated periodically. I have started the second edition, and after the MIT symposium I will update it again. Those who have the first edition will get a free version of the second, as well as all future updates.

Thanks to all those who have bought the first edition (please leave a review :). I am self-funded, have no sponsors and, so far, only one paid speaking engagement. Your purchase really helps.

onwARd,

SB

photo by Daniel Joseph.

Articles

Augmented Reality Is Used to Improve Autonomous Vehicle Testing Andrew Wheeler posted on December 12, 2019 | Since…www.engineering.com

https://www.thedrive.com/tech/9548/the-biggest-opportunity-everyone-is-missing-in-self-driving-cars

More information about what I have been up to in the world of AR.

re: the OGC GeoPose Standards Working Group, from Jan-Erik Vinje.

The working Group had its kick-off meeting on the 24th of January, 2020 when Christine Perey (Open AR Cloud), Jeremy Morley (British Ordnance Survey) and myself (Open AR Cloud) were elected as co-chairs. https://www.opengeospatial.org/pressroom/pressreleases/3132

The kick-off meeting had participants from across the geospatial industry, government, academia, NGO’s and large corporations like Google. It is important to note that the GeoPose standard, although an initiative from Open AR Cloud, is not being primarily going to be developed inside of Open AR Cloud, but rather in a leading standards body of the geospatial sector.

OGC announces the creation of new GeoPose Standards Working Group

opengeospatial.org

Augmented Reality + Autonomous Vehicles: Stephen Black @ Collider

Bubiko's guide to AR is now available on Amazon!

The following are additions that were not discussed at the Detroit meetup.

https://www.forbes.com/sites/edgarsten/2019/08/12/turning-back-seat-boredom-into-a-virtual-theme-park/#712404fc6019

! https://www.thedrive.com/tech/9548/the-biggest-opportunity-everyone-is-missing-in-self-driving-cars

!! https://panelpicker.sxsw.com/vote/100430 (What Augmented Driving Will Feel Like, a SXSW presentation by Theo Calvin.)

I wish I had known about the projects and gentlemen above before my Detroit talk.

Do read the article by Alex Roy.

Please vote for Teo Calvin's SXSW proposal.

.......................

Presentation

Thank you very much to Jacob, Rahul and Altimetrik for making this happen. It was a blast! A description of the event, and an introduction to Collider is here.

SLIDE 2

Hyperreality by Keiichi Matsuda

https://www.rt.com/news/455341-chinese-hackers-tesla-autopilot/

https://mashable.com/article/nissan-ar-virtual-reality-windshield-display/

The Nissan video features outstanding visuals.

SLIDE 3

https://www.openarcloud.org/reports/sotarc-2019

The above link is a MUST for anyone with a serious investment in AR.

Novaby is the company that did/is doing a great job with Bubiko.

(Yes, all of the research you see is self-funded. If you can help with a donation or a job...get in touch, please. I am also a photographer, artist, videomaker and a writer.

SLIDE 4

You can see all of my adventures with Bubiko elsewhere on this blog. We would be grateful for your votes for two proposals for SXSW.

This is my proposal.

This is the proposal of Sayuri Okayama, my partner.

THANK YOU FOR YOUR VOTE!

SLIDE 5

This book is a "living" book. Meaning if you buy it, you will get the updated editions free.

SLIDE 7

BONNETS! (My Powerpoint looks extremely low tech. As much as I like this look, I have to say I had no choice. I was using my Chromebook , and used the baked in slide show creator. Next time, I might actually have the time to do some design work.)

SLIDE 8

Artivive One of my own Artivive demos is here. Another, here.

Leo

Bubiko Foodtour

Rouvy Augmented Reality Released: First Ride & Explainer.

DC Rainmaker does his usually outstanding job of reviewing a bicycle-related product.Jump into the video at about the 4 minute mark to see some exemplary AR techniques. Click here to see more examples and ideas related to AR+ Bicycles.

Cannondale, for the win! A great example of functional AR in an everyday situation, as opposed to a factory or medical facility.

SLIDE 9

From a presentation I did on AR and bike safety. All of those concepts need to be unified and rethought for the age of AR.

SLIDE 10

Mapillary

LADOT

Superworld

SLIDE 11

The Open Augmented Reality Cloud people are making efforts to establish a geopost standard. If you are serious about AR, follow their efforts, or better join them and let your voice be heard!

What you see is a test I did with Bubiko. While I was in a car, I positioned her in the road ahead. We then drove forward. It is not clear, and I will redo this test.

But what happened is that Bubiko was in front, then she appeared in the car, and then we saw her in the road behind us. She did not move with/in relationship to the car.

This was using Facebook Spark AR. Technical support: the amazing Dana.

Stunt driver: Norm Black.

No AR characters were harmed in the production of this rest.

SLIDE 12

OPEN AUGMENTED REALITY CLOUD

SLIDE 13

The AR Podcast is a must for anyone serious about AR. This is a link to the extremely informative and important interview with four of the people involved with OARC.

SLIDE 14

Thank you Sergei!

https://www.slideshare.net/sergiikozyrev?utm_campaign=profiletracking&utm_medium=sssite&utm_source=ssslideview

SLIDE 15

One style of point cloud rendering.

SLIDE 16

Another way to render a point cloud. There are many ways to create point clouds and they must be interoperable.

https://www.clarissewiki.com/3.6/creating_a_point_cloud.html

SLIDE 17

An example of an organization that has information that would be useful for AR in Detroit. Geographic Information Services… How much of what is under the road do they have records of? This info would be necessary for many AR services,

How do they make pointclouds-or do they even do this yet?

SLIDE 18

One of Magic Leap's views on how the total AR world might look like.

The layers presented include IoT (the Internet of Things, as well as AI. Photo courtesy of Tony at the Skarred Ghost, another person I suggest serious AR/VR people support and follow.

SLIDE 19

Another presentation from Magic Leap on how the total AR Cloud might look. They use the term "Magicverse".

SLIDE 20

A representation by the OARC on what the layers of the cloud would be. My suggested terms would be REAL1 (R1), REAL2 (R2) and REAL3 (R3). R1=the physical world. R2; the layer with few changes; buildings, landmarks, geography. R3 being the part of the AR cloud that changes the most, and has the most segmentation.

This system also lends itself to further classification. R2C22 , for example, could refer to a specific block in Chicago for example, and R2C22E could be the collective "channel" for all organizations utilizing traffic emergency communications for that area.

SLIDE 21

Microsoft Azure Spatial anchor systems. 'Anchor systems' refers to geoposing. There can be an endless number of clouds. Interoperability... Machines reading the world for humans... A browser...AI assisted browsers.

SLIDE 22

This is from the State of the Open AR Cloud 2019 report by the Open Augmented Reality Cloud group. Already some governing bodies are being formed.

The report is free. Get it here.

SLIDE 24

Ed Garten's article on AV safety, for Forbes magazine.

SLIDE 25

The League of American Bicyclists has an active interest in AR and AV.

https://www.bikeleague.org/content/automated-vehicle-overview-box

SLIDE 27

And the amazing BabbleRabbit! https://twitter.com/BabbleRabbit/status/1115271007315615750

SLIDE 28

https://www.researchgate.net/publication/314522858_Supporting_Trust_in_Autonomous_Driving

https://www.researchgate.net/publication/333645946_The_Impact_of_Autonomous_Vehicles'_Active_Feedback_on_Trust

SLIDE 30

An AV by May.

SLIDE 33

Shenzhen's celebration used the entire city as a canvas. Something like this could be done in Detroit with AR, for much less cost, and with greater detail. AVs could travel on programmed routes... a new form of musical is born!

My report on the maker culture of Shenzhen is here.

SLIDE 34

The Fox Theatre is one of Detroit's cultural assets that could be utilized. This slide shows some of the layers of creation and co-operation that need to be considered.

SLIDE 35

An example of an urban AR project, this one by Snapchat. This article also raises questions about AR in public spaces.

SLIDE 36

Diego! DIA! https://www.dia.org/art/rivera-court

SLIDE 37

http://amirbaradaran.com/2019/works-pages/fml.html

Go to the "0.52" mark to see the actual AR clip. It is very brief.

The video on this site by Artivive showcases some possibilities in regards to AR + flat art. https://artivive.com/walkietalkie/

SLIDE 38

Apple's AR Art program. https://www.apple.com/newsroom/2019/07/apple-offers-new-augmented-reality-art-sessions/

SLIDE 39

Back to bROADWAY… and we have "discovered" that the Fox Theater is geofenced. Geofencing is a blocking of AR access. Military bases, sensitive areas...the interior of homes. The Fox Theatre is copyrighted, I believe. In this fictional example, Fox may have geofenced their theater to prevent unauthorized AR usage.

SLIDE 40

MOTOWN!

SLIDE 42

Bose AR

So there ya go! Any questions ask below.

I am available for consultation and all kinds of AR producing, as well as photography, video, art and writing projects. Thank you for any ideas and/or opportunities.

And again, please consider voting for our two SXSW presentations:

XR: bike safety, music and Bubiko Foodtour

and

Augmented Reality and Food

THANKS!

onwARd,

Stephen Black

Cloudy Traffic

A collection of posts regarding AR and Bicycling can be found here.

Traffic planning in the age of the cloud. I have read a lot and talked to many experts, but the questions in this little chart still are unanswered. To me, at least. Any ideas or thoughts are welcome; just use the comments section. Thank you! If you are an expert and want to be credited, or interviewed for my upcoming books just let me know. One book is about AR and bicycle safety. the other is about AR and traffic. (Have not yet finalized the titles.)

Obviously, the following is hypothetical; I can't think of any existing city which could accommodate five one-way lanes of traffic.

CURB ACTIVITY: Pedestrians. Parking spots for ebikes,bikes, scooters, fire hydrants, subterranean electricty and water lines, wheelchair access, bus stops, taxi/Uber/Lyft pick up and drop off areas

BIKE LANE: Individual and groups of riders, ll requiring two-way communication for weather, traffic patterns etc.

AV LANE small and large vehicles, some functioning as mobile rooms (classrooms with remote teachers, discussion rooms, meeting rooms, chill rooms, even mobile workout spaces with offsite trainers)

EMERGENCY LANE/DELIVERY LANE/BUS LANE Could something like this be managed? By whom? Would involve communicating with AVs.

TRAFFIC SIGNAL With proper traffic planning, autonomous vehicles would not need to "see" a physical light. and in this slightly futuristic scenario, could the traditional red/green/yellow lights be replaced by screens? Not just colors could be displayed, but traffic information.

WHO IS USING WHAT KIND OF AR?
Pedestrians- shopping, entertainment and internet services/information and maps for walking.

Bicyclists- maps and traffic information, internet services, including music.

Autonomous Vehicle 1 Kids using smartglasses to watch Bubiko Foodtour AR movies, one parent uses smartglasses to plan the day's activities, the other parent, also with smartglasses, attends an AR meeting conference call.

Autonomous Vehicle 2 A regularly scheduled "classroom mobile"with four students, a human teacher and AR educational materials.

QUESTIONS/THOUGHTS:

Vehicle 1: the Bubiko AR movie is on Google Cloud, the AR meeting is hosted on Apple's iCloud service, the other parent is using Facebook's cloud service. The windshield display is by WayRay and hosted on Microsoft's Azure cloud service.

Vehicle 2 is fitted with a Sony mobile AR classroom and the windshield AR hosting software is by Kamatera.

Emergency Vehicles: capable of seeing and interacting with emergency situations before arriving. Connected to a central traffic planning system, emergency vehicles and AVs are capable of maneuvering so that emergency vehicles get to their destination as quickly as possible.

Autonomous Delivery vehicles can be programmed to deliver with minimum traffic interference; for example at specific low traffic times.

Curb Activity is monitored by Open Curbs, Populus and Remix, all of whom feed information into private and government service providers who then use AR to provide information to those in traffic.

Road surface conditions: Potholes, floods, ice and snow. Monitored and then delivered to a central traffic planning agency.

Underground: sewers, flood control, power cables and more. Information available by AR

Drones: somehow drones will enter into the mobile AR picture...

In researching the above, I just discovered n excellent article about MDS, Mobiliy Data Specification.Here is a excellent article by David Zipper about MDS. Also highly recommended: this presentation by Regina Clewlows and Don MacKenzie.

................................

AR and bicycle interaction: a collection of posts on this topic is here.

If you happen to be in Port Clinton, for the Great Ohio Bicycle Adventure, stop by!

Bubiko's public AR debut! San Francisco! June 28! Bubiko's very, very excited! Tech in the Tenderloin

Thanks for leaving a comment!