Category Archives: AR

GeoPose: a low tech symbol?

The challenge: how can we simply show the benefits of GeoPose?

For AR to benefit all, and to safely evolve into a platform as powerful as radio, television and the internet, we need to simply illustrate the situation.

If organizations like Microsoft, Amazon, ATT, government agencies, NTT, Apple, traffic and safety supervisors (including AV) etc. eachcreate individual AR platforms that do not access others: there is a problem.

This candle idea hopefully represents the idea that all companies can create their own AR opportunities, but for them to achieve maximum brilliance, a GeoPose standard is needed.

Feedback greatly appreciated. I will redo this video as soon as I can access the studio.

Stay well!

Check these links!

Standards Working Group of the OPen Geospatial Consortium

https://www.ogc.org/projects/groups/swg

Open Augmented Reality Cloud

https://www.openarcloud.org/

The differences between GPS and GeoPose.

Tenten begins

Lately, musicians are going on the web to entertain, to give hope and, understandably, to make some money.

With Tenten, I am doing something like that. I would be surprised if I sell any books or music. This is mostly about connecting with old friends and making new ones. My hope is that I can provide twenty minutes of positive thoughts and energy every day.

I will be prepared before every program, and will not waste anyone's time. Stories for programs are always welcome. Planned topics include art, Asia, augmented reality, writing, photography and video.

If this goes well, I would think about how to upgrade the show technically. This would allow me to show photos, videos, links and do interviews. For now, videos and images will be supported by links on this blog.

In this, the first broadcast, I mentioned the following:

The Agaricus blazei Murrill Notebook. This was written in 2002, and is out of print. The ABM mushroom is extremely good for you, and delicious too.

Bus Stopping Book of photographs of Singapore, all including or referencing buses.

Secrets of Sushi by Kazuko and Chihiro Masui.

i ate tiong bahru, a best seller in Singapore.

i ate tiong bahru audio book

Bubiko Foodtour on Instagram. Search for Bubiko on this blog to find out more about her, including her guide to Augmented Reality.

3how was a dynamic improvisational music performance project in Singapore, co-founded by myself and Amith Narayan, whose projects include The Unseen Guest and The Silent State. 3how's CD is here. A blog post+video about 3how is here.

One minute lesson about Augmented Reality

Your host, Stephen Black. Drop me a line with your questions about AR at any time.

"Augment" means to "add to", or "improve".

AR technology adds digital information to reality. This digital information can be seen by using a phone, tablet or AR headgear. The Hololens headset, by Microsoft, is used in industrial, medical, educational and military uses.

Here is an example of AR, from an American football game:

That image is from a video that does a great job of simply explaining how the yellow line is created. In this case, the device used to "see" AR (the digital information that makes the yellow line), is the technology used by the video production company. Interestingly, in the video, the term 'AR' is not used .

AR is also called XR. AR is not VR.

AR is a huge platform, like radio, television and the internet.

Pokemon Go is based on AR. 19 Crimes Wines used AR very successfully.

AR can be used in industry/for repair/for maintenance:

Cannondale uses this for bikes, but the countless other uses of AR range from surgery to jet engine repair to teaching math, and more.

The information above is very simple, but, hopefully, is a solid introduction to the world of AR.

Once you start to see how widely used AR will become, you will understand how important GeoPose is. I will do a post about GeoPose later, but here is a start.

And, yes, I have a book about AR that I am constantly updating. However, eventually all of the info in the book appears on this blog(search!), or is on YouTube, so subscribe to learn for free.

Stay healthy! Eventually I will do a post on how AR is involved in the war on COV19, but for now I do not know enough to write knowledgeably.

On a closing note, AR is almost always viewed through a device. Here is an example in which no devices are needed. (I first saw this at Troublemaker.)

More links:

For small businesses, two links to think about:

https://www.forbes.com/sites/zarastone/2017/12/12/19-crimes-wine-is-an-amazing-example-of-adult-targeted-augmented-reality/#59f69e2647de

https://www.forbes.com/sites/jeanneobriencoffey/2019/09/29/how-millennials-and-augmented-reality-are-changing-wine-sales/

......

GeoPose, Augmented Reality and Autonomous Vehicles

Interview w SB and Bubiko Foodtour

AR SHOW podcast with OARC /Jan-Erik Vinje, Christine Perey, Jason Fox and Colin Steinman

The State of the AR Cloud with Jan-Erik Vinje, Christine Perey, Jason Fox, and Colin Steinmann (OpenThe AR Show with Jason McDowall 

Serious fun: Corona, AR and handwashing

I have been concerned with health for as long as I can remember. In 2000 I wrote a book about a medicinal mushroom. My partner and I worked on a permaculture farm in Bali a few years ago. My diet is far from ideal, and I should exercise more, and work harder to be a vegetarian. Overall, though, my health is pretty good.

So... I am also very involved with AR... And, I wanted to test an idea, using a lighthearted approach to talk about the Corona situation. At breakfast I mentioned a few ideas to my mom, and an hour later, we had the result above.

Yes, it could be edited. The sound drops out. The camerawork is amateurish. The truth is that I didn't realize I was recording.

But there is a charm to the video, and a few concepts that I do not want to analyze too much.

The software is called FaceReplaced, and it is in beta. One result of this was that, at first, it appeared upside down when we put it on Facebook... Somehow, even that seemed appropriate for these times...

onwARd!

SB

Cap’n Blog (FaceReplaced beta test)

Thanks to Catchar, I discovered the FaceReplaced app. I installed and in less than 5 minutes had a very interesting little video. The following gives you an idea of what FaceReplaced can do but, yes...I hope you are viewing this on a mobile phone, as it seems to be upside down. This is a normal little hiccup for an app in beta. THIS BUG HAS BEEN FIXED.

Cap'n Blog be a wishin' you and yours a happy and hearty day.

FaceReplaced works exceptionally well, with no installation friction, and almost no learning curve.

I am now thinking of a way to get Bubiko in FaceReplaced, so that she can read sections from her book about AR. The challenge is that Face Replaced works best with real 3D objects, and at the moment, I only have Bubiko in 2D (paper) or as a digital adventurer in 2D videos and photos.

on Amazon

A Few Questions about GeoPose

My friend Stuart Rankin, from Six Cat Studios, asked me the following questions about GeoPose. Not sure of the answers, I turned to the OARC, the Open Augmented Reality Cloud. I soon received the following reply from Christine Perey, one of the forces behind the OARC. Thanks to both Stuart and Christine!

How will GeoPose deal with two objects on the other side of the world? 
- each and every real person, place and thing can have a GeoPose at any moment in time. For digital objects or models, a GeoPose can be specified for one point (an anchor)
- two or more objects can calculate properties between themselves (e.g., distance, orientation) based on their GeoPose.

If this information does not match the question you had in mind, let me know. The point to keep in mind is that GeoPose are unique, so the locations and number of objects in your question would determine the number of GeoPose.

Does the theory of relativity have an effect (like it has with GPS)?
- Great question. It seem so, and this point will be further analyzed.

Does it account for things that are supposed to be still, changing. like with an earthquake for example  or shifting continents ?
- we have not yet decided if there will be one universal coordinate reference system (unlikely) and how we will deal with ones that are not well defined or per.
- you might want to study this wikipedia page https://en.wikipedia.org/wiki/ECEF

Who decides where point 0,0,0 is  (above)?

What happens when companies or countries reject the standard because they want to use their own which they think is better or provide political benefit or commercial?

- there will not be interoperability and the services will be confined to “walled gardens” just like mobile phones were in the earlier generations.

So there you have it. If you are serious about the future of AR, do join the OARC and follow their work on developing GeoPose. AND...check out the Open Geospatial Consortium!

These blog posts provide additional information:

Unofficial notes on defining GeoPose, based on the OGC/SWG press release

Hello. Stephen Black here. This is my personal, self-initiated, self-funded and unofficial project to create accurate and simplified definitions about GeoPose. I am doing this because:

  1. I do (worldwide) presentations about AR, and need to be able to explain GeoPose clearly, and with technical accuracy. Short definitions increase comprehension, work well on Powerpoint, and save speaking time for other topics.
  2. GeoPose and AR are topics for journalists, bloggers and reporters, not all of whom have technical backgrounds. Clear and simple definitions allow for the maximum flow of accurate information.
  3. Although my ultimate goal is to create AR experiences/produce AR apps, I am now an AR educator/evangelist: speaking mainly to general audiences. It is clear that AR is not easily understood. GeoPost will be easy to use, but, for now, the concept will likely be intimidating to many people.
  4. English is not always the first language within the tech community.
  5. I'm a writer: I like using the fewest words to create most results.

So... all comments are welcome, and needed. By the time I give my presentation at ARIA/The MIT Media Lab, I hope to present the following ideas with the input and approval of those who are far more knowledgeable than I am.

Of course , once the following are clear, I hope the information can be shared by anyone, anywhere. I will also include the information in my ebook guide to AR project, which is updated as often as possible.

Thank you for your time and attention to this.

Stephen Black

A slide similar to the one above will be shown in my presentations, as well as one which credits the OARC (and any other organizations or individuals).

Please comment upon the italicized sentence. Thank you.

THANKS!

onwARd!

SB

Autonomous Vehicles and Augmented Reality (1/23/20 Collider presentation follow up)

stephen black will be giving presentations in Toledo OH, MIT and elsewhere. Details here.

Facial scan of Stephen Black by Chiaki Williams, using Scandy + iPhone 11 Pro Max

A TEAM OF HACKERS, MINUTES AFTER A MASSIVE EARTHQUAKE. Their mission: study car navigation usage to identify surviving roads, and the traffic upon them. Location: Tokyo, immediately after the 2011 Tohoku Earthquake and Tsunami. The team: members from Toyota, Honda and Nissan; the first time in history the car manufacturers worked together.

This was one of the pieces of information shared by an attendee of my presentation about Autonomous Vehicles and AR. The point of the Japanese automaker story was to illustrate the powerful advantages of interoperable standards. For AR to reach its full potential, AR service providers like Microsoft, Amazon, Apple and others must agree upon standards that are interoperable and respectful of privacy. In other words, a GeoPose standard must be established.

GeoPose is a term given to a 6DoF geospatial reference or link of  an object (physical or digital) to the real world. It can be used to anything from visual positioning systems for AR to self driving cars or flying drones. As URL are vital to the internet, GeoPose will be to AR and real-world spatial computing.

GeoPose is a part of a larger vision for an Open Spatial Computing Platform (OSCP) inspired by the web, but for the era of real-world spatial computing.

At the bottom of this post is an update from Jan-Erik Vinje, regarding the recent activities of the OGC GeoPose Standards Working Group.

Imagine an eight story industrial building which houses 20 large workshops, six of which belong to one company and two workshops are shared by all. Question: will each company have an independent AR guidance system? Will visitors have to switch AR apps when going from one workshop to another? Will inventory suppliers have to download apps for the building and for each workshop? Will repair and maintenance crews have access to one AR system that shows wiring, water, conduits, etc? In emergencies, will fire fighters, police and first responders be able to use one system that indicates where all occupants are, where all combustibles are, where the fire escapes are?

There are countless reasons why GeoPose should be standardized, but emergency responses, medical and traffic regulation are the most obvious. On my website are three posts regarding GeoPose, my ”favorite” being one on the difference between GeopPose and GPS. I am very appreciative of the time and thoughtful explanations of the Open Augmented Reality Cloud team, especially Jan-Erik Vinje, OARC’s managing director.

OARC is a volunteer-run dynamic group who are now working on how to create GeoPose standards that are open to all. If you are serious about AR, please consider joining OARC.

Kura Gallium: Thunderbirds are go!

The talk popped from topic to topic, driven by audience questions and observations, with videos providing starting points.

Hyperreality short film by Keiichi Matsuda

Navdy- Look Forward and experience the future of driving

Tencent Keen Security Lab Experimental Security Research of Tesla Autopilot

PyTorch at Tesla- Andrej Karpathy, Tesla

Transportation Paradigms at the Intersection of Post Industrial Quantum Manifestations

Cannondale Simon Service AR

Nissan Invisible-to-Visible Technology@ CES2019

Bubiko Foodtour Meets Tranzient 1.0

Civil Maps Augmented Reality Maps and Localization

A volumetric scan from the presentation. And yes, he is single. And intelligent: he described how years ago he hacked a turntable so it would rotate slowly enough for him to do a 3D scan. (The image was created in the presentation with an iPhone 11 Max Pro and Scandy software.)

Jeff Koons Art installations in AR

I hope that Dan, who shared the story about the automakers' response to the earthquake, posts the link. (Dan sent it! https://www.iitk.ac.in/nicee/wcee/article/WCEE2012_5300.pdf)

I enjoyed the presentation very much. Thanks to Altimetrik and all who attended.

Next stop Toledo, then MIT.

My two part article about the future of AR on the AIXR website. 

There was one thing I forgot to mention in the presentation: Bubiko Foodtour’s Unusual Guide to Augmented Reality. ARPost wrote this about it:

There’s a great ebook out there that’ll introduce you to all the jargon you need. Whether you want to understand an article better, contribute more to a conversation, or start developing with AR technology, this is a good place to start.

The guide will be updated periodically. I have started the second edition, and after the MIT symposium I will update it again. Those who have the first edition will get a free version of the second, as well as all future updates.

Thanks to all those who have bought the first edition (please leave a review :). I am self-funded, have no sponsors and, so far, only one paid speaking engagement. Your purchase really helps.

onwARd,

SB

photo by Daniel Joseph.

Articles

Augmented Reality Is Used to Improve Autonomous Vehicle Testing Andrew Wheeler posted on December 12, 2019 | Since…www.engineering.com

https://www.thedrive.com/tech/9548/the-biggest-opportunity-everyone-is-missing-in-self-driving-cars

More information about what I have been up to in the world of AR.

re: the OGC GeoPose Standards Working Group, from Jan-Erik Vinje.

The working Group had its kick-off meeting on the 24th of January, 2020 when Christine Perey (Open AR Cloud), Jeremy Morley (British Ordnance Survey) and myself (Open AR Cloud) were elected as co-chairs. https://www.opengeospatial.org/pressroom/pressreleases/3132

The kick-off meeting had participants from across the geospatial industry, government, academia, NGO’s and large corporations like Google. It is important to note that the GeoPose standard, although an initiative from Open AR Cloud, is not being primarily going to be developed inside of Open AR Cloud, but rather in a leading standards body of the geospatial sector.

OGC announces the creation of new GeoPose Standards Working Group

opengeospatial.org

Bubiko visits Paddington

At Paddington Station, in the store filled with all that is Paddington.
The famous statue. "Please look after this Bear. Thank you."
The world famous bear meets the world famous chef. Lobby of the Paddington Hilton, London.
Bubiko, in awe.

VIEW 2019 part 4

The Hugo Guerra of Hugo's Desk. Hugo is an extremely good compositor and teacher.

From my TV and gamemaking days, I have some familiarity with compositing. Although it is almost certain that I will never become a compositor, I sat in on Hugo's seminar. I think I retained about .001% of the technical information that Hugo shared, but observing his workflow and troubleshooting tips was inspiring.

The Addams Family: Reintroducing a Classic: the presenters, co-director Conrad Vernon and Producer Alexa Schwartz, spoke about the challenges in creating a new version of The Addams Family. Although the story is contemporary, the two looked at the original drawings of Charles Addams. His drawings, featured in The New Yorker magazine, were the basis of the original TV show.

Conrad and Alexa presented like the professionals that they are. They completed each other's sentences. They kept the topics moving. Perhaps they rehearsed and planned for a long time, or maybe they just improvised so informatively because they knew their subject so well. They showed clips and explained the stories behind them. If there is an Addams Family Hall of Fame, Conrad and Alexa should be in it.

Animated movies have their own unique characteristics, but they also act as "containers" for other art forms, music being the most obvious example, drawing being another. However, successful animated characters are the result of combining drawing, sculpture, programming and... dreaming. Animated characters are often realistic, but they can ignore the laws of physics. Dreams and animation need no logic.

Having said that, the more a VFX operator/CG artist/animator studies reality, the better. Noticing the almost imperceptible muscles movements of the human body results in all kinds of possibilities, especially when one must make a character react to something unexpected. The following clip was shown by Theodore Tye, as part of his excellent presentation entitled Beyond Eye Darts: A Closer Look at Acting for Animation:

This masterclass, through the analysis of clips from animated and live- action films as well as acting theory, takes a fun, in-depth look at the study and execution of both comedy and dramatic acting for animation.

Following is one of the clips shown to exemplify a reaction worth studying.

VIEW took place in OGR Turino, an arts center in what was once a train station.
Glen McIntosh is a paleo-artist, and the supervising artist for Jurassic World.Glen's first film was Star Wars: Episode 1: The Phantom Menace. It was a pleasure to watch him work and share his stories.
Turin is a delight!
Bubiko photobombing animation bigwigs.
Hal Hickel, a legend at Industrial Light and Magic.Winner of both an Academy Award and BAFTA. He has worked on Star Wars, Jurassic Park, AI, Pirates of the Caribbean, Toy Story and The California Raisins!
Closing party. The London Siggraph people put copies of interesting black and white images on the tables, making Offtopic a bit like their Drink and Draw nights in London.

I have just settled down after travelling for over two months. I am still processing all that I learned and experienced at VIEW and an other post is on its way.