Tag Archives: augmented reality

What is Geopose?

This is the first of three parts. Part two is here.

There is no definition for 'geopose' on Wikipedia.

This post is an attempt to create a simple definition for the word.

In Bubiko Foodtour's Unusual Guide to Augmented Reality, 'geopose' is defined as:  A word that, now, “kind of means” a shared frame of reference signifying the unique positions and orientations of digital OR physical objects in real OR virtual spaces

The Open Augmented Reality Cloud is focused on, among other things, creating a definition upon which everyone agrees upon and can use. See also: anchor, Open Augmented Reality Cloud

The following is from a Github Post started by blairmckintyre.

(I just discovered his blog: https://blairmacintyre.me/ Wow!)

Mr. McKintyre wrote:

What will the relationship between WebXR and geospatial data be?

It seems that WebXR cannot entirely ignore geospatial positioning, as geospatial content will be a major use case for mobile AR (at least eventually).

The web already has a geolocation API, but it is not sufficient for these purposes: it gives position but not orientation, is of very poor quality and not synchronized with the WebXR frame data. The deviceorientation API cannot be relied on for orientation: it is of very poor quality, was never standardizes (and is potentially going to be removed from existing browsers) and is also not synchronized with the WebXR frame data.

ARKit offers the option to have it's local coordinate system be aligned with geospatial orientation (e.g., Y up, Z south, X east). This provides a possible direction for how geospatial might be handled: have the WebXR API expose a property that says if the coordinate frame can be aligned with geospatial EUS coordinates, and provide a way for the developer to request this. Crude/simple geospatial positional alignment (between the user and the local coordinates) is easier, if you are guaranteed to have the local device coordinates aligned with EUS: each time a geospatial value is received from the local coordinates, an estimate of the geospatial location of the origin of the local coordinate frame can be updated (based on error values, etc). It won't be any better than the error of the geolocation API, but can be stable (because the local coordinates are used for locating and rendering content, not the very-slowly-changing geolocation values).

Hi I am the founder of the https://open-arcloud.org/ . The TL DR AR-cloud description is a 1:1 digital map/twin of the physical world stored in the cloud that enables a shared programmable space attached directly to our physical suroundings that enables multiuser AR and persistent and universally consistent placement of virtual assets in the real worldOne of the things we hope can help bring this to reality is a standard definition of geographical position and orientation that can be understood across platforms and applications. What we call "GeoPose". Each AR-goggle, AR-smartphone or AR-content could have a GeoPose at any given moment.Obtaining GeoPose of an XR-device could be achieved by matching sensor data from the device with the 1:1 map in the cloud through something like a "GeoPose" cloud service. Once the device has its GeoPose it can display geospatial data and assets that are anchored to a GeoPose.A bit more about that here:
https://open-arcloud.org/standardsplease join our slack channel and chime in on how you think a GeoPose should be defined.
https://join.slack.com/t/open-arcloud/shared_invite/enQtMzE4MTc0MTY2NjYwLWIyN2E4YmYxOTA4MWNkZmI5OGQ4Mjg2MGYzNTc4OTRkN2RjZGUxOTc4YjJhOTQ0Nzc3OWMxYTA3ZDMxNGEzMGEMy hope of course is that WebXR will support using device GeoPose and do the proper transforms for assets that are ancored to GeoPoses or assets that are described by geospatial coordinates.

...............................................................

A bit of a bumbling attempt at describing geopose. The source materials are from a Powerpoint presentation on AV +AR, held at the Collider in Detroit in July 2019. The presentation is here.

The following is from a free PDF download entitled:

TITLE: Geopose Standards Working Group Charter [OGC 19-028]

Author Name (s): Jan-Erik Vinje, Christine Perey, Scott Simmons

Email: jan-erik.vinje@norkart.no

DATE: 2019-05-17

CATEGORY: SWG Charter Template

All physical world objects inherently have a geographically-anchored pose. Unfortunately, there is not a standard for universally expressing the pose in a manner which can be interpreted and used by modern computing platforms. The main purpose of this SWG will be to develop and propose a standard for geographically-anchored pose (geopose) with 6 degrees of freedom referenced to one or more standardized Coordinate Reference Systems (CRSs).

Definition of geopose

A real object in space can have three components of translation – up and down (z), left and right (x) and forward and backward (y) and three components of rotation – Pitch, Roll and Yaw. Hence the real object has six degrees of freedom.

The combination of position and orientation with 6 degrees of freedom of objects in computer graphics and robotics are usually referred to as the object’s “pose.” Pose can be expressed as being in relation to other objects and/or to the user. When a pose is defined relative to a geographical frame of reference or coordinate system, it will be called a geographically-anchored pose, or geopose for short.

Uses for geopose

An object with geopose may be any real physical object. This includes object such as an AR display device (proxy for a user’s eyes), vehicle, robot, or a park bench. It may also be a digital object like a BIM model, a computer game asset, the origin and orientation of the local coordinate system of an AR device, or a point-cloud dataset.

When the geopose of both real and virtual objects include the current position and orientation of the objects in a way that is universally understood, the interactions between the objects and an object and its location can be put to many uses. It is also important to note that many objects move with respect to a common frame of reference (and one another). Their positions and orientations can vary over time.

The ability to specify the geopose of any object enables us to represent any object in a universally agreed upon way for real world 3D spatial computing systems, such as those under development for autonomous vehicles or those used by augmented reality (AR) or 3D map solutions. In addition, the pose of any object can be encoded consistently in a digital representation of the physical world or any part therein (i.e., digital twin).

The proposed standard will provide an interoperable way to seamlessly express, record, and share the geopose of objects in an entirely consistent manner across different applications, users, devices, services, and platforms which adopt the standard or are able to translate/exchange the geopose into another CRS.

One example of the benefit of a universally consistent geopose is in a traffic situation. The same real-time geopose of a vehicle could be shared and displayed in different systems including:

Open Geospatial Consortium

Geopose SWG Charter Page 2

OGC 19-028r1

- a traffic visualization on a screen in another car,

- shown directly at its physical location in the AR glasses of a pedestrian that is around the corner for the car, or

- in the real time world model used by a delivery robot to help it navigate the world autonomously.

........................................................................................................................

argon.js documentation

This site contains documentation for web developers using Design Tools to add AR content to a web application.

Argon-aframe — Lesson 7: Geolocation

Key features of augmented reality include 1. the ability of associating data objects with places in the world and 2. displaying those objects at those places.

The <ar-geopose> primitive is Argon-aframe’s way of locating objects in physical space (of the planet). The <ar-geopose> primitive creates an entity with a referenceframe component. This component defines the position and/or rotation of the entity by an LLA (longitude, latitude, altitude), so you can locate your object anywhere on the earth relatively accurately by using this tag.

You can find the longitude and latitude through Google Maps or through a variety of mobile applications. Some apps will also give your the altitude of a location.
.........................................................................................................................................

The Open Augmented Reality Cloud glossary does not have a definition for 'geopose' as of September 19, 2019.

  1. Geo Spatial Pose: [ please define ]
  2. Pose: [please define ]
  3. Position: [please define]

It does, however, have the following post:

Reference Implementations for Conversion Between Geopose and Cartesian Coordinate Systems

There will be a need throughout many parts of the technological ecosystem to convert object poses between a geospatial coordinate-system and local ones (typically the Cartesian x,y,z in metric as used in most AR SDKs). This repository is the first step to create reference libraries in different programming languages, available for everyone to use for free.

Contributions are welcome.

  • © 2019 G
Geopose: take 2. Comments greatly appreciated, as I will redo the visuals used in the presentation and improve my speaking skills. Hopefully , anyway.

The Greatest AR Tour in History!

Would you like to support THE GREATEST AR TOUR IN HISTORY? Do you want to learn the latest news from AWE, Austin, Japan, Detroit, Turin, Munich, Shenzhen and Japan!?

Austin, London, Berlin, Munich, Paris, Shenzhen, Tokyo...full tour info at the bottom of this post. http://www.blacksteps.tv/blam-bubiko-foodtour-on-the-road/
(Photographer: Marcha Farley)

Stephen Black and Bubiko Foodtour are about to go global: learning, educating and networking at some of the biggest AR events in the world. We just need a little financial fuel...we are movin’ and groovin, but our app isn’t out yet! Startup blues!

Not a good time to help fund the excitement? We definitely understand, but why not follow this blog where you can read, and comment upon, informative articles like this: http://www.blacksteps.tv/towards-an-understanding-of-ar-cinema-possibilities/

Stephen Black and Bubiko at ARIA, MIT

You’ve got a little extra cash, and want to help? Thank you! PM me, tell me what you do or about your product, or what Bubiko and I can do to help you in anyway.

You're looking for an evangelist? Get in touch so our enthusiastic team can immediately start learning about you and planning to get the word out!

No one paid for this; it's just an example of how excited we get. It was prepared for a presentation at Hong Kong PolyU.

Your company wants to sponsor the greatest AR tour in history? Step right this way!

Bloggers, podcasters, media people... have we got unique and informative stories for you! Happy to share our information-packed adventures with your audience. Here's a sample story about Shenzhen.

Sayuri Okayama, co-creator of Bubiko Foodtour at a hackathon at MIT sponsored by Magic Leap.

Oh! Bubiko wrote an unusual and very informative book about AR: https://www.amazon.com/dp/B07WQTT22Z Buy one of these, learn a lot and help the tour!

Thanks for reading this far and any positive thoughts that you can provide. Stephen Black and Bubiko Foodtour

Get behind it before it gets past you
Now on tour... Bubiko, Eggy, Ollie and Obasan A! R! Let's go!(Lemme know if you want one of these shirts!)

Austin Startup Week: September 22-25 attendee

London: presentations date to be determined

Berlin: Meetup October 15

Amsterdam: dates to be determined

Munich: presentation at Open Augmented Reality Cloud Symposium Oct 16

Munich: attending AWE October 17/18

Turin attending View October 21-24

Paris: presenting at PARIS October 25

Detroit: Date to be determined. An update of the AR+AV presentation at Collider

2020

MIT Attending ARIA, where Stephen Black presented this year

SXSW2020 Attending, Sayuri Okayama and Stephen Black are possibly presenting:  SB Proposal SO Proposal 

Shenzhen, China: March presenting at Trouble Maker      my article about Shenzhen

Singapore: Biennale November 22, 2019, through March 22, 2020

Shenzhen: March 28/29 attending AWE China

Tokyo: April Tama Art University

Ashiya, Japan: April date to be determined

This post has more tour-related info.


Detroit: Traffic Studies

As I become more involved AR's potential impact upon traffic, I see roads, vehicles, pedestrians and bicycles differently. The following documentary photographs are study aids; barely related to my previous street photography projects, such as the Bus Stopping series.

There is also a study of San Francisco here.

A terrible photograph, but a great example of the realities of the street. Glare attacks everyone. If there were a dependency upon a device displaying crucial information, what would happen in this situation?
Waze and other apps provide the latest info on detours, construction , travel times and more. With Waze, the data is crowdsourced. What relationships will be formed between these kinds of apps and autonomous vehicles?
The overall picture of bicycle parking in Detroit: what does it look like?
Ebike parking?
What is the future of the parking lot?
Detroit's original layout.
Dashboard of one of May's autonomous vehicles.
One of May's AVs moving out into traffic.
For nearly one hundred years, Detroit has created our perception of what a car is. Let's see what happens next...

I will be making a presentation about Augmented Reality and Autonomous Vehicles at Altimetrik, on August 8, 2019.

There are a number of posts about AR and bicycling here.

These photographs were taken during Detroit Startup Week.

Bubiko in Lawnspace screen test

Bubiko's guide to AR is now available on Amazon!

Bubiko: what is a stage?

The goal is to prepare for the possibilities of AR cinema.

This post documents a simple test. The Bubiko model used for the Tech in the Tenderloin event was used. Two locations: a garage and an open piece of land. The objective: to gain an understanding of what a “stage” can be in AR. AR is a new medium; to use the established techniques of theatre, television and movie is to fail to grasp the uniqueness of AR. Performance art and dance provide clues.

Notes: Spark used

  • Occlusion not a concern at this time
  • Ambient light a constant
  • Size and scaling of Bubiko purposely varied

Bubiko was created by Stephen Black and Sayuri Okayama

  • iPad used; no manual controls nor color correction
This is Bubiko Foodtour, still with the balloons and banner she used for her debut in San Francisco, at Tech in the Tenderloin’s 2019 TNT Tech Fest,  Bubiko is a work in progress, this is not her final version.
Bubiko is a 3D model made by Novaby, based on ideas by Stephen Black and Sayuri Okayama.
These images are a screen test of sorts, a way of documenting the possibilities and challenges of AR cinematography.
AR cinematography is one of my AR goals, especially making content for autonomous vehicles.
In these images. Bubiko was positioned near the white log. Only the camera (an iPad) moved. The software used was Spark. It was stable, except when used at long distances, in which case Bubiko appeared some distance away from the post.
The camera automatically controlled exposure. The light was even, the time being late afternoon/early twilight.
Occlusion was not important in this test, but I would love to use a software like 6D for testing.
Again, Bubiko did not move, but her size was changed in camera. AR cinema reminds me of machinima. There is another test of Bubiko HERE.
The format of the screen size is both an opportunity and a challenge.
Bubiko Foodtour models for some AR camera tests.
Interesting that the same model can have the size of a mouse, or a giant, or anything in between. Size in AR was the topic of this blog post. Thanks again to Fabian Winkler.
Bubiko is actually closer to the stump than this image suggests.
Sparks had some difficulty as I moved away from Bubiko's position. For this experiment it was simply an interesting development. If this were actually part of an movie shoot, I would reposition her, or do testing. It should be noted that wifi was not needed to create these images.

Arbicles

A list of all of my AR+bike blog posts is here.

The future of AR in the world of bicycling
A chart depicting the hypothetical uses of augmented reality in the world of bicycling.

ARBICLE- A piece of bicycle equipment, with partial or total augmented reality functionality. A bicycle light with some AR functions is an arbicle. A device which acts as a "AR computer", exclusively managing AR functions for the bike, traffic and rider is also an arbicle.

The word "arbicle" was coined by Stephen Black in 2019, in response to a perceived need for AR-compatible bicycle gear.Stephen Black is a writer, a visual artist and an AR/VR producer.

The chart above is a hypothetical overview and no such network or devices now exist. LIDAR is used an example of a traffic monitoring system. In reality, LIDAR is heavy, delicate and extremely expensive. Unlike autonomous vehicles, bicycles must have an attentive human steering and braking. Thus,LIDAR would be unnecessary. However. sensors detecting objects within a range of 50 feet around the bike would be advantageous. An arbicle featuring a rear view camera with a feed into the visor or smartglasses is an obvious need. ARbicles specializing in emergencies would be another obvious need.

This chart is a result of research and thought related to the book I am working on about AR and traffic safety, focusing on bicycles. The working title is AR on Wheels.

I will be making a presentation about AR at the Great Ohio Bicycle Adventure, in Port Clinton, on June 18. I

Also, if you are near San Francisco's Tenderloin District on June 28th, you are warmly invited to the world premier of Bubiko Foodtour!

Bubiko will be at the Novaby booth at the Tech in the Tenderloin Fair! her app will not be on dispaly, as we haven't made it yet, but Bubiko will be hosting an interactive event that is sure to be a crowdpleaser.

Grudge match: Bubiko Foodtour vs. Jackie Chan
Grudge match

ARphabet Tour: Indiegogo Introductory video notes

All of the sections of the ARphabet Tour are explained here.

Notes for the video introducing the ARphabet Tour on Indiegogo.

Location: Boulevard of Houqian Bei

Stephen Black standing in the heart of China's Silicon Valley, holding the 2018 laminated pamphlet of Bubiko Orwell Tour highlights.

Like this test: https://youtu.be/fM2Z6kr7mAs

Points to cover:

  • 2002: After years of working in art, photography and network TV (Cartoon Network, Fuji TV, Fox, CNN+) became creative director at 3D gamemaking company, WalkerAsia
  • Walker/Asia was also doing something like Youtube, three years before Youtube.
  • CEO's unexpected demise results in non-action, despite great interest by Singapore Ministry of Education, Singapore Science Center, publishers in Hong Kong and universities in Japan.
  • SB, son of a book salesman, decides to write books and wait for VR/AR/spatial computing to become mainstream. Inspirations: his father, a book salesman and the release of the Kindle, Amazon's pioneering ebook reader.

  • Visa complications result in what will become the Bubiko Orwell Tour of Southeast Asia. SB pivots from VR to AR.
  • AR cinema becomes the focus, starring the following characters: the Dundercats (collaboration with Six Cat Studio), Secret Donut World (collaboration with David Severn) and Bubiko Foodtour.
  • AR presentations/workshops at Hong Kong PolyU, a presentation at Le Wagon and pitches to VCs at TechCrunch.
  • An invitation to participate in ARIA at MIT  becomes the inspiration for the ARphabet Tour. Debuting at ARIA will be an ARKIT/Unity collaboration with Dominique Wu/Hummingbirdsday Studios, a game featuring Green Bean Boy and co-starring Bubiko Foodtour.
  • The ARphabet Tour will also be a platform for Stephen Black to do readings and writing workshops.
  • The ARphabet Tour also aims to educate people about mango sticky rice, Bubiko's favorite food.
  • Separate from this, briefly mention the unicorn concept which has a high degree of success regardless of the global economy or 5G take-up.

All of the sections of the ARphabet Tour are explained here.

Presentations and workshops by Stephen Black at HK PolyU.