Tag Archives: augmented reality

Unofficial notes on defining GeoPose, based on the OGC/SWG press release

Hello. Stephen Black here. This is my personal, self-initiated, self-funded and unofficial project to create accurate and simplified definitions about GeoPose. I am doing this because:

  1. I do (worldwide) presentations about AR, and need to be able to explain GeoPose clearly, and with technical accuracy. Short definitions increase comprehension, work well on Powerpoint, and save speaking time for other topics.
  2. GeoPose and AR are topics for journalists, bloggers and reporters, not all of whom have technical backgrounds. Clear and simple definitions allow for the maximum flow of accurate information.
  3. Although my ultimate goal is to create AR experiences/produce AR apps, I am now an AR educator/evangelist: speaking mainly to general audiences. It is clear that AR is not easily understood. GeoPost will be easy to use, but, for now, the concept will likely be intimidating to many people.
  4. English is not always the first language within the tech community.
  5. I'm a writer: I like using the fewest words to create most results.

So... all comments are welcome, and needed. By the time I give my presentation at ARIA/The MIT Media Lab, I hope to present the following ideas with the input and approval of those who are far more knowledgeable than I am.

Of course , once the following are clear, I hope the information can be shared by anyone, anywhere. I will also include the information in my ebook guide to AR project, which is updated as often as possible.

Thank you for your time and attention to this.

Stephen Black

A slide similar to the one above will be shown in my presentations, as well as one which credits the OARC (and any other organizations or individuals).

Please comment upon the italicized sentence. Thank you.

THANKS!

onwARd!

SB

STEPHEN BLACK: WHO IS HE AND WHAT IS HE DOING IN NYC?

I will be presenting at VIEW in Turin in October!

My talk about AR and Autonomous Vehicles, in January 2020.

Bio from the ARIA/Augmented Reality Leadership Summit at the MIT Media Lab, February 12.

The video below is explained here.

Bubiko + Tranzient test: Mocap, music and VR!

December 23: new article on the AIXR website.

February 12: ARIA @MIT details to follow

SB reading Volumetric Scan by Harleigh Shaw @ Scandy

I am definitely attending the Volumetric Filmmakers NYC Meetup on December 12.

I am also hoping to meet media companies, content producers, musicians, visual artists and anyone involved with AR, VR and volumetric filmmaking.

Interview with TIVA at the Video Show

(This post was originally created for the The Video Show in Washington DC, where the interview was recorded.)

As part of the Video Show fun, this unusual ebook guide to AR was on sale!

Although, in my presentations, I mention companies, no one is paying me to have their product or service mentioned. I am thrilled to say that Novaby is helping me with Bubiko, and that I have spent a little quality time with Tranzient and Scandy (listed below), but other than that, I am just sharing info gathered online and at trade shows/events.

SB at ARIA, MIT 2019
Bubiko Foodtour amongst the pumpkins in one of the London WeWork offices.

Stephen Black is a consultant/creative director/ bestselling writer/director/producer (Fox, Cartoon Network, CNN, Fuji TV) who’s spoken about AR at MIT, Hong Kong PolyU, TechCrunch Shenzhen, PARIS (Paris Augmented Reality Influencers Show) and the Open Augmented Reality Cloud Symposium (Munich). Beach Road, his VR (360 video) movie was featured at VR festivals in Singapore, Las Vegas and Brisbane. 

360 films
Stephen Black, in the Beach Road, the VR(360 video) film he co-produced with Hiverlab

Also an established visual artist, he has exhibited at art spaces worldwide, including the Singapore Biennale (with Michael Lee), Image Forum Experimental Film and Video Festival (Tokyo), and numerous venues in the legendary art scene of the Rivington School/Lower East Side of New York City.

Office Orchitect by Michael Lee, text by Stephen Black

With Sayuri Okayama, Stephen created Bubiko Foodtour, an AR character who will soon be featured in an app. Bubiko has written a guide to AR, as well as collaborated with: the Tranzient VR electronic music-making software, an AR portal experiment with Green Bean Boy/Hummingbirdsday Studio. Upcoming: collaborations with Six Cats Studio, David Severn, Secret Donut World and NUG TOTH (Natchez)

The 3D version of Bubiko, and her rigging, are by Novaby. Bubiko's 3D AR debut was at Tech in the Tenderloin, generously supported by Niantic.

Bubiko at the Pierogi Fest in Whiting, Indiana.

Stephen is available for creating AR/VR/traditional video content  as well as consulting, creative direction and public speaking opportunities. His latest book, Bubiko Foodtour’s Ununusual Guide to Augmented Reality (reviewed here) is available on Amazon.

PRO TIPS/NEWS STORIES

Geopose. As URL is to the internet, geopose is to AR. Interested? This blog post is a must.

Geopose and GPS virtual sculpture (1st location: Paris) now in production by Vincent Trastour (Flamingo Studios/PARIS event) and Stephen Black.

Scandy: A revolutionary way to create 3D scans with iOS. https://www.scandy.co/


Neilson Gamble's experiment with volumetric video, Aframe, hoxel and the Oculus Quest.

Novaby: 3D model makers experienced with AR, gamemaking and more: https://www.novaby.com/ The CEO of Novaby, Julia Beabout is also heading cutting edge AR/social projects: 

https://www.youtube.com/watch?v=Tww8aGYV99s

A talk about the amazing Blackhawk Jazz club AR project San Francisco. And soon Julia will be sharing info about her Seattle AR project.

Tech in the Tenderloin is another project Julia is involved with. (So was Bubiko!)

Tranzient: Electronic Musicmaking in VR: http://www.blacksteps.tv/bubiko-meets-tranzient-1-0/ 

https://www.aliveintech.com/

Bubiko Foodtour’s Unusual Guide to Augmented Reality, reviewed on AR Post: https://arpost.co/2019/10/22/bubiko-foodtours-unusual-guide-to-augmented-reality-approachable-introduction-ar-technology/

How augmented reality is being used in weather reporting | ZDNet https://www.zdnet.com/video/how-augmented-reality-is-being-used-in-weather-reporting/

Questions? Use the comment section. Thanks! Looking forward to meeting you!

PS Ask me about the AR Coffee Network!




What is Geopose?

This is the first of three parts. Part two is here.

There is no definition for 'geopose' on Wikipedia.

This post is an attempt to create a simple definition for the word.

In Bubiko Foodtour's Unusual Guide to Augmented Reality, 'geopose' is defined as:  A word that, now, “kind of means” a shared frame of reference signifying the unique positions and orientations of digital OR physical objects in real OR virtual spaces

The Open Augmented Reality Cloud is focused on, among other things, creating a definition upon which everyone agrees upon and can use. See also: anchor, Open Augmented Reality Cloud

The following is from a Github Post started by blairmckintyre.

(I just discovered his blog: https://blairmacintyre.me/ Wow!)

Mr. McKintyre wrote:

What will the relationship between WebXR and geospatial data be?

It seems that WebXR cannot entirely ignore geospatial positioning, as geospatial content will be a major use case for mobile AR (at least eventually).

The web already has a geolocation API, but it is not sufficient for these purposes: it gives position but not orientation, is of very poor quality and not synchronized with the WebXR frame data. The deviceorientation API cannot be relied on for orientation: it is of very poor quality, was never standardizes (and is potentially going to be removed from existing browsers) and is also not synchronized with the WebXR frame data.

ARKit offers the option to have it's local coordinate system be aligned with geospatial orientation (e.g., Y up, Z south, X east). This provides a possible direction for how geospatial might be handled: have the WebXR API expose a property that says if the coordinate frame can be aligned with geospatial EUS coordinates, and provide a way for the developer to request this. Crude/simple geospatial positional alignment (between the user and the local coordinates) is easier, if you are guaranteed to have the local device coordinates aligned with EUS: each time a geospatial value is received from the local coordinates, an estimate of the geospatial location of the origin of the local coordinate frame can be updated (based on error values, etc). It won't be any better than the error of the geolocation API, but can be stable (because the local coordinates are used for locating and rendering content, not the very-slowly-changing geolocation values).

Hi I am the founder of the https://open-arcloud.org/ . The TL DR AR-cloud description is a 1:1 digital map/twin of the physical world stored in the cloud that enables a shared programmable space attached directly to our physical suroundings that enables multiuser AR and persistent and universally consistent placement of virtual assets in the real worldOne of the things we hope can help bring this to reality is a standard definition of geographical position and orientation that can be understood across platforms and applications. What we call "GeoPose". Each AR-goggle, AR-smartphone or AR-content could have a GeoPose at any given moment.Obtaining GeoPose of an XR-device could be achieved by matching sensor data from the device with the 1:1 map in the cloud through something like a "GeoPose" cloud service. Once the device has its GeoPose it can display geospatial data and assets that are anchored to a GeoPose.A bit more about that here:
https://open-arcloud.org/standardsplease join our slack channel and chime in on how you think a GeoPose should be defined.
https://join.slack.com/t/open-arcloud/shared_invite/enQtMzE4MTc0MTY2NjYwLWIyN2E4YmYxOTA4MWNkZmI5OGQ4Mjg2MGYzNTc4OTRkN2RjZGUxOTc4YjJhOTQ0Nzc3OWMxYTA3ZDMxNGEzMGEMy hope of course is that WebXR will support using device GeoPose and do the proper transforms for assets that are ancored to GeoPoses or assets that are described by geospatial coordinates.

...............................................................

A bit of a bumbling attempt at describing geopose. The source materials are from a Powerpoint presentation on AV +AR, held at the Collider in Detroit in July 2019. The presentation is here.

The following is from a free PDF download entitled:

TITLE: Geopose Standards Working Group Charter [OGC 19-028]

Author Name (s): Jan-Erik Vinje, Christine Perey, Scott Simmons

Email: jan-erik.vinje@norkart.no

DATE: 2019-05-17

CATEGORY: SWG Charter Template

All physical world objects inherently have a geographically-anchored pose. Unfortunately, there is not a standard for universally expressing the pose in a manner which can be interpreted and used by modern computing platforms. The main purpose of this SWG will be to develop and propose a standard for geographically-anchored pose (geopose) with 6 degrees of freedom referenced to one or more standardized Coordinate Reference Systems (CRSs).

Definition of geopose

A real object in space can have three components of translation – up and down (z), left and right (x) and forward and backward (y) and three components of rotation – Pitch, Roll and Yaw. Hence the real object has six degrees of freedom.

The combination of position and orientation with 6 degrees of freedom of objects in computer graphics and robotics are usually referred to as the object’s “pose.” Pose can be expressed as being in relation to other objects and/or to the user. When a pose is defined relative to a geographical frame of reference or coordinate system, it will be called a geographically-anchored pose, or geopose for short.

Uses for geopose

An object with geopose may be any real physical object. This includes object such as an AR display device (proxy for a user’s eyes), vehicle, robot, or a park bench. It may also be a digital object like a BIM model, a computer game asset, the origin and orientation of the local coordinate system of an AR device, or a point-cloud dataset.

When the geopose of both real and virtual objects include the current position and orientation of the objects in a way that is universally understood, the interactions between the objects and an object and its location can be put to many uses. It is also important to note that many objects move with respect to a common frame of reference (and one another). Their positions and orientations can vary over time.

The ability to specify the geopose of any object enables us to represent any object in a universally agreed upon way for real world 3D spatial computing systems, such as those under development for autonomous vehicles or those used by augmented reality (AR) or 3D map solutions. In addition, the pose of any object can be encoded consistently in a digital representation of the physical world or any part therein (i.e., digital twin).

The proposed standard will provide an interoperable way to seamlessly express, record, and share the geopose of objects in an entirely consistent manner across different applications, users, devices, services, and platforms which adopt the standard or are able to translate/exchange the geopose into another CRS.

One example of the benefit of a universally consistent geopose is in a traffic situation. The same real-time geopose of a vehicle could be shared and displayed in different systems including:

Open Geospatial Consortium

Geopose SWG Charter Page 2

OGC 19-028r1

- a traffic visualization on a screen in another car,

- shown directly at its physical location in the AR glasses of a pedestrian that is around the corner for the car, or

- in the real time world model used by a delivery robot to help it navigate the world autonomously.

........................................................................................................................

argon.js documentation

This site contains documentation for web developers using Design Tools to add AR content to a web application.

Argon-aframe — Lesson 7: Geolocation

Key features of augmented reality include 1. the ability of associating data objects with places in the world and 2. displaying those objects at those places.

The <ar-geopose> primitive is Argon-aframe’s way of locating objects in physical space (of the planet). The <ar-geopose> primitive creates an entity with a referenceframe component. This component defines the position and/or rotation of the entity by an LLA (longitude, latitude, altitude), so you can locate your object anywhere on the earth relatively accurately by using this tag.

You can find the longitude and latitude through Google Maps or through a variety of mobile applications. Some apps will also give your the altitude of a location.
.........................................................................................................................................

The Open Augmented Reality Cloud glossary does not have a definition for 'geopose' as of September 19, 2019.

  1. Geo Spatial Pose: [ please define ]
  2. Pose: [please define ]
  3. Position: [please define]

It does, however, have the following post:

Reference Implementations for Conversion Between Geopose and Cartesian Coordinate Systems

There will be a need throughout many parts of the technological ecosystem to convert object poses between a geospatial coordinate-system and local ones (typically the Cartesian x,y,z in metric as used in most AR SDKs). This repository is the first step to create reference libraries in different programming languages, available for everyone to use for free.

Contributions are welcome.

  • © 2019 G
Geopose: take 2. Comments greatly appreciated, as I will redo the visuals used in the presentation and improve my speaking skills. Hopefully , anyway.

The Greatest AR Tour in History!

Would you like to support THE GREATEST AR TOUR IN HISTORY? Do you want to learn the latest news from AWE, Austin, Japan, Detroit, Turin, Munich, Shenzhen and Japan!?

Austin, London, Berlin, Munich, Paris, Shenzhen, Tokyo...full tour info at the bottom of this post. http://www.blacksteps.tv/blam-bubiko-foodtour-on-the-road/
(Photographer: Marcha Farley)

Stephen Black and Bubiko Foodtour are about to go global: learning, educating and networking at some of the biggest AR events in the world. We just need a little financial fuel...we are movin’ and groovin, but our app isn’t out yet! Startup blues!

Not a good time to help fund the excitement? We definitely understand, but why not follow this blog where you can read, and comment upon, informative articles like this: http://www.blacksteps.tv/towards-an-understanding-of-ar-cinema-possibilities/

Stephen Black and Bubiko at ARIA, MIT

You’ve got a little extra cash, and want to help? Thank you! PM me, tell me what you do or about your product, or what Bubiko and I can do to help you in anyway.

You're looking for an evangelist? Get in touch so our enthusiastic team can immediately start learning about you and planning to get the word out!

No one paid for this; it's just an example of how excited we get. It was prepared for a presentation at Hong Kong PolyU.

Your company wants to sponsor the greatest AR tour in history? Step right this way!

Bloggers, podcasters, media people... have we got unique and informative stories for you! Happy to share our information-packed adventures with your audience. Here's a sample story about Shenzhen.

Sayuri Okayama, co-creator of Bubiko Foodtour at a hackathon at MIT sponsored by Magic Leap.

Oh! Bubiko wrote an unusual and very informative book about AR: https://www.amazon.com/dp/B07WQTT22Z Buy one of these, learn a lot and help the tour!

Thanks for reading this far and any positive thoughts that you can provide. Stephen Black and Bubiko Foodtour

Get behind it before it gets past you
Now on tour... Bubiko, Eggy, Ollie and Obasan A! R! Let's go!(Lemme know if you want one of these shirts!)

Austin Startup Week: September 22-25 attendee

London: presentations date to be determined

Berlin: Meetup October 15

Amsterdam: dates to be determined

Munich: presentation at Open Augmented Reality Cloud Symposium Oct 16

Munich: attending AWE October 17/18

Turin attending View October 21-24

Paris: presenting at PARIS October 25

Detroit: Date to be determined. An update of the AR+AV presentation at Collider

2020

MIT Attending ARIA, where Stephen Black presented this year

SXSW2020 Attending, Sayuri Okayama and Stephen Black are possibly presenting:  SB Proposal SO Proposal 

Shenzhen, China: March presenting at Trouble Maker      my article about Shenzhen

Singapore: Biennale November 22, 2019, through March 22, 2020

Shenzhen: March 28/29 attending AWE China

Tokyo: April Tama Art University

Ashiya, Japan: April date to be determined

This post has more tour-related info.


Detroit: Traffic Studies

As I become more involved AR's potential impact upon traffic, I see roads, vehicles, pedestrians and bicycles differently. The following documentary photographs are study aids; barely related to my previous street photography projects, such as the Bus Stopping series.

There is also a study of San Francisco here.

A terrible photograph, but a great example of the realities of the street. Glare attacks everyone. If there were a dependency upon a device displaying crucial information, what would happen in this situation?
Waze and other apps provide the latest info on detours, construction , travel times and more. With Waze, the data is crowdsourced. What relationships will be formed between these kinds of apps and autonomous vehicles?
The overall picture of bicycle parking in Detroit: what does it look like?
Ebike parking?
What is the future of the parking lot?
Detroit's original layout.
Dashboard of one of May's autonomous vehicles.
One of May's AVs moving out into traffic.
For nearly one hundred years, Detroit has created our perception of what a car is. Let's see what happens next...

I will be making a presentation about Augmented Reality and Autonomous Vehicles at Altimetrik, on August 8, 2019.

There are a number of posts about AR and bicycling here.

These photographs were taken during Detroit Startup Week.

Bubiko in Lawnspace screen test

Bubiko's guide to AR is now available on Amazon!

Bubiko: what is a stage?

The goal is to prepare for the possibilities of AR cinema.

This post documents a simple test. The Bubiko model used for the Tech in the Tenderloin event was used. Two locations: a garage and an open piece of land. The objective: to gain an understanding of what a “stage” can be in AR. AR is a new medium; to use the established techniques of theatre, television and movie is to fail to grasp the uniqueness of AR. Performance art and dance provide clues.

Notes: Spark used

  • Occlusion not a concern at this time
  • Ambient light a constant
  • Size and scaling of Bubiko purposely varied

Bubiko was created by Stephen Black and Sayuri Okayama

  • iPad used; no manual controls nor color correction
This is Bubiko Foodtour, still with the balloons and banner she used for her debut in San Francisco, at Tech in the Tenderloin’s 2019 TNT Tech Fest,  Bubiko is a work in progress, this is not her final version.
Bubiko is a 3D model made by Novaby, based on ideas by Stephen Black and Sayuri Okayama.
These images are a screen test of sorts, a way of documenting the possibilities and challenges of AR cinematography.
AR cinematography is one of my AR goals, especially making content for autonomous vehicles.
In these images. Bubiko was positioned near the white log. Only the camera (an iPad) moved. The software used was Spark. It was stable, except when used at long distances, in which case Bubiko appeared some distance away from the post.
The camera automatically controlled exposure. The light was even, the time being late afternoon/early twilight.
Occlusion was not important in this test, but I would love to use a software like 6D for testing.
Again, Bubiko did not move, but her size was changed in camera. AR cinema reminds me of machinima. There is another test of Bubiko HERE.
The format of the screen size is both an opportunity and a challenge.
Bubiko Foodtour models for some AR camera tests.
Interesting that the same model can have the size of a mouse, or a giant, or anything in between. Size in AR was the topic of this blog post. Thanks again to Fabian Winkler.
Bubiko is actually closer to the stump than this image suggests.
Sparks had some difficulty as I moved away from Bubiko's position. For this experiment it was simply an interesting development. If this were actually part of an movie shoot, I would reposition her, or do testing. It should be noted that wifi was not needed to create these images.

Arbicles

A list of all of my AR+bike blog posts is here.

The future of AR in the world of bicycling
A chart depicting the hypothetical uses of augmented reality in the world of bicycling.

ARBICLE- A piece of bicycle equipment, with partial or total augmented reality functionality. A bicycle light with some AR functions is an arbicle. A device which acts as a "AR computer", exclusively managing AR functions for the bike, traffic and rider is also an arbicle.

The word "arbicle" was coined by Stephen Black in 2019, in response to a perceived need for AR-compatible bicycle gear.Stephen Black is a writer, a visual artist and an AR/VR producer.

The chart above is a hypothetical overview and no such network or devices now exist. LIDAR is used an example of a traffic monitoring system. In reality, LIDAR is heavy, delicate and extremely expensive. Unlike autonomous vehicles, bicycles must have an attentive human steering and braking. Thus,LIDAR would be unnecessary. However. sensors detecting objects within a range of 50 feet around the bike would be advantageous. An arbicle featuring a rear view camera with a feed into the visor or smartglasses is an obvious need. ARbicles specializing in emergencies would be another obvious need.

This chart is a result of research and thought related to the book I am working on about AR and traffic safety, focusing on bicycles. The working title is AR on Wheels.

I will be making a presentation about AR at the Great Ohio Bicycle Adventure, in Port Clinton, on June 18. I

Also, if you are near San Francisco's Tenderloin District on June 28th, you are warmly invited to the world premier of Bubiko Foodtour!

Bubiko will be at the Novaby booth at the Tech in the Tenderloin Fair! her app will not be on dispaly, as we haven't made it yet, but Bubiko will be hosting an interactive event that is sure to be a crowdpleaser.

Grudge match: Bubiko Foodtour vs. Jackie Chan
Grudge match

ARphabet Tour: Indiegogo Introductory video notes

All of the sections of the ARphabet Tour are explained here.

Notes for the video introducing the ARphabet Tour on Indiegogo.

Location: Boulevard of Houqian Bei

Stephen Black standing in the heart of China's Silicon Valley, holding the 2018 laminated pamphlet of Bubiko Orwell Tour highlights.

Like this test: https://youtu.be/fM2Z6kr7mAs

Points to cover:

  • 2002: After years of working in art, photography and network TV (Cartoon Network, Fuji TV, Fox, CNN+) became creative director at 3D gamemaking company, WalkerAsia
  • Walker/Asia was also doing something like Youtube, three years before Youtube.
  • CEO's unexpected demise results in non-action, despite great interest by Singapore Ministry of Education, Singapore Science Center, publishers in Hong Kong and universities in Japan.
  • SB, son of a book salesman, decides to write books and wait for VR/AR/spatial computing to become mainstream. Inspirations: his father, a book salesman and the release of the Kindle, Amazon's pioneering ebook reader.

  • Visa complications result in what will become the Bubiko Orwell Tour of Southeast Asia. SB pivots from VR to AR.
  • AR cinema becomes the focus, starring the following characters: the Dundercats (collaboration with Six Cat Studio), Secret Donut World (collaboration with David Severn) and Bubiko Foodtour.
  • AR presentations/workshops at Hong Kong PolyU, a presentation at Le Wagon and pitches to VCs at TechCrunch.
  • An invitation to participate in ARIA at MIT  becomes the inspiration for the ARphabet Tour. Debuting at ARIA will be an ARKIT/Unity collaboration with Dominique Wu/Hummingbirdsday Studios, a game featuring Green Bean Boy and co-starring Bubiko Foodtour.
  • The ARphabet Tour will also be a platform for Stephen Black to do readings and writing workshops.
  • The ARphabet Tour also aims to educate people about mango sticky rice, Bubiko's favorite food.
  • Separate from this, briefly mention the unicorn concept which has a high degree of success regardless of the global economy or 5G take-up.

All of the sections of the ARphabet Tour are explained here.

Presentations and workshops by Stephen Black at HK PolyU.