Category Archives: Stephen Black

PARIS/London AR Meetup @ Microsoft Reactor

This post provides notes on the above Powerpoint. The actual presentation elaborated on the points much more than I do here. Please feel free to ask questions. Also, as always I recommend joining the Open Augmented Reality Cloud. They are working to create open, interoperable standards to encourage the growth, use and understanding of AR.

And yes, another resource is Bubiko Foodtour's Unusual Guide to Augmented Reality, which is reviewed here.

  1. The following presentation uses references from the State of the AR Cloud Report published May 28, 2019 by the Open AR Cloud. All rights reserved. http://stateofthearcloud.com/ With the exception of Novaby, the 3D model making company, I have no relationships with any companies mentioned in this presentation. This research has been self-funded.

2. Stephen Black PARIS + London AR Meetup

  • SB introduction
  • Bubiko Foodtour introduction
  • Geopose

3. Nissan video/ question of geopose https://mashable.com/article/nissan-ar-virtual-reality- windshield-display/

The above link exemplifies a lot of the ideas about the future of AR in general, as well as about the potential applications of AR and AV, Autonomous Vehicles.The entire article is good, but the embedded video is excellent.

4. GEOPOSE

The photos were done as a spur of the moment test. I have done another version, featuring a 1947 Rolls Royce!

The point to be made here is that the model, Bubiko , was placed on the road ahead of the vehicle.the car, then "drove through" Bubiko, and she remained on the road behind us.

This gives us something to think about in terms of creating permanent AR experiences using geoposts.

5. Microsoft Azure Website

An example of how one company illustrates their version of the entirety of AR.

6. from a SlideShare presentation by Sergii Kozyrev

Another illustration of how the entire AR world will look like, this time based on Android.

7. OARC From State of the AR Cloud Report 2019

I cannot recommend the work of the OARC highly enough. Visit their site for the download of the first OARC Symposium Report.

8.  www.blacksteps.tv At least three posts about 'geopose'

Yes, on this blog, I presently have a few posts about 'geopose'.

9. From correspondence with Jan-Erik Vinje, Managing Director of Open Augmented Reality Cloud:

If we are successful in creating such a standard we will in effect have created the equivalent of the URL for real world spatial computing. Allowing the geopose of both real and virtual objects to be universally captured, stored, shared and understood.

This comment by Jan-Erik, and those that follow, are self-explanatory. However, one week ago, at the second OARC Symposium, the definition of 'geopost' was greatly discussed. In fact, the goal of the OARC for the next year is to fcus upon creating a final definition of 'geopost', and to work towards a working model.

10. ○ I liken it to URL because it can be seen as links between the physical world with the digital world. ○ URL links information to more information. Geopose links the world to digital information and digital information to the world.

11. ● It can even be used to create a "persistent portal" between a physical space and a virtual space. Where people from across the world who are experiencing a virtual space can go through such a portal to experience a real space (by streaming realtime reality capture data to all those in the virtual reality space).

12. ● At the same time people in the real world can walk into the virtual reality space or see virtual objects, scenes and avatars of virtual reality users projected into their physical space using AR.

13. Geopost is to AR as URL is to the internet.

14. To create a GEOPOSE 1.Physical space owner 2. AR data/ SLAM spatial location and mapping 3. AR Cloud space 4. End user(s)

This slide features a photo of the Fox Theatre in Detroit. The front of the theatre is copyrighted. Anyway planning to use the front of the Fox would need to obtain permission to do so.

This situation would be true for many buildings, copyrighted or not.

15. How to find the location? (the need for interoperability): Google maps Mapillary Military maps LADOT ebike monitoring maps(eg) Satellite-based maps monitoring floods, snow, ice, fire, crowds etc. City/State/Federal maps Company owned routing maps Bus routes Ride sharing maps Superworld Emergency routes Bike lanes Construction Traffic signals

The companies and organizations listed above would all benefit from an open AR Cloud. A comparison is sometimes made, comparing the present state of the AR Cloud with the early nonstandardized gauges of railroad tracks. Once the railroad tracks became standardized, society benefited.

Once there are interoperable standards for the AR Cloud, groups like those listed above will benefit, as will education, medicine, science and, all of society/

16. https://techcrunch.com/2017/10/08/jeff-koons-augmented-reality-snapchat-artwork-gets-vandalized Jeff Koons/Snapchat

This article shows an instance in which a geopost by Instagram was used by an artist to promote discussion about AR artin public spaces.

17. Geopose and GPS AR sculpture now being planned with Vincent Trastour/Flamingo Filters and others.

Stay tuned!

18. Bubiko and SB are always open to cross-promotions, collaborations, and exchanges!

Art, business or fun, get in touch!

19. Stephen Black LinkedIn, Facebook, twitter Bubiko Foodtour Instagram, Facebook, twitter bubikoworldtour@gmail.com

20. Thank You

(An Easter egg! If you keep clicking you will see my presentation abut AR and Autonomous vehicles.)

What is Geopose?

This is the first of three parts. Part two is here.

There is no definition for 'geopose' on Wikipedia.

This post is an attempt to create a simple definition for the word.

In Bubiko Foodtour's Unusual Guide to Augmented Reality, 'geopose' is defined as:  A word that, now, “kind of means” a shared frame of reference signifying the unique positions and orientations of digital OR physical objects in real OR virtual spaces

The Open Augmented Reality Cloud is focused on, among other things, creating a definition upon which everyone agrees upon and can use. See also: anchor, Open Augmented Reality Cloud

The following is from a Github Post started by blairmckintyre.

(I just discovered his blog: https://blairmacintyre.me/ Wow!)

Mr. McKintyre wrote:

What will the relationship between WebXR and geospatial data be?

It seems that WebXR cannot entirely ignore geospatial positioning, as geospatial content will be a major use case for mobile AR (at least eventually).

The web already has a geolocation API, but it is not sufficient for these purposes: it gives position but not orientation, is of very poor quality and not synchronized with the WebXR frame data. The deviceorientation API cannot be relied on for orientation: it is of very poor quality, was never standardizes (and is potentially going to be removed from existing browsers) and is also not synchronized with the WebXR frame data.

ARKit offers the option to have it's local coordinate system be aligned with geospatial orientation (e.g., Y up, Z south, X east). This provides a possible direction for how geospatial might be handled: have the WebXR API expose a property that says if the coordinate frame can be aligned with geospatial EUS coordinates, and provide a way for the developer to request this. Crude/simple geospatial positional alignment (between the user and the local coordinates) is easier, if you are guaranteed to have the local device coordinates aligned with EUS: each time a geospatial value is received from the local coordinates, an estimate of the geospatial location of the origin of the local coordinate frame can be updated (based on error values, etc). It won't be any better than the error of the geolocation API, but can be stable (because the local coordinates are used for locating and rendering content, not the very-slowly-changing geolocation values).

Hi I am the founder of the https://open-arcloud.org/ . The TL DR AR-cloud description is a 1:1 digital map/twin of the physical world stored in the cloud that enables a shared programmable space attached directly to our physical suroundings that enables multiuser AR and persistent and universally consistent placement of virtual assets in the real worldOne of the things we hope can help bring this to reality is a standard definition of geographical position and orientation that can be understood across platforms and applications. What we call "GeoPose". Each AR-goggle, AR-smartphone or AR-content could have a GeoPose at any given moment.Obtaining GeoPose of an XR-device could be achieved by matching sensor data from the device with the 1:1 map in the cloud through something like a "GeoPose" cloud service. Once the device has its GeoPose it can display geospatial data and assets that are anchored to a GeoPose.A bit more about that here:
https://open-arcloud.org/standardsplease join our slack channel and chime in on how you think a GeoPose should be defined.
https://join.slack.com/t/open-arcloud/shared_invite/enQtMzE4MTc0MTY2NjYwLWIyN2E4YmYxOTA4MWNkZmI5OGQ4Mjg2MGYzNTc4OTRkN2RjZGUxOTc4YjJhOTQ0Nzc3OWMxYTA3ZDMxNGEzMGEMy hope of course is that WebXR will support using device GeoPose and do the proper transforms for assets that are ancored to GeoPoses or assets that are described by geospatial coordinates.

...............................................................

A bit of a bumbling attempt at describing geopose. The source materials are from a Powerpoint presentation on AV +AR, held at the Collider in Detroit in July 2019. The presentation is here.

The following is from a free PDF download entitled:

TITLE: Geopose Standards Working Group Charter [OGC 19-028]

Author Name (s): Jan-Erik Vinje, Christine Perey, Scott Simmons

Email: jan-erik.vinje@norkart.no

DATE: 2019-05-17

CATEGORY: SWG Charter Template

All physical world objects inherently have a geographically-anchored pose. Unfortunately, there is not a standard for universally expressing the pose in a manner which can be interpreted and used by modern computing platforms. The main purpose of this SWG will be to develop and propose a standard for geographically-anchored pose (geopose) with 6 degrees of freedom referenced to one or more standardized Coordinate Reference Systems (CRSs).

Definition of geopose

A real object in space can have three components of translation – up and down (z), left and right (x) and forward and backward (y) and three components of rotation – Pitch, Roll and Yaw. Hence the real object has six degrees of freedom.

The combination of position and orientation with 6 degrees of freedom of objects in computer graphics and robotics are usually referred to as the object’s “pose.” Pose can be expressed as being in relation to other objects and/or to the user. When a pose is defined relative to a geographical frame of reference or coordinate system, it will be called a geographically-anchored pose, or geopose for short.

Uses for geopose

An object with geopose may be any real physical object. This includes object such as an AR display device (proxy for a user’s eyes), vehicle, robot, or a park bench. It may also be a digital object like a BIM model, a computer game asset, the origin and orientation of the local coordinate system of an AR device, or a point-cloud dataset.

When the geopose of both real and virtual objects include the current position and orientation of the objects in a way that is universally understood, the interactions between the objects and an object and its location can be put to many uses. It is also important to note that many objects move with respect to a common frame of reference (and one another). Their positions and orientations can vary over time.

The ability to specify the geopose of any object enables us to represent any object in a universally agreed upon way for real world 3D spatial computing systems, such as those under development for autonomous vehicles or those used by augmented reality (AR) or 3D map solutions. In addition, the pose of any object can be encoded consistently in a digital representation of the physical world or any part therein (i.e., digital twin).

The proposed standard will provide an interoperable way to seamlessly express, record, and share the geopose of objects in an entirely consistent manner across different applications, users, devices, services, and platforms which adopt the standard or are able to translate/exchange the geopose into another CRS.

One example of the benefit of a universally consistent geopose is in a traffic situation. The same real-time geopose of a vehicle could be shared and displayed in different systems including:

Open Geospatial Consortium

Geopose SWG Charter Page 2

OGC 19-028r1

- a traffic visualization on a screen in another car,

- shown directly at its physical location in the AR glasses of a pedestrian that is around the corner for the car, or

- in the real time world model used by a delivery robot to help it navigate the world autonomously.

........................................................................................................................

argon.js documentation

This site contains documentation for web developers using Design Tools to add AR content to a web application.

Argon-aframe — Lesson 7: Geolocation

Key features of augmented reality include 1. the ability of associating data objects with places in the world and 2. displaying those objects at those places.

The <ar-geopose> primitive is Argon-aframe’s way of locating objects in physical space (of the planet). The <ar-geopose> primitive creates an entity with a referenceframe component. This component defines the position and/or rotation of the entity by an LLA (longitude, latitude, altitude), so you can locate your object anywhere on the earth relatively accurately by using this tag.

You can find the longitude and latitude through Google Maps or through a variety of mobile applications. Some apps will also give your the altitude of a location.
.........................................................................................................................................

The Open Augmented Reality Cloud glossary does not have a definition for 'geopose' as of September 19, 2019.

  1. Geo Spatial Pose: [ please define ]
  2. Pose: [please define ]
  3. Position: [please define]

It does, however, have the following post:

Reference Implementations for Conversion Between Geopose and Cartesian Coordinate Systems

There will be a need throughout many parts of the technological ecosystem to convert object poses between a geospatial coordinate-system and local ones (typically the Cartesian x,y,z in metric as used in most AR SDKs). This repository is the first step to create reference libraries in different programming languages, available for everyone to use for free.

Contributions are welcome.

  • © 2019 G
Geopose: take 2. Comments greatly appreciated, as I will redo the visuals used in the presentation and improve my speaking skills. Hopefully , anyway.

The Greatest AR Tour in History!

Would you like to support THE GREATEST AR TOUR IN HISTORY? Do you want to learn the latest news from AWE, Austin, Japan, Detroit, Turin, Munich, Shenzhen and Japan!?

Austin, London, Berlin, Munich, Paris, Shenzhen, Tokyo...full tour info at the bottom of this post. http://www.blacksteps.tv/blam-bubiko-foodtour-on-the-road/
(Photographer: Marcha Farley)

Stephen Black and Bubiko Foodtour are about to go global: learning, educating and networking at some of the biggest AR events in the world. We just need a little financial fuel...we are movin’ and groovin, but our app isn’t out yet! Startup blues!

Not a good time to help fund the excitement? We definitely understand, but why not follow this blog where you can read, and comment upon, informative articles like this: http://www.blacksteps.tv/towards-an-understanding-of-ar-cinema-possibilities/

Stephen Black and Bubiko at ARIA, MIT

You’ve got a little extra cash, and want to help? Thank you! PM me, tell me what you do or about your product, or what Bubiko and I can do to help you in anyway.

You're looking for an evangelist? Get in touch so our enthusiastic team can immediately start learning about you and planning to get the word out!

No one paid for this; it's just an example of how excited we get. It was prepared for a presentation at Hong Kong PolyU.

Your company wants to sponsor the greatest AR tour in history? Step right this way!

Bloggers, podcasters, media people... have we got unique and informative stories for you! Happy to share our information-packed adventures with your audience. Here's a sample story about Shenzhen.

Sayuri Okayama, co-creator of Bubiko Foodtour at a hackathon at MIT sponsored by Magic Leap.

Oh! Bubiko wrote an unusual and very informative book about AR: https://www.amazon.com/dp/B07WQTT22Z Buy one of these, learn a lot and help the tour!

Thanks for reading this far and any positive thoughts that you can provide. Stephen Black and Bubiko Foodtour

Get behind it before it gets past you
Now on tour... Bubiko, Eggy, Ollie and Obasan A! R! Let's go!(Lemme know if you want one of these shirts!)

Austin Startup Week: September 22-25 attendee

London: presentations date to be determined

Berlin: Meetup October 15

Amsterdam: dates to be determined

Munich: presentation at Open Augmented Reality Cloud Symposium Oct 16

Munich: attending AWE October 17/18

Turin attending View October 21-24

Paris: presenting at PARIS October 25

Detroit: Date to be determined. An update of the AR+AV presentation at Collider

2020

MIT Attending ARIA, where Stephen Black presented this year

SXSW2020 Attending, Sayuri Okayama and Stephen Black are possibly presenting:  SB Proposal SO Proposal 

Shenzhen, China: March presenting at Trouble Maker      my article about Shenzhen

Singapore: Biennale November 22, 2019, through March 22, 2020

Shenzhen: March 28/29 attending AWE China

Tokyo: April Tama Art University

Ashiya, Japan: April date to be determined

This post has more tour-related info.


What is Augmented Reality?

The following video is a rehearsal. The starting point is a presentation I did in Detroit in July 2019. That presentation was about Autonomous Vehicles and Augmented Reality. Eventually I will have about eight videos based on that Detroit presentation. You can find the Powerpoint for that here.

It will be obvious that I am not the smoothest person to ever be on a stage. I am a photographer, a cinematographer, an artist and a writer. I am used to having time to think about what I am expressing. As I will soon be making presentations in Europe, I am trying to get through the learning curve of being onstage, asap.

In this presentation, I often refer to the Open Augmented Reality Cloud. If you are serious about AR, you must learn about their work, and download the free State of the Augmented Reality Cloud Report which is available on their website. (I am honored and humbled to say that I will be speaking about Bubiko at the OARC Symposium in Munich on October 16!)

The ARShow produced this informative podcast with Jan-Erik Vinje, Christine Perey, Jason Fox and Colin Steinman, the key cotributors to the OARC

Thank you for any suggestions. And your patience!

Oh yes... Bubiko's Unusual Guide to Augmented Reality is now available on Amazon.

Yes, the lighting is not great. This is a rehearsal, albeit an informative one.

BLAM ! Bubiko Foodtour on the road!

UPDATED: http://www.blacksteps.tv/the-greatest-ar-tour-in-history/

Bubiko's schedule has been changing very rapidly in the past few days. Here is the latest:

Austin Startup Week: September 22-25 attendee

London: presentations date to be determined

Berlin: presentations date to be determined

Munich: presentation at Open Augmented Reality Cloud Symposium Oct 16

Munich: attending AWE October 17/18

Turin attending View October 21-24

Paris: presenting at PARIS October 25

2020

MIT Attending ARIA, where I presented this year

SXSW2020 Attending, Sayuri Okayama and I are possible presenting:  SB Proposal SO Proposal 

Shenzhen, China: March presenting at Trouble Maker      my article about Shenzhen

Singapore: Biennale November 22, 2019, through March 22, 2020

Shenzhen: March 28/29 attending AWE China

Tokyo: April Tama Art University

Ashiya, Japan: April date to be determined

....................

Bubiko is a little chef who has been having some exciting adventures in AR, Augmented Reality. Bubiko was born at Novaby and made her public debut at Tech in the Tenderloin.

Bubiko, in Detroit, thinking about her pierogi : steamed or fried?

Stephen Black is a writer, a visual artist and marching along the path of Spoken Word.

Ar entrepreneur Stephen Black interview
Kevin Turley, from Mount Bonnell Media, interviewing Stephen Black at SXSW2019. The video is here.

This post is exploratory.

Stephen Black and Bubiko Foodtour are now looking for opportunities to make presentations, or do collaborations with musicians, artists, writers or AR practitioners in these cities.

(BLAM is also a reference to SLAM: Simultaneous Localization And Mapping, a process associated with AR.)

Stephen Black has given presentations at Sasin School of Business, MIT Media Lab, Hong Kong PolyU, TechCrunch Shenzhen and the Collider at Alitimetrik (Detroit). This post is about his projects and this post is about Bubiko's.

What we hope to do, are open to:

  1. Find AR collaborators. Do you have an AR software that could use a cute little chef? (Bubiko has been in Facebook Spark and Facebook Camera projects, as well as an AR game demo made by Dominique Wu from Hummingbirdsday Studios. Two projects using Artive are here and here.
Image from game demo by Dominique Wu and Michael Stragey.
Bubiko's book is available on Amazon.

2. Consultations regarding AR, or projects needing a producer.

3. Meeting with galleries regarding an AR exhibition. Stephen Black curated SPOKEN with pioneering AR artist Eugene Soh.

www.gallery.sg

4. Meetups/ presentations about AR and its relationship with bicycles, Autonomous Vehicles, traffic and more. This presentation has been updated:

Autonomous Vehcles and Augmented Reality from stephen black

5. Readings: topics include Bali, Obama, Furikake, Singapore, Art and more. Fact-based poetic fiction...

a guitarist and a reader onstage
Stephen Black reads from Bali Wave Ghost, accompanied by Rizal Abdulhadi

6. Would be happy to chat with publishers about writing projects, cross-promotion, printing and distribution.

7. Publicity: any contacts with podcasters, bloggers ,newspapers, magazines etc. greatly appreciated.

Augmented Reality in Asia
article about Stephen Black, Sayuri Okayama and Bubiko Foodtour in Ipoh, Malaysia.

Thank you for your time and consideration!

Stephen Black and Bubiko Foodtour

bROADWAY: notes for a citywide AR experience

  • The recent release of citywide 3D mapping technologies allows AR objects to be placed permanently and accurately. Two companies to watch : Scape and 6D.Ai.

With an established background in visual arts, music, the performing arts and AR, I have been waiting for the opportunity to create very large scale AR artworks. Years ago I developed plans for an AR sound artwork for Singapore's Tiong Bahru, an estate composed of historic Art Deco buildings. In 2018, in Shenzhen, a citywide light show rekindled my interest in large scale AR projects.

https://youtu.be/aKbs1beYAJQ

This year, while preparing for a presentation in Detroit, another idea: an Augmented Reality project to be viewed, and experienced, from inside Autonomous Vehicles; bROADWAY

Although the ideas of bROADWAY could work in any city, Detroit is associated with the automobile industry, including AV. Detroit is the home of legends like Motown, Aretha Franklin, Stevie Wonder, the Jacksons, Detroit techno (Juan Atkins, Kevin Saunderson and Derrick May +), Bob Seger, Jack White, Alice Cooper and Iggy Pop. These points, plus distinguished architecture and public spaces, mean there could be no better city for the world’s first AR+AV citywide experience!

AVs as performers!

If anyone in Detroit knows how to make this project happen, please get in touch.

(And, as AVs are becoming more common worldwide, the idea could happen anywhere.)

This post provides more information on AR +AV. The notes about bROADWAY begin with slide 29.


An autonomous vehicle in Detroit, by May.
Detroit!

Stephen Black recently worked with Bubiko Foodtour to create an unusual guide to AR...

Bubiko Foodtour’s Unusual Guide to Augmented Reality

This blog post is a sample of the guide, which is available on Amazon.

the cover

INTRODUCTION

Hi.

Welcome to R3.

This is a response to an urgent need to share information.

 Influences: a. “make it fast, not perfect” 

                    b. wabi-sabi

                    c. ash from chaos 

                    d. Chungking Express 

                    e. The Zone System by Ansel Adams and Minor White

No person or company has paid me to have their name or product included in this document.

I am now notifying the companies and individuals mentioned. If your work is here, and I have not yet contacted you, I apologize. If you prefer that I do not share your work, let me know and  I will remove it immediately.

No one has received a promotional copy. If you have bought this, and we meet, I will buy you a beverage. Or two. If you bought this and it seems unlikely that we will meet, I will send you my other ebooks or find a way to make sure this purchase is something you are very happy with. Hint, hint, Bubiko and I are working on an app. (Many times in the past, I  have given out free ebooks; only to be surprised that people did not even open them; even my bestseller.)

If you use photos or text from this document, please credit accordingly:

Photo by Stephen Black from Bubiko’s Unusual Guide to AR

Text by Stephen Black from  Bubiko’s Unusual Guide to AR

Have a nice day.

onwARd,

Stephen Black

9/3/2019 4th edition

A

Anchor  The three points used to describe the location, in the real world, where an AR object has been placed. The more one understands about 3D geometry, the more one is prepared for AR. See also billboarding, geopost.

AR Cinema  Soon! http://www.blacksteps.tv/towards-an-understanding-of-ar-cinema-possibilities/

Arbicle  Any piece of bicycle equipment with AR capability.

A list of articles and links about AR, arbicles and bicycles: http://www.blacksteps.tv/arbike/

ARCore  The platform used to make apps for Android mobile devices. Released in 2018.

ARKit  Apple released ARKit in 2017; it is the platform used to make apps for iOS mobile devices.

[AR]T https://news.artnet.com/opinion/apple-augmented-reality-art-1624540

Augmented Driving  AR will increase the amount of information available to drivers, thus increasing driving skills and traffic safety, especially when combined with AI.

www.thedrive.com/tech/9548/the-biggest-opportunity-everyone-is-missing-in-self-driving-cars

https://panelpicker.sxsw.com/vote/100430

What Augmented Driving Will Feel Like, a SXSW presentation by Theo Calvin.

Avatar  A digital creation used to represent a person, possibly resembling a human, possibly not.

Augmented Reality  To ‘augment’ means to make something greater; to give it more power. The platform called ‘augmented reality’ is a network that adds digital information to real objects. Machines are needed to do this, and  to see the results. Thus, augmented reality is the real world and the digital information added to it, as well as the machines enabling us to experience both at the same time.See R3

   Digital information could be in the form of a 3D model of a real object made by a computer, like the furniture in AR apps made by Ikea, Wayfair and other companies.  Pokemon Go and Snapchat are other examples of AR. However, the digital information could also be live or pre-recorded video, music, podcasts,medical imagery, industrial blueprints, text information or many other types of content.

   A mobile phone, tablet, HMD (head mounted device) or eyewear is needed  to see/hear/feel the digital content.

   AR will change everything, even more than radio, television, computers and mobile phones.

Autonomous Vehicles  Vehicles capable of sensing their environment, making decisions and navigating without human input. AVs require the safest, most efficient AR data networks possible.

Augmented World Expo (AWE)  Over ten years old and still visionary. Recommended: https://www.youtube.com/watch?v=WX-geVGmOvY

B

Billboarding The term used to describe a common procedure when positioning models in AR. Billboard means that the front view of the 3D model faces the viewer. Most AR apps allow the user to rotate the model so that another side of the model is presented to the viewer.

Bubiko in the starting position; ie billboarded.

Babble Rabbit The AR masterpiece of 2019.

Occlusion, light estimation, voice commands and more:

Patched Reality and 6d allow you to learn three years worth of ARness, and see the future: 

                                                                            https://patchedreality.com/                    https://www.6d.ai/

Bubiko Foodtour AR’s first superstar, a character created by Stephen Black and Sayuri Okayama. Bubiko is one of the results of a two year food/AR research trip in Southeast Asia. Bubiko is a trailblazer who shares her AR experiences with the general public as well as with AR practitioners. Bubiko often forms partnerships, such as one with Green Bean Boy, a character made by Dominique Wu at Hummingbirdsday Studios http://www.hummingbirdsday.com/. Other collaborations are planned with the Dundercats, by Six Cat Studios https://www.sixcatstudios.com/journal/2018/4/24/the-dundercats, and creations by David Severn http://david-severn.com/ . The 3D version of Bubiko was created by Novaby. https://www.novaby.com/

Bubiko at the Mascot Hall of Fame

                                                                                                     

Bubiko debuted at the Tech in the Tenderloin event. http://www.blacksteps.tv/tech-in-the-tenderloin-2019-salvation-army-kroc-center-san-francisco/

C

Cannondale AR for bikes https://www.youtube.com/watch?v=-F3jXZDNj38

Charlie Fink's Metaverse - An AR Enabled Guide to AR & VR

Cloud see R3

Computer vision Computers use lenses, radar and many kinds of sensors to learn about the world. These different ways of “seeing” are often combined with Artificial Intelligence(AI). The end result is that computers recognize objects as well as the many kinds of information connected to them.

Convergence

Convergence author and Forbes columnist Charlie Fink tells the story of Augmented Reality (AR), a new technology that's already seeping into every smartphone and every workplace. AR's merger with new 5G and AI technologies will unleash a wave of innovation that will enable wearable, invisible, latency-free and ubiquitous computing. The book uses a kind of mobile AR called "marker AR" to allow readers to use their smartphone to bring pages to life, demonstrating with art and entertainment how the world, and every person, place, and thing, will be painted with data. https://www.amazon.com/Convergence-World-Will-Painted-Data/dp/0578460556/

D

Depth sensing Recording scenes in 3D dimensions. See volumetric video

Debbie Ding An artist and a lecturer in Singapore. Some of Debbie’s students’ work can be seen here: http://www.blacksteps.tv/ar-hkpolyu-followup-2-students-work/

Dr. Ludo's Events on Hi-Techs4Humans: Workshops, Seminars, Lectures, etc. (Facebook)

E

Edge computing There are advantages to processing data as close to the user as possible, especially in regards to the Internet of Things. This means, to a large extent, a decentralized system. This localized/decentralized approach is called edge computing.

https://www.networkworld.com/article/3224893/what-is-edge-computing-and-how-it-s-changing-the-network.html

End User The person who uses the app or device. Always important, but especially when the product is meant for a specific demographic, like the elderly.

Eye Tracking The measurement of eye motion and activity.

Eugene Soh The Dude. Probably the first in Asia (who isn’t a Facebook employee) to create an Instagram Filter. https://www.dude.sg/    www.gallery.sg  

F

Facebook Spark vs. Facebook Camera http://www.blacksteps.tv/bubiko-foodtour-test-facebook-spark-vs-facebook-camera/ = �U0���

Thank you for your interest. The rest of the definitions are available at Amazon, in the guide itself.

Bubiko Scrapbook September 2019

Bubiko is a little chef from Thailand who loves AR. Her unusual guide to Augmented Reality is now on Amazon.

This post is an introduction to Bubiko's world.

July, 2017 Kuala Lumpur, Malaysia. Bubiko, the first paper version, based on a doll from Thailand. Bubiko is very knowledgeable about the food of Southeast Asia. Here she studies thunder tea rice.

July 2019 Pierogi Festival, Detroit. Bubiko. 3D version made by Novaby. In the summer of 2019, Bubiko debuted in two formats: Facebook Spark and Facebook Camera. Facebook Camera support by Dana Hagan.

doll with colorful drink
2017: At the Penang Food Festival in Kuala Lumpur. Bandung is the name of a popular drink. Aroi mak mak is Bubiko's favorite phrase. It means "very delicious"" in the Thai language.


https://www.instagram.com/p/Bs4hK_hH8cV/

Bubiko has an Instagram account. She also made one book:

Available on Amazon




Bubiko Foodtour
A guide to the food of Shenzhen, a work in progress.
Shenzhen is the Silicon Valley of China. A story about Shenzhen , written and photographed by Stephen Black for makermag.

ARKit games made with Unity
Presentation at Le Wagon, Shenzhen December 26, 2018 Pictured is an AR game collaborative test with Green Bean Boy, a character by Dominique Wu/Hummingbirdsday Studios.

November, 2018 Shenzhen. Stephen Black, pitching his unicorn idea to VCs at TechCrunch Shenzhen. (The unicorn idea is a separate idea from Bubiko/the Pixar of AR)

Sayuri Okayama, at the 2019 Reality Virtually Hackathon at the MIT Media Lab, sponsored by Magic Leap. 

S O with an early paper mockup of Bubiko. Ipoh Malaysia

A demonstration by Google in Kuala Lumpur.
computer users having fun
Chiang Rai, Thailand May 2018. Stephen Black and Suphakorn Traisrisin testing the HP Reveal AR software with Bubiko Foodtour.
Austin Chronicle, Bubiko Foodtour
A collection of Bubiko's 2019 SXSW blog posts are here.
Stephen Black's Bubiko-themed proposal for SXSW 2020 is here.
Sayuri Okayama's (Food + AR) proposal for SXSW 2020 is here.

Get behind it before it gets past you
Now on tour....Bubiko, Eggy, Ollie and Obasan A! R! Let's go!
Green Bean Boy and other AR characters
The plan: a tour of the US and Canada: readings, food tastings and AR, AR, AR.

SB at MIT. Next presentation by SB: OARC (Open Augmented Reality, Cloud) Munich, October 16, 2019.

Augmented Reality in Asia
Malay Mail article explaining Bubiko and her research about Southeast Asian food.
Bubiko is looking forward to the future, meeting other chefs and discovering new foods.

Bubiko's app is on its way! If you would like to be among the first to play with it, leave a message in the comment section. See you on Twitter , Facebook and Instagram!
BYE!

https://www.instagram.com/p/Bs4hK_hH8cV

Augmented Reality + Autonomous Vehicles: Stephen Black @ Collider

Bubiko's guide to AR is now available on Amazon!

The following are additions that were not discussed at the Detroit meetup.

https://www.forbes.com/sites/edgarsten/2019/08/12/turning-back-seat-boredom-into-a-virtual-theme-park/#712404fc6019

! https://www.thedrive.com/tech/9548/the-biggest-opportunity-everyone-is-missing-in-self-driving-cars

!! https://panelpicker.sxsw.com/vote/100430 (What Augmented Driving Will Feel Like, a SXSW presentation by Theo Calvin.)

I wish I had known about the projects and gentlemen above before my Detroit talk.

Do read the article by Alex Roy.

Please vote for Teo Calvin's SXSW proposal.

.......................

Presentation

Thank you very much to Jacob, Rahul and Altimetrik for making this happen. It was a blast! A description of the event, and an introduction to Collider is here.

SLIDE 2

Hyperreality by Keiichi Matsuda

https://www.rt.com/news/455341-chinese-hackers-tesla-autopilot/

https://mashable.com/article/nissan-ar-virtual-reality-windshield-display/

The Nissan video features outstanding visuals.

SLIDE 3

https://www.openarcloud.org/reports/sotarc-2019

The above link is a MUST for anyone with a serious investment in AR.

Novaby is the company that did/is doing a great job with Bubiko.

(Yes, all of the research you see is self-funded. If you can help with a donation or a job...get in touch, please. I am also a photographer, artist, videomaker and a writer.

SLIDE 4

You can see all of my adventures with Bubiko elsewhere on this blog. We would be grateful for your votes for two proposals for SXSW.

This is my proposal.

This is the proposal of Sayuri Okayama, my partner.

THANK YOU FOR YOUR VOTE!

SLIDE 5

This book is a "living" book. Meaning if you buy it, you will get the updated editions free.

SLIDE 7

BONNETS! (My Powerpoint looks extremely low tech. As much as I like this look, I have to say I had no choice. I was using my Chromebook , and used the baked in slide show creator. Next time, I might actually have the time to do some design work.)

SLIDE 8

Artivive One of my own Artivive demos is here. Another, here.

Leo

Bubiko Foodtour

Rouvy Augmented Reality Released: First Ride & Explainer.

DC Rainmaker does his usually outstanding job of reviewing a bicycle-related product.Jump into the video at about the 4 minute mark to see some exemplary AR techniques. Click here to see more examples and ideas related to AR+ Bicycles.

Cannondale, for the win! A great example of functional AR in an everyday situation, as opposed to a factory or medical facility.

SLIDE 9

From a presentation I did on AR and bike safety. All of those concepts need to be unified and rethought for the age of AR.

SLIDE 10

Mapillary

LADOT

Superworld

SLIDE 11

The Open Augmented Reality Cloud people are making efforts to establish a geopost standard. If you are serious about AR, follow their efforts, or better join them and let your voice be heard!

What you see is a test I did with Bubiko. While I was in a car, I positioned her in the road ahead. We then drove forward. It is not clear, and I will redo this test.

But what happened is that Bubiko was in front, then she appeared in the car, and then we saw her in the road behind us. She did not move with/in relationship to the car.

This was using Facebook Spark AR. Technical support: the amazing Dana.

Stunt driver: Norm Black.

No AR characters were harmed in the production of this rest.

SLIDE 12

OPEN AUGMENTED REALITY CLOUD

SLIDE 13

The AR Podcast is a must for anyone serious about AR. This is a link to the extremely informative and important interview with four of the people involved with OARC.

SLIDE 14

Thank you Sergei!

https://www.slideshare.net/sergiikozyrev?utm_campaign=profiletracking&utm_medium=sssite&utm_source=ssslideview

SLIDE 15

One style of point cloud rendering.

SLIDE 16

Another way to render a point cloud. There are many ways to create point clouds and they must be interoperable.

https://www.clarissewiki.com/3.6/creating_a_point_cloud.html

SLIDE 17

An example of an organization that has information that would be useful for AR in Detroit. Geographic Information Services… How much of what is under the road do they have records of? This info would be necessary for many AR services,

How do they make pointclouds-or do they even do this yet?

SLIDE 18

One of Magic Leap's views on how the total AR world might look like.

The layers presented include IoT (the Internet of Things, as well as AI. Photo courtesy of Tony at the Skarred Ghost, another person I suggest serious AR/VR people support and follow.

SLIDE 19

Another presentation from Magic Leap on how the total AR Cloud might look. They use the term "Magicverse".

SLIDE 20

A representation by the OARC on what the layers of the cloud would be. My suggested terms would be REAL1 (R1), REAL2 (R2) and REAL3 (R3). R1=the physical world. R2; the layer with few changes; buildings, landmarks, geography. R3 being the part of the AR cloud that changes the most, and has the most segmentation.

This system also lends itself to further classification. R2C22 , for example, could refer to a specific block in Chicago for example, and R2C22E could be the collective "channel" for all organizations utilizing traffic emergency communications for that area.

SLIDE 21

Microsoft Azure Spatial anchor systems. 'Anchor systems' refers to geoposing. There can be an endless number of clouds. Interoperability... Machines reading the world for humans... A browser...AI assisted browsers.

SLIDE 22

This is from the State of the Open AR Cloud 2019 report by the Open Augmented Reality Cloud group. Already some governing bodies are being formed.

The report is free. Get it here.

SLIDE 24

Ed Garten's article on AV safety, for Forbes magazine.

SLIDE 25

The League of American Bicyclists has an active interest in AR and AV.

https://www.bikeleague.org/content/automated-vehicle-overview-box

SLIDE 27

And the amazing BabbleRabbit! https://twitter.com/BabbleRabbit/status/1115271007315615750

SLIDE 28

https://www.researchgate.net/publication/314522858_Supporting_Trust_in_Autonomous_Driving

https://www.researchgate.net/publication/333645946_The_Impact_of_Autonomous_Vehicles'_Active_Feedback_on_Trust

SLIDE 30

An AV by May.

SLIDE 33

Shenzhen's celebration used the entire city as a canvas. Something like this could be done in Detroit with AR, for much less cost, and with greater detail. AVs could travel on programmed routes... a new form of musical is born!

My report on the maker culture of Shenzhen is here.

SLIDE 34

The Fox Theatre is one of Detroit's cultural assets that could be utilized. This slide shows some of the layers of creation and co-operation that need to be considered.

SLIDE 35

An example of an urban AR project, this one by Snapchat. This article also raises questions about AR in public spaces.

SLIDE 36

Diego! DIA! https://www.dia.org/art/rivera-court

SLIDE 37

http://amirbaradaran.com/2019/works-pages/fml.html

Go to the "0.52" mark to see the actual AR clip. It is very brief.

The video on this site by Artivive showcases some possibilities in regards to AR + flat art. https://artivive.com/walkietalkie/

SLIDE 38

Apple's AR Art program. https://www.apple.com/newsroom/2019/07/apple-offers-new-augmented-reality-art-sessions/

SLIDE 39

Back to bROADWAY… and we have "discovered" that the Fox Theater is geofenced. Geofencing is a blocking of AR access. Military bases, sensitive areas...the interior of homes. The Fox Theatre is copyrighted, I believe. In this fictional example, Fox may have geofenced their theater to prevent unauthorized AR usage.

SLIDE 40

MOTOWN!

SLIDE 42

Bose AR

So there ya go! Any questions ask below.

I am available for consultation and all kinds of AR producing, as well as photography, video, art and writing projects. Thank you for any ideas and/or opportunities.

And again, please consider voting for our two SXSW presentations:

XR: bike safety, music and Bubiko Foodtour

and

Augmented Reality and Food

THANKS!

onwARd,

Stephen Black

Bubiko at the Pierogi Festival

Bubiko's guide to AR is now available on Amazon!

Pierogis are Polish dumplings. Bubiko is a little chef from Thailand. Roll out the barrel and let the fun begin!