Yes quarantine has produced an outpouring of little, home movie-meets-hi-tech video sketches. This one is about carrot cake, one of my mom's specialties.
Photos of the world's best piece of carrot cake are here.
My mom's recipe began with a prizewinning recipe she saw in the newspaper "a few years ago". Since then she has made a few subtle but magical changes. One of these days we will likely do some kind of recipe project..maybe this will be in it.
In the video I mention that in Southeast Asia, "carrot cake" is a very delicious, but very different thing. The 'carrot' in SE Asian carrot cake is actually a white radish (something like what the Japanese call 'daikon'). It is fried with flavorings. Traditionally it is served on banana leaves,
Here is an interview with Mr. Boo, from Kampong Carrot Cake in Tiong Bahru, Singapore. I have eaten his carrot cake many times, and I have interviewed him for the sequel to i ate tiong bahru.
So, yes there are two very different foods that share the name of "carrot cake", and I am very fortunate to know master chefs of both!
Hello. Stephen Black here. This is my personal, self-initiated, self-funded and unofficial project to create accurate and simplified definitions about GeoPose. I am doing this because:
I do (worldwide) presentations about AR, and need to be able to explain GeoPose clearly, and with technical accuracy. Short definitions increase comprehension, work well on Powerpoint, and save speaking time for other topics.
GeoPose and AR are topics for journalists, bloggers and reporters, not all of whom have technical backgrounds. Clear and simple definitions allow for the maximum flow of accurate information.
Although my ultimate goal is to create AR experiences/produce AR apps, I am now an AR educator/evangelist: speaking mainly to general audiences. It is clear that AR is not easily understood. GeoPost will be easy to use, but, for now, the concept will likely be intimidating to many people.
English is not always the first language within the tech community.
I'm a writer: I like using the fewest words to create most results.
So... all comments are welcome, and needed. By the time I give my presentation at ARIA/The MIT Media Lab, I hope to present the following ideas with the input and approval of those who are far more knowledgeable than I am.
Of course , once the following are clear, I hope the information can be shared by anyone, anywhere. I will also include the information in my ebook guide to AR project, which is updated as often as possible.
Thank you for your time and attention to this.
Please comment upon the italicized sentence. Thank you.
stephen black will be giving presentations in Toledo OH, MIT and elsewhere. Details here.
A TEAM OF HACKERS, MINUTES AFTER A MASSIVE EARTHQUAKE. Their mission: study car navigation usage to identify surviving roads, and the traffic upon them. Location: Tokyo, immediately after the 2011 Tohoku Earthquake and Tsunami. The team: members from Toyota, Honda and Nissan; the first time in history the car manufacturers worked together.
This was one of the pieces of information shared by an attendee of my presentation about Autonomous Vehicles and AR. The point of the Japanese automaker story was to illustrate the powerful advantages of interoperable standards. For AR to reach its full potential, AR service providers like Microsoft, Amazon, Apple and others must agree upon standards that are interoperable and respectful of privacy. In other words, a GeoPose standard must be established.
GeoPose is a term given to a 6DoF geospatial reference or link of an object (physical or digital) to the real world. It can be used to anything from visual positioning systems for AR to self driving cars or flying drones. As URL are vital to the internet, GeoPose will be to AR and real-world spatial computing.
GeoPose is a part of a larger vision for an Open Spatial Computing Platform (OSCP) inspired by the web, but for the era of real-world spatial computing.
At the bottom of this post is an update from Jan-Erik Vinje, regarding the recent activities of the OGC GeoPose Standards Working Group.
Imagine an eight story industrial building which houses 20 large workshops, six of which belong to one company and two workshops are shared by all. Question: will each company have an independent AR guidance system? Will visitors have to switch AR apps when going from one workshop to another? Will inventory suppliers have to download apps for the building and for each workshop? Will repair and maintenance crews have access to one AR system that shows wiring, water, conduits, etc? In emergencies, will fire fighters, police and first responders be able to use one system that indicates where all occupants are, where all combustibles are, where the fire escapes are?
There are countless reasons why GeoPose should be standardized, but emergency responses, medical and traffic regulation are the most obvious. On my website are three posts regarding GeoPose, my ”favorite” being one on the difference between GeopPose and GPS. I am very appreciative of the time and thoughtful explanations of the Open Augmented Reality Cloud team, especially Jan-Erik Vinje, OARC’s managing director.
OARC is a volunteer-run dynamic group who are now working on how to create GeoPose standards that are open to all. If you are serious about AR, please consider joining OARC.
The talk popped from topic to topic, driven by audience questions and observations, with videos providing starting points.
There was one thing I forgot to mention in the presentation: Bubiko Foodtour’s Unusual Guide to Augmented Reality. ARPost wrote this about it:
There’s a great ebook out there that’ll introduce you to all the jargon you need. Whether you want to understand an article better, contribute more to a conversation, or start developing with AR technology, this is a good place to start.
The guide will be updated periodically. I have started the second edition, and after the MIT symposium I will update it again. Those who have the first edition will get a free version of the second, as well as all future updates.
Thanks to all those who have bought the first edition (please leave a review :). I am self-funded, have no sponsors and, so far, only one paid speaking engagement. Your purchase really helps.
The kick-off meeting had participants from across the geospatial industry, government, academia, NGO’s and large corporations like Google. It is important to note that the GeoPose standard, although an initiative from Open AR Cloud, is not being primarily going to be developed inside of Open AR Cloud, but rather in a leading standards body of the geospatial sector.
This post provides notes on the above Powerpoint. The actual presentation elaborated on the points much more than I do here. Please feel free to ask questions. Also, as always I recommend joining the Open Augmented Reality Cloud. They are working to create open, interoperable standards to encourage the growth, use and understanding of AR.
And yes, another resource is Bubiko Foodtour's Unusual Guide to Augmented Reality, which is reviewed here.
The following presentation uses references from the State of the AR Cloud Report published May 28, 2019 by the Open AR Cloud. All rights reserved. http://stateofthearcloud.com/ With the exception of Novaby, the 3D model making company, I have no relationships with any companies mentioned in this presentation. This research has been self-funded.
The above link exemplifies a lot of the ideas about the future of AR in general, as well as about the potential applications of AR and AV, Autonomous Vehicles.The entire article is good, but the embedded video is excellent.
I cannot recommend the work of the OARC highly enough. Visit their site for the download of the first OARC Symposium Report.
8. www.blacksteps.tv At least three posts about 'geopose'
Yes, on this blog, I presently have a few posts about 'geopose'.
9. From correspondence with Jan-Erik Vinje, Managing Director of Open Augmented Reality Cloud:
○ If we are successful in creating such a standard we will in effect have created the equivalent of the URL for real world spatial computing. Allowing the geopose of both real and virtual objects to be universally captured, stored, shared and understood.
This comment by Jan-Erik, and those that follow, are self-explanatory. However, one week ago, at the second OARC Symposium, the definition of 'geopost' was greatly discussed. In fact, the goal of the OARC for the next year is to fcus upon creating a final definition of 'geopost', and to work towards a working model.
10. ○ I liken it to URL because it can be seen as links between the physical world with the digital world. ○ URL links information to more information. Geopose links the world to digital information and digital information to the world.
11. ● It can even be used to create a "persistent portal" between a physical space and a virtual space. Where people from across the world who are experiencing a virtual space can go through such a portal to experience a real space (by streaming realtime reality capture data to all those in the virtual reality space).
12. ● At the same time people in the real world can walk into the virtual reality space or see virtual objects, scenes and avatars of virtual reality users projected into their physical space using AR.
14. To create a GEOPOSE 1.Physical space owner 2. AR data/ SLAM spatial location and mapping 3. AR Cloud space 4. End user(s)
This slide features a photo of the Fox Theatre in Detroit. The front of the theatre is copyrighted. Anyway planning to use the front of the Fox would need to obtain permission to do so.
This situation would be true for many buildings, copyrighted or not.
15. How to find the location? (the need for interoperability): Google maps Mapillary Military maps LADOT ebike monitoring maps(eg) Satellite-based maps monitoring floods, snow, ice, fire, crowds etc. City/State/Federal maps Company owned routing maps Bus routes Ride sharing maps Superworld Emergency routes Bike lanes Construction Traffic signals
The companies and organizations listed above would all benefit from an open AR Cloud. A comparison is sometimes made, comparing the present state of the AR Cloud with the early nonstandardized gauges of railroad tracks. Once the railroad tracks became standardized, society benefited.
Once there are interoperable standards for the AR Cloud, groups like those listed above will benefit, as will education, medicine, science and, all of society/
What will the relationship between WebXR and geospatial data be?
It seems that WebXR cannot entirely ignore geospatial positioning, as geospatial content will be a major use case for mobile AR (at least eventually).
The web already has a geolocation API, but it is not sufficient for these purposes: it gives position but not orientation, is of very poor quality and not synchronized with the WebXR frame data. The deviceorientation API cannot be relied on for orientation: it is of very poor quality, was never standardizes (and is potentially going to be removed from existing browsers) and is also not synchronized with the WebXR frame data.
ARKit offers the option to have it's local coordinate system be aligned with geospatial orientation (e.g., Y up, Z south, X east). This provides a possible direction for how geospatial might be handled: have the WebXR API expose a property that says if the coordinate frame can be aligned with geospatial EUS coordinates, and provide a way for the developer to request this. Crude/simple geospatial positional alignment (between the user and the local coordinates) is easier, if you are guaranteed to have the local device coordinates aligned with EUS: each time a geospatial value is received from the local coordinates, an estimate of the geospatial location of the origin of the local coordinate frame can be updated (based on error values, etc). It won't be any better than the error of the geolocation API, but can be stable (because the local coordinates are used for locating and rendering content, not the very-slowly-changing geolocation values).
Hi I am the founder of the https://open-arcloud.org/ . The TL DR AR-cloud description is a 1:1 digital map/twin of the physical world stored in the cloud that enables a shared programmable space attached directly to our physical suroundings that enables multiuser AR and persistent and universally consistent placement of virtual assets in the real worldOne of the things we hope can help bring this to reality is a standard definition of geographical position and orientation that can be understood across platforms and applications. What we call "GeoPose". Each AR-goggle, AR-smartphone or AR-content could have a GeoPose at any given moment.Obtaining GeoPose of an XR-device could be achieved by matching sensor data from the device with the 1:1 map in the cloud through something like a "GeoPose" cloud service. Once the device has its GeoPose it can display geospatial data and assets that are anchored to a GeoPose.A bit more about that here: https://open-arcloud.org/standardsplease join our slack channel and chime in on how you think a GeoPose should be defined. https://join.slack.com/t/open-arcloud/shared_invite/enQtMzE4MTc0MTY2NjYwLWIyN2E4YmYxOTA4MWNkZmI5OGQ4Mjg2MGYzNTc4OTRkN2RjZGUxOTc4YjJhOTQ0Nzc3OWMxYTA3ZDMxNGEzMGEMy hope of course is that WebXR will support using device GeoPose and do the proper transforms for assets that are ancored to GeoPoses or assets that are described by geospatial coordinates.
TITLE: Geopose Standards Working Group Charter [OGC 19-028]
Author Name (s): Jan-Erik Vinje, Christine Perey, Scott Simmons
CATEGORY: SWG Charter Template
All physical world objects inherently have a geographically-anchored pose. Unfortunately, there is not a standard for universally expressing the pose in a manner which can be interpreted and used by modern computing platforms. The main purpose of this SWG will be to develop and propose a standard for geographically-anchored pose (geopose) with 6 degrees of freedom referenced to one or more standardized Coordinate Reference Systems (CRSs).
Definition of geopose
A real object in space can have three components of translation – up and down (z), left and right (x) and forward and backward (y) and three components of rotation – Pitch, Roll and Yaw. Hence the real object has six degrees of freedom.
The combination of position and orientation with 6 degrees of freedom of objects in computer graphics and robotics are usually referred to as the object’s “pose.” Pose can be expressed as being in relation to other objects and/or to the user. When a pose is defined relative to a geographical frame of reference or coordinate system, it will be called a geographically-anchored pose, or geopose for short.
Uses for geopose
An object with geopose may be any real physical object. This includes object such as an AR display device (proxy for a user’s eyes), vehicle, robot, or a park bench. It may also be a digital object like a BIM model, a computer game asset, the origin and orientation of the local coordinate system of an AR device, or a point-cloud dataset.
When the geopose of both real and virtual objects include the current position and orientation of the objects in a way that is universally understood, the interactions between the objects and an object and its location can be put to many uses. It is also important to note that many objects move with respect to a common frame of reference (and one another). Their positions and orientations can vary over time.
The ability to specify the geopose of any object enables us to represent any object in a universally agreed upon way for real world 3D spatial computing systems, such as those under development for autonomous vehicles or those used by augmented reality (AR) or 3D map solutions. In addition, the pose of any object can be encoded consistently in a digital representation of the physical world or any part therein (i.e., digital twin).
The proposed standard will provide an interoperable way to seamlessly express, record, and share the geopose of objects in an entirely consistent manner across different applications, users, devices, services, and platforms which adopt the standard or are able to translate/exchange the geopose into another CRS.
One example of the benefit of a universally consistent geopose is in a traffic situation. The same real-time geopose of a vehicle could be shared and displayed in different systems including:
Open Geospatial Consortium
Geopose SWG CharterPage 2
- a traffic visualization on a screen in another car,
- shown directly at its physical location in the AR glasses of a pedestrian that is around the corner for the car, or
- in the real time world model used by a delivery robot to help it navigate the world autonomously.
This site contains documentation for web developers using Design Tools to add AR content to a web application.
Argon-aframe — Lesson 7: Geolocation
Key features of augmented reality include 1. the ability of associating data objects with places in the world and 2. displaying those objects at those places.
The <ar-geopose> primitive is Argon-aframe’s way of locating objects in physical space (of the planet). The <ar-geopose> primitive creates an entity with a referenceframe component. This component defines the position and/or rotation of the entity by an LLA (longitude, latitude, altitude), so you can locate your object anywhere on the earth relatively accurately by using this tag.
You can find the longitude and latitude through Google Maps or through a variety of mobile applications. Some apps will also give your the altitude of a location. .........................................................................................................................................
Reference Implementations for Conversion Between Geopose and Cartesian Coordinate Systems
There will be a need throughout many parts of the technological ecosystem to convert object poses between a geospatial coordinate-system and local ones (typically the Cartesian x,y,z in metric as used in most AR SDKs). This repository is the first step to create reference libraries in different programming languages, available for everyone to use for free.
Would you like to support THE GREATEST AR TOUR IN HISTORY? Do you want to learn the latest news from AWE, Austin, Japan, Detroit, Turin, Munich, Shenzhen and Japan!?
Stephen Black and Bubiko Foodtour are about to go global: learning, educating and networking at some of the biggest AR events in the world. We just need a little financial fuel...we are movin’ and groovin, but our app isn’t out yet! Startup blues!
The following video is a rehearsal. The starting point is a presentation I did in Detroit in July 2019. That presentation was about Autonomous Vehicles and Augmented Reality. Eventually I will have about eight videos based on that Detroit presentation. You can find the Powerpoint for that here.
It will be obvious that I am not the smoothest person to ever be on a stage. I am a photographer, a cinematographer, an artist and a writer. I am used to having time to think about what I am expressing. As I will soon be making presentations in Europe, I am trying to get through the learning curve of being onstage, asap.
In this presentation, I often refer to the Open Augmented Reality Cloud. If you are serious about AR, you must learn about their work, and download the free State of the Augmented Reality Cloud Report which is available on their website. (I am honored and humbled to say that I will be speaking about Bubiko at the OARC Symposium in Munich on October 16!)
The ARShow produced this informative podcast with Jan-Erik Vinje, Christine Perey, Jason Fox and Colin Steinman, the key cotributors to the OARC
Bubiko is a little chef who has been having some exciting adventures in AR, Augmented Reality. Bubiko was born at Novaby and made her public debut at Tech in the Tenderloin.
Stephen Black is a writer, a visual artist and marching along the path of Spoken Word.
This post is exploratory.
Stephen Black and Bubiko Foodtour are now looking for opportunities to make presentations, or do collaborations with musicians, artists, writers or AR practitioners in these cities.
(BLAM is also a reference to SLAM: Simultaneous Localization And Mapping, a process associated with AR.)
Stephen Black has given presentations at Sasin School of Business, MIT Media Lab, Hong Kong PolyU, TechCrunch Shenzhen and the Collider at Alitimetrik (Detroit). This post is about his projects and this post is about Bubiko's.
What we hope to do, are open to:
Find AR collaborators. Do you have an AR software that could use a cute little chef? (Bubiko has been in Facebook Spark and Facebook Camera projects, as well as an AR game demo made by Dominique Wu from Hummingbirdsday Studios. Two projects using Artive are here and here.
2. Consultations regarding AR, or projects needing a producer.
The recent release of citywide 3D mapping technologies allows AR objects to be placed permanently and accurately. Two companies to watch : Scape and 6D.Ai.
With an established background in visual arts, music, the performing arts and AR, I have been waiting for the opportunity to create very large scale AR artworks. Years ago I developed plans for an AR sound artwork for Singapore's Tiong Bahru, an estate composed of historic Art Deco buildings. In 2018, in Shenzhen, a citywide light show rekindled my interest in large scale AR projects.
This year, while preparing for a presentation in Detroit, another idea: an Augmented Reality project to be viewed, and experienced, from inside Autonomous Vehicles; bROADWAY
Although the ideas of bROADWAY could work in any city, Detroit is associated with the automobile industry, including AV. Detroit is the home of legends like Motown, Aretha Franklin, Stevie Wonder, the Jacksons, Detroit techno (Juan Atkins, Kevin Saunderson and Derrick May +), Bob Seger, Jack White, Alice Cooper and Iggy Pop. These points, plus distinguished architecture and public spaces, mean there could be no better city for the world’s first AR+AV citywide experience!
AVs as performers!
If anyone in Detroit knows how to make this project happen, please get in touch.
(And, as AVs are becoming more common worldwide, the idea could happen anywhere.)
This blog post is a sample of the guide, which is available on Amazon.
This is a response to an urgent need to share
Influences: a. “make it fast, not
c. ash from chaos
d. Chungking Express
e. The Zone System by Ansel
Adams and Minor White
No person or company has paid me to have their
name or product included in this document.
I am now notifying the companies and individuals
mentioned. If your work is here, and I have not yet contacted you, I apologize.
If you prefer that I do not share your work, let me know and I will remove it immediately.
No one has received a promotional copy. If you
have bought this, and we meet, I will buy you a beverage. Or two. If you bought
this and it seems unlikely that we will meet, I will send you my other ebooks
or find a way to make sure this purchase is something you are very happy with.
Hint, hint, Bubiko and I are working on an app. (Many times in the past, I have given out free ebooks; only to be
surprised that people did not even open them; even my bestseller.)
If you use photos or text from this document,
please credit accordingly:
Stephen Black from Bubiko’s Unusual Guide
Stephen Black from Bubiko’s Unusual Guide to AR
Have a nice day.
9/3/2019 4th edition
Anchor The three points used to describe the
location, in the real world, where an AR object has been placed. The more one
understands about 3D geometry, the more one is prepared for AR. See also billboarding, geopost.
Augmented Driving Will Feel Like, a SXSW
presentation by Theo Calvin.
Avatar A digital creation used to
represent a person, possibly resembling a human, possibly not.
‘augment’ means to make something greater; to give it more power. The platform
called ‘augmented reality’ is a network that adds digital information to real
objects. Machines are needed to do this, and
to see the results. Thus, augmented reality is the real world and the
digital information added to it, as well as the machines enabling us to
experience both at the same time.See R3
information could be in the form of a 3D model of a real object made by a
computer, like the furniture in AR apps made by Ikea, Wayfair and other
companies. Pokemon Go and Snapchat are
other examples of AR. However, the digital information could also be live or
pre-recorded video, music, podcasts,medical imagery, industrial blueprints,
text information or many other types of content.
phone, tablet, HMD (head mounted device) or eyewear is needed to see/hear/feel the digital content.
change everything, even more than radio, television, computers and mobile
Autonomous Vehicles Vehicles capable of sensing their
environment, making decisions and navigating without human input. AVs require the safest, most efficient AR data networks possible.
Billboarding The term used to describe a common procedure when positioning models
in AR. Billboard means that the front view of the 3D model faces the viewer.
Most AR apps allow the user to rotate the model so that another side of the
model is presented to the viewer.
Bubiko in the starting position; ie
Rabbit The AR masterpiece of 2019.
Occlusion, light estimation, voice commands and
Patched Reality and 6d allow you to learn three
years worth of ARness, and see the future:
Foodtour AR’s first superstar, a character created by
Stephen Black and Sayuri Okayama. Bubiko is one of the results of a two year
food/AR research trip in Southeast Asia. Bubiko is a trailblazer who shares her
AR experiences with the general public as well as with AR practitioners. Bubiko
often forms partnerships, such as one with Green Bean Boy, a character made by
Dominique Wu at Hummingbirdsday Studios http://www.hummingbirdsday.com/.
Other collaborations are planned with the Dundercats, by Six Cat Studios https://www.sixcatstudios.com/journal/2018/4/24/the-dundercats,
and creations by David Severn http://david-severn.com/ . The 3D version of
Bubiko was created by Novaby. https://www.novaby.com/
Charlie Fink's Metaverse - An AR Enabled Guide to AR & VR
Cloud see R3
vision Computers use lenses, radar and many kinds of
sensors to learn about the world. These different ways of “seeing” are often
combined with Artificial Intelligence(AI). The end result is that computers
recognize objects as well as the many kinds of information connected to them.
Convergence author and
Forbes columnist Charlie Fink tells the story of Augmented Reality (AR), a new
technology that's already seeping into every smartphone and every workplace.
AR's merger with new 5G and AI technologies will unleash a wave of innovation
that will enable wearable, invisible, latency-free and ubiquitous computing.
The book uses a kind of mobile AR called "marker AR" to allow readers
to use their smartphone to bring pages to life, demonstrating with art and
entertainment how the world, and every person, place, and thing, will be
painted with data. https://www.amazon.com/Convergence-World-Will-Painted-Data/dp/0578460556/
sensing Recording scenes in 3D dimensions. See volumetric video
Events on Hi-Techs4Humans: Workshops, Seminars, Lectures, etc. (Facebook)
computing There are advantages to processing data as
close to the user as possible, especially in regards to the Internet of Things.
This means, to a large extent, a decentralized system. This
localized/decentralized approach is called edge computing.