Tony, Antony Vitillo, is the AR/VR consultant who runs Skarred Ghost, one of the top blogs for VR and AR. I met Tony online in 2016, and we have shared our problems and joys since then. I was invited to speak in Munich and Paris, and hoped that somehow I could finally meet Tony in person, in Europe.
However, Tony was going to be in China until he returned to Italy, to give a presentation at VIEW, in Torino, Italy. I had never heard of VIEW. When I saw it, I immediately wanted to go. But my trip was on a budget far below “low budget”. Perhaps I could volunteer, like I would do at AWE, in Munich. Tony said he would ask the organizers, and that was how we left it.
I arrived in Turin on the morning of Sunday, October 21. I’d taken an overnight bus from Munich; the city felt both friendly and alien. Two officers in a polizia car asked me if I knew where I was going.
Though the officers described the bus and train options very well, I didn’t pay too much attention. Bubiko and I were going to walk.
And, walk we did.
The address turned out to be the administrative office for VIEW, not the venue. I was relieved when someone answered the intercom; and happy when Ricardo, a handsome young man walked out. He attentively listened to my volunteering idea and seemed genuinely interested in my Bubiko demo. Like the polizie, Ricardo gave me directions on how to the venue, a place called OGR, which seemed to be near where the bus from Munich had dropped me off. I thanked Ricardo, slung my bag over my shoulder, and began rolling my little suitcase down the road.
A blonde young woman called out to me! She was the driver for OGR, and she was going to the venue. As she drove me to OGR, we talked. She lived outside of Turin, and told me how beautiful the golds and reds of Autumn were beneath the snow-capped peaks of the Alps.
We arrived at OGR, once a train station, now an art center.
I didn’t know what would happen inside, but I pretended that I did.
This post provides notes on the above Powerpoint. The actual presentation elaborated on the points much more than I do here. Please feel free to ask questions. Also, as always I recommend joining the Open Augmented Reality Cloud. They are working to create open, interoperable standards to encourage the growth, use and understanding of AR.
And yes, another resource is Bubiko Foodtour's Unusual Guide to Augmented Reality, which is reviewed here.
The following presentation uses references from the State of the AR Cloud Report published May 28, 2019 by the Open AR Cloud. All rights reserved. http://stateofthearcloud.com/ With the exception of Novaby, the 3D model making company, I have no relationships with any companies mentioned in this presentation. This research has been self-funded.
The above link exemplifies a lot of the ideas about the future of AR in general, as well as about the potential applications of AR and AV, Autonomous Vehicles.The entire article is good, but the embedded video is excellent.
I cannot recommend the work of the OARC highly enough. Visit their site for the download of the first OARC Symposium Report.
8. www.blacksteps.tv At least three posts about 'geopose'
Yes, on this blog, I presently have a few posts about 'geopose'.
9. From correspondence with Jan-Erik Vinje, Managing Director of Open Augmented Reality Cloud:
○ If we are successful in creating such a standard we will in effect have created the equivalent of the URL for real world spatial computing. Allowing the geopose of both real and virtual objects to be universally captured, stored, shared and understood.
This comment by Jan-Erik, and those that follow, are self-explanatory. However, one week ago, at the second OARC Symposium, the definition of 'geopost' was greatly discussed. In fact, the goal of the OARC for the next year is to fcus upon creating a final definition of 'geopost', and to work towards a working model.
10. ○ I liken it to URL because it can be seen as links between the physical world with the digital world. ○ URL links information to more information. Geopose links the world to digital information and digital information to the world.
11. ● It can even be used to create a "persistent portal" between a physical space and a virtual space. Where people from across the world who are experiencing a virtual space can go through such a portal to experience a real space (by streaming realtime reality capture data to all those in the virtual reality space).
12. ● At the same time people in the real world can walk into the virtual reality space or see virtual objects, scenes and avatars of virtual reality users projected into their physical space using AR.
14. To create a GEOPOSE 1.Physical space owner 2. AR data/ SLAM spatial location and mapping 3. AR Cloud space 4. End user(s)
This slide features a photo of the Fox Theatre in Detroit. The front of the theatre is copyrighted. Anyway planning to use the front of the Fox would need to obtain permission to do so.
This situation would be true for many buildings, copyrighted or not.
15. How to find the location? (the need for interoperability): Google maps Mapillary Military maps LADOT ebike monitoring maps(eg) Satellite-based maps monitoring floods, snow, ice, fire, crowds etc. City/State/Federal maps Company owned routing maps Bus routes Ride sharing maps Superworld Emergency routes Bike lanes Construction Traffic signals
The companies and organizations listed above would all benefit from an open AR Cloud. A comparison is sometimes made, comparing the present state of the AR Cloud with the early nonstandardized gauges of railroad tracks. Once the railroad tracks became standardized, society benefited.
Once there are interoperable standards for the AR Cloud, groups like those listed above will benefit, as will education, medicine, science and, all of society/
Bubiko is a little chef who has been having some exciting adventures in AR, Augmented Reality. Bubiko was born at Novaby and made her public debut at Tech in the Tenderloin.
Stephen Black is a writer, a visual artist and marching along the path of Spoken Word.
This post is exploratory.
Stephen Black and Bubiko Foodtour are now looking for opportunities to make presentations, or do collaborations with musicians, artists, writers or AR practitioners in these cities.
(BLAM is also a reference to SLAM: Simultaneous Localization And Mapping, a process associated with AR.)
Stephen Black has given presentations at Sasin School of Business, MIT Media Lab, Hong Kong PolyU, TechCrunch Shenzhen and the Collider at Alitimetrik (Detroit). This post is about his projects and this post is about Bubiko's.
What we hope to do, are open to:
Find AR collaborators. Do you have an AR software that could use a cute little chef? (Bubiko has been in Facebook Spark and Facebook Camera projects, as well as an AR game demo made by Dominique Wu from Hummingbirdsday Studios. Two projects using Artive are here and here.
2. Consultations regarding AR, or projects needing a producer.
This blog post is a sample of the guide, which is available on Amazon.
This is a response to an urgent need to share
Influences: a. “make it fast, not
c. ash from chaos
d. Chungking Express
e. The Zone System by Ansel
Adams and Minor White
No person or company has paid me to have their
name or product included in this document.
I am now notifying the companies and individuals
mentioned. If your work is here, and I have not yet contacted you, I apologize.
If you prefer that I do not share your work, let me know and I will remove it immediately.
No one has received a promotional copy. If you
have bought this, and we meet, I will buy you a beverage. Or two. If you bought
this and it seems unlikely that we will meet, I will send you my other ebooks
or find a way to make sure this purchase is something you are very happy with.
Hint, hint, Bubiko and I are working on an app. (Many times in the past, I have given out free ebooks; only to be
surprised that people did not even open them; even my bestseller.)
If you use photos or text from this document,
please credit accordingly:
Stephen Black from Bubiko’s Unusual Guide
Stephen Black from Bubiko’s Unusual Guide to AR
Have a nice day.
9/3/2019 4th edition
Anchor The three points used to describe the
location, in the real world, where an AR object has been placed. The more one
understands about 3D geometry, the more one is prepared for AR. See also billboarding, geopost.
Augmented Driving Will Feel Like, a SXSW
presentation by Theo Calvin.
Avatar A digital creation used to
represent a person, possibly resembling a human, possibly not.
‘augment’ means to make something greater; to give it more power. The platform
called ‘augmented reality’ is a network that adds digital information to real
objects. Machines are needed to do this, and
to see the results. Thus, augmented reality is the real world and the
digital information added to it, as well as the machines enabling us to
experience both at the same time.See R3
information could be in the form of a 3D model of a real object made by a
computer, like the furniture in AR apps made by Ikea, Wayfair and other
companies. Pokemon Go and Snapchat are
other examples of AR. However, the digital information could also be live or
pre-recorded video, music, podcasts,medical imagery, industrial blueprints,
text information or many other types of content.
phone, tablet, HMD (head mounted device) or eyewear is needed to see/hear/feel the digital content.
change everything, even more than radio, television, computers and mobile
Autonomous Vehicles Vehicles capable of sensing their
environment, making decisions and navigating without human input. AVs require the safest, most efficient AR data networks possible.
Billboarding The term used to describe a common procedure when positioning models
in AR. Billboard means that the front view of the 3D model faces the viewer.
Most AR apps allow the user to rotate the model so that another side of the
model is presented to the viewer.
Bubiko in the starting position; ie
Rabbit The AR masterpiece of 2019.
Occlusion, light estimation, voice commands and
Patched Reality and 6d allow you to learn three
years worth of ARness, and see the future:
Foodtour AR’s first superstar, a character created by
Stephen Black and Sayuri Okayama. Bubiko is one of the results of a two year
food/AR research trip in Southeast Asia. Bubiko is a trailblazer who shares her
AR experiences with the general public as well as with AR practitioners. Bubiko
often forms partnerships, such as one with Green Bean Boy, a character made by
Dominique Wu at Hummingbirdsday Studios http://www.hummingbirdsday.com/.
Other collaborations are planned with the Dundercats, by Six Cat Studios https://www.sixcatstudios.com/journal/2018/4/24/the-dundercats,
and creations by David Severn http://david-severn.com/ . The 3D version of
Bubiko was created by Novaby. https://www.novaby.com/
Charlie Fink's Metaverse - An AR Enabled Guide to AR & VR
Cloud see R3
vision Computers use lenses, radar and many kinds of
sensors to learn about the world. These different ways of “seeing” are often
combined with Artificial Intelligence(AI). The end result is that computers
recognize objects as well as the many kinds of information connected to them.
Convergence author and
Forbes columnist Charlie Fink tells the story of Augmented Reality (AR), a new
technology that's already seeping into every smartphone and every workplace.
AR's merger with new 5G and AI technologies will unleash a wave of innovation
that will enable wearable, invisible, latency-free and ubiquitous computing.
The book uses a kind of mobile AR called "marker AR" to allow readers
to use their smartphone to bring pages to life, demonstrating with art and
entertainment how the world, and every person, place, and thing, will be
painted with data. https://www.amazon.com/Convergence-World-Will-Painted-Data/dp/0578460556/
sensing Recording scenes in 3D dimensions. See volumetric video
Events on Hi-Techs4Humans: Workshops, Seminars, Lectures, etc. (Facebook)
computing There are advantages to processing data as
close to the user as possible, especially in regards to the Internet of Things.
This means, to a large extent, a decentralized system. This
localized/decentralized approach is called edge computing.
Bubiko is a little chef from Thailand. Her favorite food is mango sticky rice, and her favorite expression is "Aroi mak mak", which means very delicious in the Thai languge. Sayuri Okayama and I have been brainstorming about food and augmented reality since 2016, when we used a paper version of Bubiko.
Finally, in July 2019, we had a 3D version of Bubiko. Novaby did a great job, and using the Facebook Spark and Facebook Camera apps, we were ready to augment reality with our little chef. The Facebook Camera idea and tech support were thanks to Dana.
Whiting, Indiana is home to both the Mascot Hall of Fame, and the Pierogi Festival. We decided to visit both on the same weekend, and had Bubiko's balloons decorated accordingly. Later, we took Bubiko to pierogi festivals in Detroit, Michigan and Toledo, Ohio.
Food and AR
End User or End Product
Is AR being used to create a user experience or an image to be used for publicity, marketing or other purposes?
At present the following are only proposals. Of course we hope they happen. Please vote!
Color correction was made, in both cases, with the 'auto' function. Spark is brighter than Camera.
Spark allows the camera person to move around the model, as though it were a physical object. Spark also allows the size of the model to become different sizes. With Facebook Camera, the position and size of the model are locked. Only the front of the model can be seen, like a 2D image. Like a postage stamp.
In this case, Dana positioned Bubiko on the bottom right. We checked this position so that it also works in landscape mode. However, landscape mode seems to be unstable, based on my experiences. Fb Camera often enlarges and turns the background scene, like this:
Note the size of the pictures in the last two examples. Spark uses the dimensions of a mobile phone, Camera produces a more conventional image.
Finally: saving images. Spark, in my case, saved images directly into the iPad photo album.
Facebook Camera, on the other hand... Unless you actively go into the Facebook Archive feature, and turn it on, the images are only stored for 24 hours! I am hoping there is a way to retrieve some images I made, but so far have not been able to find a way to bring them back. Frustrating, as I am 99.9% sure I pressed "save" on the Facebook Camera app.
All images were created with an iPad.
Happy to reply to any questions or comments. Thanks for stopping by!
I have to thank Dana Moreira S Hagan A LOT. For personal reasons, I unexpectedly found myself in Austin on a Tuesday, with the need to have the new version of Bubiko loaded in my tablet by 1PM the following Saturday.
On Wednesday, I went to Facebook, presented them with this letter:
Although I was told they would get back to me, they haven't. After constant searching, including meeting the very helpful PJ and Ramona at Impact Hub, I discovered Capital Factory. There were two events going on that night (Thursday), but two people, Brance Hudzietz and Erin Miller, put my request out on two different networks!
Finally, on Friday, about 6, I discovered Erin Ford at General Assembly. Thanks to Erin, about 7PM I started a phone conversation with Dana. Dana did not have the Mac-with-Mojave that was so desperately needed, but she did come through with the idea to use Facebook Camera which was an even better choice for testing.
The goal is to prepare for the possibilities of AR cinema.
This post documents a simple test. The Bubiko model used for the Tech in the Tenderloin event was used. Two locations: a garage and an open piece of land. The objective: to gain an understanding of what a “stage” can be in AR. AR is a new medium; to use the established techniques of theatre, television and movie is to fail to grasp the uniqueness of AR. Performance art and dance provide clues.
Notes: Spark used
Occlusion not a concern at this time
Ambient light a constant
Size and scaling of Bubiko purposely varied
Bubiko was created by Stephen Black and Sayuri Okayama
iPad used; no manual controls nor color correction
Stephen Black: This post is a breakdown of my experiences with AR/VR/Spatial Computing. It starts with 2002, though I received a BFA in Photographic Illustration from the Rochester Institute of Technology well before that.
Before 2002, I lived in Tokyo, Manhattan, Paris and Hong Kong, and worked in network TV, fine arts, photography and music. A fuller biography can be found here. But AR is the topic of this post...
2002-2007. In Singapore I worked as a creative director for a 3D game making company that was also doing something like Youtube,-- but three years before Youtube. Although I was not a developer, I learned a great deal about spatial computing, and taught 3D gamemaking in Singapore, including classes at the Singapore Science Center. It was during this time, that David Severn and I developed the Secret Donut World characters.
2007- 2014 Singapore/Bali: wrote novels, including a bestseller, was involved with 3how and researched VR and AR.
2014 SPOKEN, with Eugene Soh; a curation of a wide range of artists.
2014 The Oculus signaled the emergence of VR, and I began notes for a book about VR cinematography.
2015 In Singapore, a chance meeting with Ender Jiang, the founder of Hiverlab, resulted in the opportunity to make my first 360 film. Ender provided me with technical support and creative freedom and I am extremely grateful for that opportunity. The resulting film, Beach Road, featured a soundtrack by Bani Haykal and Chen Yi Qi, and was selected as a demo VR film in the Hybrid Arcade session of the Brisbane Asia Pacific Film Festival in November 2015, and was nominated as the Best Experimental VR Film in the VR Fest Las Vegas 2016. It was also fetured in a VR film festival at the Singapore national Museum. Beach Road was receiving a healthy number of views and comments before a technical change in Google Play took it off. At the time of this writing, Beach Road is on Veer and has received almost 5000 views.
2016 The year began with discussing a VR startup idea with VCs in Singapore. Though the discussions went well, the lack of a prototype slowed things down. Shortly after, the release of ARCore and ARKit resulted in a halt to VR the possibilities of AR were assessed.
By April, AR had become the focus and the decision was made to become the "Pixar of AR": original characters, stories and software. With Sayuri Okayama, Bubiko Foodtour was originated.
2018 A presentation about AR was given at Sasin School of Business in Bangkok, later followed by two presentations and two workshops at Hong Kong PolyU, all at 80% capacity or higher.
2018Lotus Mountain, a 360 film was shot and post production began including VR art contributions from Scobot and a soundtrack by Rei Shimizu. The film is at least 80% done and finishing funds are now being searched for. Lotus Mountain was supported by Kando, and 8K Obsidians were used for most of the shooting. Noted Chinese VR filmmaker Leo Wei co-directed and produced.
Bubiko at the Rise festival in HK
Hong Kong Comicon
2018 Cross-promotional and development partnership with Six Cats Studios (HK), focusing on their original IPs, Ollie and Charlie.
2018 Presentations in Shenzhen, including Le Wagon and Tech Crunch Shenzhen.