Category Archives: VR

AR, VR and Every R in Between (July 7, 2018)

Taking place during the Maker Faire Hong Kong, was AR, VR and Every R in Between, organized by Dr. Ludovic Krundel, of the Digital Entertainment Lab, School of Design at HK PolyU. Here is a link to bios of some of the people who made the day so interesting. Plus, there was Kandao and SnapPop. Photos by Stephen Black and Bubiko Foodtour. 360VR video of the event is here!

360VR video of this is here.

Day 2 is here.

Alphabet Spikes Z-T (notes from June 2018, Hong Kong)

Alphabet Spikes is a collection of stories, essays and experiments created from February 2017 until now--and in the future! The core of the book is here, on Amazon, but this ebook actually something like crowdfunding.

Once you buy the book, send me your email and you will get an updated ebook with new stories, as I add them. Right now, the version on Amazon includes stories about a game developer, Antigone Cloud and my brief encounter with Anthony Bourdain. Next will be journal entries from the Bubiko Orwell Tour, which voyaged through Singapore, Malaysia, Laos, Myanmar, Thailand, Indonesia and Hong Kong. The purpose of the tour was to research food, to create a network of people interested in AR, and two work on two books.

Besides the tour journal, there are, and will be, short stories, interviews and essays about Southeast Asia and people, events and places connected to it.

Alphabet Spikes: Art and entrepreneurship go on a road trip in Southeast Asia. Lots of eating, a few meetings, and nonstop ups and downs.

In reverse alphabetical order, the following are some of my experiences in Hong Kong; these will become stories and essays. Questions? Leave in the comments section, as well as any info you'd like to share. Thanks!

Zorn. Click to hear the HK/Macau/CBGB story.

Yam cha and dim sum

Yam cha! The literal translation is "drink tea". However, yum cha usually means eating a meal of dim sum. Dim sum are the foods served in the round bamboo containers. Dim sum restaurants are everywhere in Hong Kong.

Xu Xi at the launch of Insignificance

“An audacious, inventive and original collection: these ‘Hong Kong’ stories are full of clever energy and lively strangeness.” - Gail Jones On Amazon.

Walsh, Joe. Performing with Shear, Jules and John, Doctor.

VR HMD ad on a tram.

Uniworks, the display of students' work, near the entrance of the Jockey Club Innovation Tower on the Hong Kong Polytechnic campus.

Inside the Dome

Tony Tan, Delta Blues Audio

Tai Kwun Art Complex, just down the road from where I used to live.

Alphabet Spikes: Q-S is here.

another book by Book Merah

2018 AR/Augmented Reality: State of the Art

I recently did two workshops and two presentations about AR at the Hong Kong Polytechnic University. This post summarizes what I presented, or wanted to present. Just before the presentations started, there were so many new announcements from Google, Apple and the attendees at the AWE, that not all of the following info was presented. And, a few tweaks and additions will be happening in the next few days. I would again like to thank Phil Morgan, Gino Yu, Dr. Ludovic Krundel and Hong Kong Polytechnic for their support.

AR Reference Materials

Descriptions of Workshops and Presentations

Questionnaire For Those Attending Workshops

Responses to First Day Topics: Emergency Response and Urban Planning

Followup: Head Mounted Devices

Followup: Students' Work

Followup: Food and AR

Followup: Apps and Software

Bubiko Foodtour with coconuts (an AR test)

A large part of the Bubiko Orwell Tour involve networking with AR practioners, individuals as well as companies.

Also, during the events, my ebooks were either free or discounted.

AR HKPOLYU Followup 2 (Students Work +)

MUCH MORE INFO ABOUT THE MATERIALS PRESENTED IS HERE.

As I began to prepare for the events, I soon discovered a fantastic problem. Three huge AR events had very recently occurred:

- Google held its Developer's Conference on May 8.

- Apple's Worldwide Developer's Conference ended on June 8.

-The biggest announcements in AR were made at the Augmented World Expo, which was from May 30 to June 1.

Because my presentations were meant to reflect the State of the Art in AR, I had to organize lot of information in a short period of time. Plus, the materials I had gathered previously had become out of date.

The good news is that nearly all of the materials presented were less than a year old, some just a few days old! The bad news is that in the rush, I had to de-prioritize student's work and ended up not showing any. With this post I remedy that, and am thankful to the teachers and students involved with the work below.(Any students, anywhere: I will be happy to post your AR-related work!)

First is the "home team", the Hong Kong Polytechnic University of Design. Dr. Ludovic Krundell helped secure these images, and he was a most helpful resource and source of welcome advice during my time at PolyU. His support, as well as the guidance of Gino Yu, made my time here an unforgettable experience. OK; the work...

Meow Meow AR Cat Game by HK Poly U Students

AR Game by: LIU MingYi, Kelly
ZHANG Zhenyi
LIU Xiaoyu, Sherry

Meow Meow AR Cat Game by HK Poly U Students 2

Poster for Sound Visualization, an AR project by Zhuang Mengzhou, Dai Mingyi, Dong Genggeng, Hu Xianzhi

Thailand: the Institute for Promotion of Teaching Science and Technology has incorporated AR into junior high school science textbooks.(Info kindly provided by Trasvin Jittidecharak/Silkworm Books.)

The following were kindly provided by Fabian Winkler, the Associate Professor of Visual and Performing Arts, at the Electronic and Time-Based Art Program of Purdue University. Professor Winkler's own work can be seen here.

The following presentations were developed within a short period: less than two weeks. They are about the relationship of the markers (image targets) and the AR content they activate.

The following is by Dr. Tomas Laurenzo, who is Assistant Professor at the School of Creative Media of the City University of Hong Kong.

from Singapore

Debbie Ding (http://dbbd.sg / http://openurbanism.blogspot.com

Lecturer, Interaction Design

Module Leader for Final Year Project 1 and Final Year Project 2

A (VR/AR/Haptics+)-based book proposal for agents-like-Lauren-Appleton

Hello literary-agents-like-Lauren-Appleton!

I hope all is well on your side of the interwebtubes! My name is Stephen Black and I have a book proposal that I believe will be of interest to you, one of the publishing companies whom you represent and millions of people interested in visual art, gaming and film-making.

Cinema 8.0 will be a timeless bestselling classic like Towards an Architecture

Towards an Architecture was written during a transitional period in which concrete, preformed materials and Modernism were replacing past paradigms and materials. Cinema 8.0 is being written during a transitional period in which VR, AR, social media and haptics are exploding the concept of "motion pictures".

An artist/producer/writer, I believe my finished text will be factual, inspirational and light-hearted. Just as Corbusier's book is evergreen, so will be mine. (A valuable resource has been this post by Ryan Holiday about the making of Perennial Seller)

Beach Road 360VR film featured at festivals in Singapore, Brisbane and Las Vegas.

SPOKEN Unity-based virtual exhibition, curated by myself, co-produced with Eugene Soh.

Captioned virtual reality scene with two real men in it

Eugene Soh and Stephen Black

i ate tiong bahru A bestseller in Singapore. With. No. Marketing.

I've long lived in Asia, have worked for CNN, Cartoon Network, Fuji TV: writer, director, cameraman, producer. Collected as an artist, published as a photographer.

Here are blog posts that exemplify some of the research that I have done. The theoretical/inspirational components, as well as a chapter outline, can be viewed upon request.

Thank you for your time and consideration literary-agents-like-Lauren-Appleton!

onwARd,

Stephen Black

public section of Engadget Experience 100K grant proposal

Bubiko Foodtour: the world's first AR superstar

I discovered information about Lauren Appleton, and her request for manuscripts, here. I wrote the above with a great deal of respect and, hopefully, in a way that prevents internet search complications or misrepresentations.

Oh yeah...a book cover about immersive environments A working title, now scrapped.

Hatsune Miku virtual character cafe experience

The following article really interested me and I used Google Translate to get the English text below. My desire to work with AR/VR is summarized here, in the public part of a submission for a grant for the 2017 Engadget Experience.

I found this on the KDDi website, where it was labeled as a corporate news release.

KDDI and Krypton realize a cafe date experience with the world's first virtual character

~ Limited time offering "Hatsune Miku" cafe experience possible ~

KDDI Corporation (headquartered in Chiyoda Ward, Tokyo, President and CEO: Koji Tanaka, hereinafter referred to as KDDI) and Krypton Future Media, Inc. (Head office: Hokkaido Sapporo City, President: Hiroyuki Itoh, hereinafter referred to as Krypton) Hideo Miku "cafe experience event (hereinafter this event) will be held at" BLUE LEAF CAFÉ "(Sendai city, Miyagi prefecture) with au SENDAI from 8th to 9th and 15th to 17th July To do.

Both companies signed a basic agreement on service development utilizing AR / VR / MR technology on April 26 this year. Based on the same agreement, this event realizes the world's first trial of a cafe experience with virtual characters (Note 1). The two companies will continue to develop services that utilize technologies such as AR / VR / MR (Note 2) so that they can provide a new experience that combines "Hatsune Miku" and other characters and the real world.

In this event, utilizing Google's Tango technology spatial recognition technology to realize AR experience with 3D camera, it is possible to experience as if Hatsune Miku is sitting in front of you and experiencing a cafe together. In addition, this event is a new window opens The advance application system (lottery) (Note 3) has become.

During the period, "Miku ☆ Sanpo ~ CAFÉ edition ~" is launched on Tango compatible smartphone installed in the table in the space of "BLUE LEAF CAFÉ", "Hatsune Miku" appears in front of you, together with a cafe You can enjoy meals and chatting. A limited-time collaboration menu will also be offered and it is possible to taste the world view of "Hatsune Miku" to its fullest. Part of the sales of the limited time collaboration menu will be donated to support Tohoku reconstruction.

Also, the original "Data Charge Card" (limited quantity) with a plastic card with a visual card used on this event on the face of the card and limited goods of 10th anniversary of Hatsune Miku will be delivered from July 8, 2017 to September 3, 2017, We will sell at au direct shop nationwide.

KDDIとクリプトン、世界初のバーチャルキャラクターとのカフェデート体験を実現

~期間限定で「初音ミク」とのカフェ体験が可能に~

KDDI株式会社 (本社: 東京都千代田区、代表取締役社長: 田中孝司、以下KDDI) と、クリプトン・フューチャー・メディア株式会社 (本社: 北海道札幌市、代表取締役社長: 伊藤博之、以下クリプトン) は、2017年7月8日から9日、15日から17日に、au SENDAI併設の「BLUE LEAF CAFÉ」(宮城県仙台市) で「初音ミク」とカフェ体験ができるイベント (以下、本イベント) を実施します

KDDI株式会社 (本社: 東京都千代田区、代表取締役社長: 田中孝司、以下KDDI) と、クリプトン・フューチャー・メディア株式会社 (本社: 北海道札幌市、代表取締役社長: 伊藤博之、以下クリプトン) は、2017年7月8日から9日、15日から17日に、au SENDAI併設の「BLUE LEAF CAFÉ」(宮城県仙台市) で「初音ミク」とカフェ体験ができるイベント (以下、本イベント) を実施します。

両社は、今年4月26日にAR/VR/MR技術等活用したサービス開発に関する基本合意書を締結しました。本イベントは、同合意書に基づき、バーチャルキャラクターとのカフェ体験という世界初 (注1) の試みを実現するものです。 今後も両社は、「初音ミク」らキャラクターと現実世界が融合した、新たな体験を提供できるよう、AR/VR/MR (注2) 等の技術を活用したサービス開発を進めてまいります。

本イベントでは3DカメラによるAR体験を実現するGoogle社のTangoテクノロジーの空間認識技術を活用し、目の前にあたかも初音ミクが座って一緒にカフェ体験をしているかのような体験が可能です。なお、本イベントは新規ウィンドウが開きます事前申込制 (抽選) (注3) となっております。 期間中、「BLUE LEAF CAFÉ」の専用スペースでテーブルに設置されたTango対応スマートフォンにて「ミク☆さんぽ~CAFÉ edition~」を起動すると、目の前に「初音ミク」が現れ、一緒にカフェでの食事やおしゃべりを楽しめます。期間限定コラボメニューも提供予定となっており、「初音ミク」の世界観を存分に味わうことが可能です。 期間限定コラボメニューの売上の一部は、東北復興支援のため寄付されます。

また、本イベントで使用するビジュアルが券面に描かれたプラスチックカード付きのオリジナル「データチャージカード」(数量限定) と初音ミク10周年の限定グッズを2017年7月8日から9月3日まで、全国のau直営店で販売いたします。

Stelarc: the sound of three hands clapping (#3 in the Haptics series)

Three hands clapping. Maybe the phrase is a cyborg Zen riddle. Maybe it’s not. I can only imagine Stelarc’s reaction upon seeing the phrase. He'll either ignore it and plunge into the heart of the text, or laugh his Aussie-mad-scientist laugh..

This post is casual, a pleasant way to continue my haptics series. So much of writing, art and AR/VR is done in isolation and it is refreshing and important to remember the human side of things. I’m reminded of how unusual the “facts” of my life can be: In Singapore’s Little India, I once had dinner with a man with an ear on his arm.

When I lived in Japan, I was fortunate to document a few of Stelarc’s performances that featured The Third Hand, including his monorail suspension, his "last". Years before that event, I was working in lower Manhattan, not far from where Stelarc suspended himself over 11th Street. Two of my friends rushed in and told me about the “guy who was hanging by fish hooks”. The information caused me to become became pale and deeply confused.

Photo by Toyo Tsuchiya used with permission.

Now, when I meet Stelarc, it is like seeing a dear friend, one who is always stimulating.

Stephen Black as lab rat

effect of low voltage electricity on muscles demonstration

Stelarc ear on arm

LASALLE College of the Arts, Singapore. With Urich Lau and Steve Dixon. My first and only photobomb.

http://www.blacksteps.tv/unlocking-with-ears-stelarc/
man, hat, smartphone and dragonfly

Stelarc recording winged body, by Stephen Black

Stelarc has a piece in SPOKEN, a co-production between myself and Eugene Soh, The Dude. The first part of this series is here.

Cone: Engadget Experience public document

Hello Engadget and Esteemed Judges,

My name is Stephen Black and I am an artist, writer and producer. Cone is a three part project: a VR experience, an AR film experiment and a book. Thank you very much for your time and consideration.

OnwARd,

Stephen Black

Engadget Experience Cone by Stephen Black PDF

AR, VR, ebook icon: Cone

Stephen Black's Cone is a 3 part project proposed for the 2017 Engadget Experience

Engadget Experience STEPHEN BLACK CONE (VR +AR +ebook)

Stephen Black’s Cone is a conceptual, experiential, multidisciplinary artwork: VR, AR, gaming, audio and text. Cone is conscious—and ignorant-- of fine art, dance, music, sound, design, animation, performance art, branding, storytelling, and installation. Cone has three parts: a short VR film experience, an AR experiment with Vance and a book documenting the creation and ideas associated with these two projects. Cone aims to help bridge the gap between artists and technologists.

Stephen Black is an artist, producer and writer. He was creative director of the Monja Kids Creative Development Kit, a 3D gamemaking kit which was successfully launched in Singapore.

Beach Road, Black’s 360 short film co-production with Hiverlab, was featured at film festivals in Brisbane, Singapore and Las Vegas. He curated SPOKEN, a virtual gallery(Unity) built by Eugene Soh. His text was a significant part of Michael Lee’s Office Orchitect installation at the 2011 Singapore Biennale.

Virtual gallery curators at the opening of their exhibition

Glasses in hand, the avatars of Stephen Black and Eugene Soh welcome visitors

Floating balloon dog

Eugene Soh's tribute to Jeff Koons' balloon dog floats over the SPOKEN landscape

VR graphics for game engine project

One of several designs by Roy Chan.

Black has worked for Cartoon Network, CNN, Fox and Fuji TV. He is also the author of several books, including i ate tiong bahru , which is a national bestseller in Singapore. He collaborated text and concepts to Office Orchitect, Michael Lee’s installation at the 2011 Singapore Biennale.

CONE 360 short film will combine butoh, performance art with 360-specific visual and audio techniques.

Ohno spirits

CONE AR will feature Vance, an animated character, and challenges the limits of AR filmmaking/storytelling.

Vance

Secret Donut World by David Severn w/ Stephen Black

CONEMA MANIFESTO (koh-ne-ma, three syllables as in cinema) An ebook combining existing interviews and essays by SB, with documentation of CONE and examples of short stories which lend themselves to 360 cinema.To be given away free during Engadget Experience.

Emgadget Experience documentation

Cover for ebook of Stephen Black's proposed Cone project for the Engadget Experience

Technologies and Products

Google Tango, depth perception visual/shape recognition algorithms, alternatives to image markers or GPS, Matterport, Unity, Vuforia, Android, Samsung, Ossic Sound, technologies that can scan bodies, technologies that link sound files, lipsynch and AI

Total Budget for VR short film experience, AR experience and ebook production, transportation and expenses: $100,000. Item by item breakdown available upon request.

Current topics of research:

http://www.blacksteps.tv/360-videography-what-would-matisse-do/

http://www.blacksteps.tv/the-potential-of-vr-as-a-collage-medium/

http://www.blacksteps.tv/riffs-on-vives-vr-development-bootcamp-at-digipen-part-1/

http://www.blacksteps.tv/mare-vaporum-open-source-video-source-material/

http://www.blacksteps.tv/virtual-reality-for-artists-workshopmichael-naimarkobjectifs/

http://www.blacksteps.tv/with-bubiko-foodtour-at-the-i-love-penang-festival-in-kl/

http://www.blacksteps.tv/haptics-giving-vr-the-finger-1-of-a-series/

http://www.blacksteps.tv/four-examples-of-a-blog-post-display-on-mobile-instant-article/

http://www.blacksteps.tv/red-dot-sad-stories-art-digitalia-2002-2017/

minimal book covers

red dot SAD (Stories Art, Digitalia 2002-2017) book by Stephen Black

http://www.blacksteps.tv/self-portrait-as-a-game/

http://www.blacksteps.tv/facebook-goes-cameramondo/

http://www.blacksteps.tv/vr-what-would-picasso-do-notes-and-links/

Music/audio/performance: 3how

screenshot of video interview on youtube

Stephen Black discusses his books, including Bali Wave Ghost, Obama Search Words and i ate tiong bahru.Reality TV and VR are also briefly discussed. Video by Aquiles Ascension

AR, VR, ebook icon: Cone

Cone. Engadget Experience. Los Angeles 2017

red dot SAD (Stories, Art, Digitalia 2002-2017)

red dot SAD is a collection of stories, essays and images created during Stephen Black's fifteen years in Southeast Asia, mainly in Singapore. An American who has also lived in Tokyo, Manhattan, Hong Kong and Paris, the book documents a creative life that knows no boundaries.

Topics include virtual reality, performance art, network television, food, music, photography, and art projects of all kinds. Physical locations range from an abandoned "haunted" hotel to facilities stacked with IT machinery, from wet markets and beaches to construction sites, the Singapore Biennale, and government built housing complexes. For those interested in Singapore and anyone who enjoys visual arts and well-researched, dynamic writing.

red dot SAD is also an experiment. Presently the book is about 150 pages. Eventually the book will be printed on paper. Those who buy the earlier editions of the ebook receive the updated versions free of charge. For more information on how red dot SAD is re-inventing Amazon and crowdfunding, click here.

To see the current list of topics, click here.

red dot SAD on Amazon

Reviews of i ate tiong bahru, Black's bestselling book are here.

Interviews with Stephen Black and descriptions of his other books are here.

minimal book covers

red dot SAD (Stories Art, Digitalia 2002-2017) book by Stephen Black

The Baby Steps of Bubiko Foodtour

UPDATE: http://www.blacksteps.tv/bubiko-foodtour-update-august-23-2017/

and:

http://www.blacksteps.tv/bubiko-foodtour-ar-superstar-chef-and-photography-guru/

A lot has been happening since this was posted. For example, Bubiko went to the Penang Food Festival in KL.

Bubiko's Instagram is here. Twitter. This past weekend SD(Suitcase Delicious) and I began serious work on the Bubiko Foodtour blog. For now we are using an iPhone and a toy doll, but plans for an original character are underway. Initially we are focusing on the food of Southeast Asia. The posts are entertaining and informative. Augmented reality and 3D animation ideas are also being discussed and refined. For now, we are developing ways to offer value to fans of Bubiko. A new website with a store is being planned. The Bubiko Foodtour blog is here.

a meal of bitter gourd soup

bitter gourd soup

A list of Bubiko's blog posts can be found here.

Bubiko Foodtour on Instagram