Category Archives: AR

A (VR/AR/Haptics+)-based book proposal for agents-like-Lauren-Appleton

Hello literary-agents-like-Lauren-Appleton!

I hope all is well on your side of the interwebtubes! My name is Stephen Black and I have a book proposal that I believe will be of interest to you, one of the publishing companies whom you represent and millions of people interested in visual art, gaming and film-making.

Cinema 8.0 will be a timeless bestselling classic like Towards an Architecture

Towards an Architecture was written during a transitional period in which concrete, preformed materials and Modernism were replacing past paradigms and materials. Cinema 8.0 is being written during a transitional period in which VR, AR, social media and haptics are exploding the concept of "motion pictures".

An artist/producer/writer, I believe my finished text will be factual, inspirational and light-hearted. Just as Corbusier's book is evergreen, so will be mine. (A valuable resource has been this post by Ryan Holiday about the making of Perennial Seller)

Beach Road 360VR film featured at festivals in Singapore, Brisbane and Las Vegas.

SPOKEN Unity-based virtual exhibition, curated by myself, co-produced with Eugene Soh.

Captioned virtual reality scene with two real men in it

Eugene Soh and Stephen Black

i ate tiong bahru A bestseller in Singapore. With. No. Marketing.

I've long lived in Asia, have worked for CNN, Cartoon Network, Fuji TV: writer, director, cameraman, producer. Collected as an artist, published as a photographer.

Here are blog posts that exemplify some of the research that I have done. The theoretical/inspirational components, as well as a chapter outline, can be viewed upon request.

Thank you for your time and consideration literary-agents-like-Lauren-Appleton!

onwARd,

Stephen Black

public section of Engadget Experience 100K grant proposal

Bubiko Foodtour: the world's first AR superstar

I discovered information about Lauren Appleton, and her request for manuscripts, here. I wrote the above with a great deal of respect and, hopefully, in a way that prevents internet search complications or misrepresentations.

Oh yeah...a book cover about immersive environments A working title, now scrapped.

Haptics: Bubiko, Lei Cha and Data Science (Ingredients)

This is the second post in a series in which I have fun with lei cha, haptics and Bubiko. Later, when things are more organized and clear, I hope this catch the interest of data scientists, information specialists and CG filmmakers/animators. There is a fun dimension to all of this, but I seriously wonder what would happen if 1% of the earth's population ate one bowl of lei cha a week...10%? 100% ?What would happen environmentally, economically and to the health of everyone and the planet?

For now, a list of ingredients. In a future post, I will describe the ingredients and add links.If you know some ingredients that I missed, please add them in the comments section. Also, tips on places that make great lei cha are always welcome! Those too, can go in the comments section.

OK...the ingredients.(NOT a recipe)

The tea broth above is from Vege Station in Johor Jaya, one of my favorite places for lei cha.

INGREDIENTS for BROTH

100 gram basil

30 grams cilantro

Some salt

Sweet potato leaves

Broccoli

Garlic

Green beans

Chinese long beans (long-podded cowpeas)

Celery stalks

Basil

Oregano

Acenthopanax trifoliateus

Coriander

Artemisia

Sawtooth

Moringa leaves

Dill

INGREDIENTS FOR BOWL

Dried peeled shrimp

Sautéed meat

Dried tofu

Peanuts

Dried radish

Snow lotus

Ginko

Lotus

Gordon Euryale seeds

Green peas

Job’s tears

Chinese yam

Adzuki

Rice

Jack

Mung or scarlet runner beans

Soybeans

Black soybeans

Millet wheat

Wheat or red wheat

Barley

Buckwheat

Oats

Brown rice

It is likely that there are other ingredients.

Haptics: Bubiko, Lei Cha and Data Science (Finger, Hand and Arm Movements)

This post is a resource, a continuation of my series of posts about haptics . It also references Bubiko Foodtour and builds upon my interest in food as art. By deconstructing and pondering the processes involved in making lei cha, I will create a data base. I hope to find a data scientist and or/data presentation artist who can reveal new things and an interesting structure from the information and experiences collected.

WHAT IS LEICHA?

Lei Cha is also known as thunder tea rice. A tea-based broth is served with a plate or bowl with rice, vegetables, peanuts and other ingredients. The broth can be poured over the other ingredients or the two can be eaten separately. It is a simple food and very healthy. This description will become more detailed later). Usually the name is written as lei cha. The two words mean “pounded tea”.

HAND and ARM MOTIONS FOR MAKING LEI CHA

Handling:

-moving of ingredients

-natural ingredients such as teal leaves, basil and peanuts

- containers: jars, cardboard boxes, plastic boxes, tupperware, bottles

Pounding: the tea leaves are crushed by using a mortar and pestle

Fire creation: hand and arm motions are required to operate the mechanisms of the stove (could include sparking gas to create a flame or turning a knob)

Pouring Notes: This assumes the ingredients are all with one area, there is no need for motions comparable to walking. An overhead diagram is needed Next post: Ingredients

Hatsune Miku virtual character cafe experience

The following article really interested me and I used Google Translate to get the English text below. My desire to work with AR/VR is summarized here, in the public part of a submission for a grant for the 2017 Engadget Experience.

I found this on the KDDi website, where it was labeled as a corporate news release.

KDDI and Krypton realize a cafe date experience with the world's first virtual character

~ Limited time offering "Hatsune Miku" cafe experience possible ~

KDDI Corporation (headquartered in Chiyoda Ward, Tokyo, President and CEO: Koji Tanaka, hereinafter referred to as KDDI) and Krypton Future Media, Inc. (Head office: Hokkaido Sapporo City, President: Hiroyuki Itoh, hereinafter referred to as Krypton) Hideo Miku "cafe experience event (hereinafter this event) will be held at" BLUE LEAF CAFÉ "(Sendai city, Miyagi prefecture) with au SENDAI from 8th to 9th and 15th to 17th July To do.

Both companies signed a basic agreement on service development utilizing AR / VR / MR technology on April 26 this year. Based on the same agreement, this event realizes the world's first trial of a cafe experience with virtual characters (Note 1). The two companies will continue to develop services that utilize technologies such as AR / VR / MR (Note 2) so that they can provide a new experience that combines "Hatsune Miku" and other characters and the real world.

In this event, utilizing Google's Tango technology spatial recognition technology to realize AR experience with 3D camera, it is possible to experience as if Hatsune Miku is sitting in front of you and experiencing a cafe together. In addition, this event is a new window opens The advance application system (lottery) (Note 3) has become.

During the period, "Miku ☆ Sanpo ~ CAFÉ edition ~" is launched on Tango compatible smartphone installed in the table in the space of "BLUE LEAF CAFÉ", "Hatsune Miku" appears in front of you, together with a cafe You can enjoy meals and chatting. A limited-time collaboration menu will also be offered and it is possible to taste the world view of "Hatsune Miku" to its fullest. Part of the sales of the limited time collaboration menu will be donated to support Tohoku reconstruction.

Also, the original "Data Charge Card" (limited quantity) with a plastic card with a visual card used on this event on the face of the card and limited goods of 10th anniversary of Hatsune Miku will be delivered from July 8, 2017 to September 3, 2017, We will sell at au direct shop nationwide.

KDDIとクリプトン、世界初のバーチャルキャラクターとのカフェデート体験を実現

~期間限定で「初音ミク」とのカフェ体験が可能に~

KDDI株式会社 (本社: 東京都千代田区、代表取締役社長: 田中孝司、以下KDDI) と、クリプトン・フューチャー・メディア株式会社 (本社: 北海道札幌市、代表取締役社長: 伊藤博之、以下クリプトン) は、2017年7月8日から9日、15日から17日に、au SENDAI併設の「BLUE LEAF CAFÉ」(宮城県仙台市) で「初音ミク」とカフェ体験ができるイベント (以下、本イベント) を実施します

KDDI株式会社 (本社: 東京都千代田区、代表取締役社長: 田中孝司、以下KDDI) と、クリプトン・フューチャー・メディア株式会社 (本社: 北海道札幌市、代表取締役社長: 伊藤博之、以下クリプトン) は、2017年7月8日から9日、15日から17日に、au SENDAI併設の「BLUE LEAF CAFÉ」(宮城県仙台市) で「初音ミク」とカフェ体験ができるイベント (以下、本イベント) を実施します。

両社は、今年4月26日にAR/VR/MR技術等活用したサービス開発に関する基本合意書を締結しました。本イベントは、同合意書に基づき、バーチャルキャラクターとのカフェ体験という世界初 (注1) の試みを実現するものです。 今後も両社は、「初音ミク」らキャラクターと現実世界が融合した、新たな体験を提供できるよう、AR/VR/MR (注2) 等の技術を活用したサービス開発を進めてまいります。

本イベントでは3DカメラによるAR体験を実現するGoogle社のTangoテクノロジーの空間認識技術を活用し、目の前にあたかも初音ミクが座って一緒にカフェ体験をしているかのような体験が可能です。なお、本イベントは新規ウィンドウが開きます事前申込制 (抽選) (注3) となっております。 期間中、「BLUE LEAF CAFÉ」の専用スペースでテーブルに設置されたTango対応スマートフォンにて「ミク☆さんぽ~CAFÉ edition~」を起動すると、目の前に「初音ミク」が現れ、一緒にカフェでの食事やおしゃべりを楽しめます。期間限定コラボメニューも提供予定となっており、「初音ミク」の世界観を存分に味わうことが可能です。 期間限定コラボメニューの売上の一部は、東北復興支援のため寄付されます。

また、本イベントで使用するビジュアルが券面に描かれたプラスチックカード付きのオリジナル「データチャージカード」(数量限定) と初音ミク10周年の限定グッズを2017年7月8日から9月3日まで、全国のau直営店で販売いたします。

SS2 Night Market Color Studies (Bubiko Food Tour Research)

Bubiko Foodtour is a project which will ultimately involve AR, branding, storytelling and the art of the table. Bubiko Foodtour is now on Instagram, Facebook, twitter and has her own blog. These components are the slow moving tip of the iceberg. The preproduction elements and planning are exciting but invisible. For now, some images from the SS2 Night Market near Kuala Lumpur.

Stelarc: the sound of three hands clapping (#3 in the Haptics series)

Three hands clapping. Maybe the phrase is a cyborg Zen riddle. Maybe it’s not. I can only imagine Stelarc’s reaction upon seeing the phrase. He'll either ignore it and plunge into the heart of the text, or laugh his Aussie-mad-scientist laugh..

This post is casual, a pleasant way to continue my haptics series. So much of writing, art and AR/VR is done in isolation and it is refreshing and important to remember the human side of things. I’m reminded of how unusual the “facts” of my life can be: In Singapore’s Little India, I once had dinner with a man with an ear on his arm.

When I lived in Japan, I was fortunate to document a few of Stelarc’s performances that featured The Third Hand, including his monorail suspension, his "last". Years before that event, I was working in lower Manhattan, not far from where Stelarc suspended himself over 11th Street. Two of my friends rushed in and told me about the “guy who was hanging by fish hooks”. The information caused me to become became pale and deeply confused.

Photo by Toyo Tsuchiya used with permission.

Now, when I meet Stelarc, it is like seeing a dear friend, one who is always stimulating.

Stephen Black as lab rat

effect of low voltage electricity on muscles demonstration

Stelarc ear on arm

LASALLE College of the Arts, Singapore. With Urich Lau and Steve Dixon. My first and only photobomb.

http://www.blacksteps.tv/unlocking-with-ears-stelarc/
man, hat, smartphone and dragonfly

Stelarc recording winged body, by Stephen Black

Stelarc has a piece in SPOKEN, a co-production between myself and Eugene Soh, The Dude. The first part of this series is here.

Cone: Engadget Experience public document

Hello Engadget and Esteemed Judges,

My name is Stephen Black and I am an artist, writer and producer. Cone is a three part project: a VR experience, an AR film experiment and a book. Thank you very much for your time and consideration.

OnwARd,

Stephen Black

Engadget Experience Cone by Stephen Black PDF

AR, VR, ebook icon: Cone

Stephen Black's Cone is a 3 part project proposed for the 2017 Engadget Experience

Engadget Experience STEPHEN BLACK CONE (VR +AR +ebook)

Stephen Black’s Cone is a conceptual, experiential, multidisciplinary artwork: VR, AR, gaming, audio and text. Cone is conscious—and ignorant-- of fine art, dance, music, sound, design, animation, performance art, branding, storytelling, and installation. Cone has three parts: a short VR film experience, an AR experiment with Vance and a book documenting the creation and ideas associated with these two projects. Cone aims to help bridge the gap between artists and technologists.

Stephen Black is an artist, producer and writer. He was creative director of the Monja Kids Creative Development Kit, a 3D gamemaking kit which was successfully launched in Singapore.

Beach Road, Black’s 360 short film co-production with Hiverlab, was featured at film festivals in Brisbane, Singapore and Las Vegas. He curated SPOKEN, a virtual gallery(Unity) built by Eugene Soh. His text was a significant part of Michael Lee’s Office Orchitect installation at the 2011 Singapore Biennale.

Virtual gallery curators at the opening of their exhibition

Glasses in hand, the avatars of Stephen Black and Eugene Soh welcome visitors

Floating balloon dog

Eugene Soh's tribute to Jeff Koons' balloon dog floats over the SPOKEN landscape

VR graphics for game engine project

One of several designs by Roy Chan.

Black has worked for Cartoon Network, CNN, Fox and Fuji TV. He is also the author of several books, including i ate tiong bahru , which is a national bestseller in Singapore. He collaborated text and concepts to Office Orchitect, Michael Lee’s installation at the 2011 Singapore Biennale.

CONE 360 short film will combine butoh, performance art with 360-specific visual and audio techniques.

Ohno spirits

CONE AR will feature Vance, an animated character, and challenges the limits of AR filmmaking/storytelling.

Vance

Secret Donut World by David Severn w/ Stephen Black

CONEMA MANIFESTO (koh-ne-ma, three syllables as in cinema) An ebook combining existing interviews and essays by SB, with documentation of CONE and examples of short stories which lend themselves to 360 cinema.To be given away free during Engadget Experience.

Emgadget Experience documentation

Cover for ebook of Stephen Black's proposed Cone project for the Engadget Experience

Technologies and Products

Google Tango, depth perception visual/shape recognition algorithms, alternatives to image markers or GPS, Matterport, Unity, Vuforia, Android, Samsung, Ossic Sound, technologies that can scan bodies, technologies that link sound files, lipsynch and AI

Total Budget for VR short film experience, AR experience and ebook production, transportation and expenses: $100,000. Item by item breakdown available upon request.

Current topics of research:

http://www.blacksteps.tv/360-videography-what-would-matisse-do/

http://www.blacksteps.tv/the-potential-of-vr-as-a-collage-medium/

http://www.blacksteps.tv/riffs-on-vives-vr-development-bootcamp-at-digipen-part-1/

http://www.blacksteps.tv/mare-vaporum-open-source-video-source-material/

http://www.blacksteps.tv/virtual-reality-for-artists-workshopmichael-naimarkobjectifs/

http://www.blacksteps.tv/with-bubiko-foodtour-at-the-i-love-penang-festival-in-kl/

http://www.blacksteps.tv/haptics-giving-vr-the-finger-1-of-a-series/

http://www.blacksteps.tv/four-examples-of-a-blog-post-display-on-mobile-instant-article/

http://www.blacksteps.tv/red-dot-sad-stories-art-digitalia-2002-2017/

minimal book covers

red dot SAD (Stories Art, Digitalia 2002-2017) book by Stephen Black

http://www.blacksteps.tv/self-portrait-as-a-game/

http://www.blacksteps.tv/facebook-goes-cameramondo/

http://www.blacksteps.tv/vr-what-would-picasso-do-notes-and-links/

Music/audio/performance: 3how

screenshot of video interview on youtube

Stephen Black discusses his books, including Bali Wave Ghost, Obama Search Words and i ate tiong bahru.Reality TV and VR are also briefly discussed. Video by Aquiles Ascension

AR, VR, ebook icon: Cone

Cone. Engadget Experience. Los Angeles 2017

Haptics: Giving VR the Finger (2 of a series)

(The first of my posts on haptics is here. Some posts in this series are technical, some are interviews, some are essays; all are handy and some are touching.)

To truly understand haptics, one must be aware of those glorious, sensitive tools that are always at arm’s length.

Hand performance

from the Mare Vaporum project

"The human hand is an engineering marvel. There is no more impressive example of functional anatomy. It can grab and release, caress and defend. Learn karate, and you can break bricks with it. It’s a mechanism of precision and flexibility. A maestro can play the piano and the violin with the same hand. It’s a way of seeing. Close your eyes, and you can identify almost anything you touch. It’s an organ of sensuality—the fingers have more nerve endings than almost any other part of the body—and an organ of expression and communication. Not for nothing has Dr. Kodi Azari made the hand—its function, its reconstruction, and its transplantation—his life’s work."

hand transplant

hand, transplanted: photo by Michael Lewis for Los Angeles Magazine

“I’m not a religious person, but if there’s any evidence of divine intervention, it has to be the human hand,” he says. “It’s perfect.”

-Amy Wallace writing for Los Angeles Magazine, March 20, 2017. Her article is highly recommended, for anyone. It continues...

Azari, who is 48, is the surgical director of the Hand Transplant Program at UCLA, where he’s worked since 2008. The field is still in its relative infancy. The first hand transplant to achieve prolonged success was performed 18 years ago in Louisville; by 2015, fewer than 85 procedures had been undertaken worldwide. But Azari is at the forefront. He’s traveled the country as one of the lead surgeons in five hand transplants conducted at the University of Pittsburgh and at Johns Hopkins University, including the first double-hand transplant and the first arm transplant performed in the United States. Then, in 2011, he and a team of 16 others did the first hand transplant west of the Rockies, at UCLA. The recipient was Emily Fennell, a 26-year-old single mom who’d lost her right hand in a traffic accident."

The complete article: http://www.lamag.com/longform/the-hollywood-exec-and-the-hand-transplant-that-changed-his-life/ The Hollywood Exec and the Hand Transplant That Changed His Life In just 30 hours, a superfit reality TV producer went from the top of his game to the precipice of death. What happened next would teach him everything about grace, resolve, and the power of love.

Jersey Finger

Gloves in space: this article, from 2009, details some of NASA’s requirements for hand coverings. https://www.newscientist.com/article/dn18166-nasa-seeks-its-one-true-glove/

hand performance

http://www.blacksteps.tv/mare-vaporum-open-source-video-source-material/

TALK TO THE HAND

Haptics: Giving VR the Finger (1 of a series )

Rethink the body for a moment. The skin; the largest organ. The wondrous organs and processes within this sack of flesh, especially the skeletal, muscular and nervous systems. With everything working together, we can do things like jump, speak and button our clothes.

Zooming in on the act of buttoning a shirt, we see a number of interactions. The brain controls muscles related to the eyes, arms and hands. Information about texture and positioning is exchanged between brain and fingers. Muscles and tendons make movements, some obvious, some extremely subtle. Fingertips maneuver the object. Voila! The shirt is buttoned. All parts of the buttoning operation are important. However, from the viewpoint of haptics, the three nerves connected to the fingers deserve a closer look.

The median nerve controls the thumb and wrist. It also gives feeling to the skin around the palm, thumb, middle and index fingers. It runs down the inside of the arm, crosses the front of the elbow and passes through the wrist bones and connective tissue of the carpal tunnel. Compressing the median nerve over a long period can result in carpal tunnel syndrome.

Another nerve, the ulnar nerve, is connected to the muscles that bend the wrist and fingers. It passes behind the elbow. When someone says, “I hit my funny bone”, the correct reply is,”what you are actually saying is that you’ve unexpectedly stimulated your ulnar nerve, resulting in that unusual, wacky tingling sensation”.

Spock rockin' that ulnar nerve/ flexor digitalis superficialis action.

Finally, the radial nerve, which straightens the wrist, thumb and fingers. It gives feeling to the skin on the back of the hand, as well as the index finger, middle finger, and half of the ring finger. Considered by many to be the second most important nerve in the body, the radial nerve is also responsible for bending the elbow.

My interest in haptics is not yet linked to any projects, commercial or artistic. This series of haptics-related blog posts is open-ended, but, the following topics seem likely to follow, in this order: nerve endings, sensors, and haptic-related products. I am especially interested in the intersection of haptics and music. I hope to also again speak with Stelarc about his possible haptics-related projects. I was fortunate to document some of his third hand projects, as well as chat with his prosthetic head. FWIW, I have only knowingly photobombed once:

Stelarc third ear

Stephen Black's first and only photobomb.Stelarc, Uerich Lau, Steve Dixon and ? LASALLE College of the Arts

Black and white photo courtesy of Toyo Tsuchiya, from his No Se No documentation project.

Part two of this series is here.

now

To find out what nownownow is about, visit!

Hello!

I am an American who has experienced Life mainly in Asia, in the areas of art, television production, music, fine art and commercial photography, food, VR and gaming.

I am now combining these experiences and writing books, creating a new portfolio of visual works and finalizing business plans for two startups one VR-based, one AR-based.

I am especially keen to communicate with Unity or Daydream/Android 7.1 people, as well as literary agents, publishers or anyone who has an interest in anything I do.

If I can help anyone in any of the above areas just ask. Or if you just have a question or want to say hi or meet for a meal or just Skype... get in touch!

Now I am in Kuala Lumpur.

I am very excited about Bubiko Foodtour! Always looking for ways to make another 360 "VR" movie like Beach Road, or be involved with another virtual project like SPOKEN.

MUSIC! I have done everything a band member can do except play an instrument! Lee Wen/Seasons Without Seasons. This series of interviews may be of interest. 3how! (Derek Sivers is connected to this post in more ways than one!)

As for my books, I will be happy to send a free ebook to anyone who requests one. If the titles interest you, check for more info on the internet or click here.

The Agaricus blazei Murrill Notebook

Obama Search Words

On Seng Poh Road

Tiong Bahru Blue

Furikake

Contact With Shadow

Bus Stopping

i ate tiong bahru (a best seller in Singapore)

The classic coffee mug reborn with a glassy pop art, postmodern touch

Bali Wave Ghost

red dot SAD

(rdS uses as Amazon as a base for crowdfunding.)

Something Something About VR (the name keeps changing but the contests are essays about VR, AR, digital cinematography and related topics.Some essays are elsewhere on www.blacksteps.tv

Touching JB (finishing late in 2017)

Tiong Bahru Mouth (2018. images, stories and essays)