Tag Archives: VR

Haptics: Bubiko, Lei Cha and Data Science (Ingredients)

This is the second post in a series in which I have fun with lei cha, haptics and Bubiko. Later, when things are more organized and clear, I hope this catch the interest of data scientists, information specialists and CG filmmakers/animators. There is a fun dimension to all of this, but I seriously wonder what would happen if 1% of the earth's population ate one bowl of lei cha a week...10%? 100% ?What would happen environmentally, economically and to the health of everyone and the planet?

For now, a list of ingredients. In a future post, I will describe the ingredients and add links.If you know some ingredients that I missed, please add them in the comments section. Also, tips on places that make great lei cha are always welcome! Those too, can go in the comments section.

OK...the ingredients.(NOT a recipe)

The tea broth above is from Vege Station in Johor Jaya, one of my favorite places for lei cha.

INGREDIENTS for BROTH

100 gram basil

30 grams cilantro

Some salt

Sweet potato leaves

Broccoli

Garlic

Green beans

Chinese long beans (long-podded cowpeas)

Celery stalks

Basil

Oregano

Acenthopanax trifoliateus

Coriander

Artemisia

Sawtooth

Moringa leaves

Dill

INGREDIENTS FOR BOWL

Dried peeled shrimp

Sautéed meat

Dried tofu

Peanuts

Dried radish

Snow lotus

Ginko

Lotus

Gordon Euryale seeds

Green peas

Job’s tears

Chinese yam

Adzuki

Rice

Jack

Mung or scarlet runner beans

Soybeans

Black soybeans

Millet wheat

Wheat or red wheat

Barley

Buckwheat

Oats

Brown rice

It is likely that there are other ingredients.

Haptics: Bubiko, Lei Cha and Data Science (Finger, Hand and Arm Movements)

This post is a resource, a continuation of my series of posts about haptics . It also references Bubiko Foodtour and builds upon my interest in food as art. By deconstructing and pondering the processes involved in making lei cha, I will create a data base. I hope to find a data scientist and or/data presentation artist who can reveal new things and an interesting structure from the information and experiences collected.

WHAT IS LEICHA?

Lei Cha is also known as thunder tea rice. A tea-based broth is served with a plate or bowl with rice, vegetables, peanuts and other ingredients. The broth can be poured over the other ingredients or the two can be eaten separately. It is a simple food and very healthy. This description will become more detailed later). Usually the name is written as lei cha. The two words mean “pounded tea”.

HAND and ARM MOTIONS FOR MAKING LEI CHA

Handling:

-moving of ingredients

-natural ingredients such as teal leaves, basil and peanuts

- containers: jars, cardboard boxes, plastic boxes, tupperware, bottles

Pounding: the tea leaves are crushed by using a mortar and pestle

Fire creation: hand and arm motions are required to operate the mechanisms of the stove (could include sparking gas to create a flame or turning a knob)

Pouring Notes: This assumes the ingredients are all with one area, there is no need for motions comparable to walking. An overhead diagram is needed Next post: Ingredients

Hatsune Miku virtual character cafe experience

The following article really interested me and I used Google Translate to get the English text below. My desire to work with AR/VR is summarized here, in the public part of a submission for a grant for the 2017 Engadget Experience.

I found this on the KDDi website, where it was labeled as a corporate news release.

KDDI and Krypton realize a cafe date experience with the world's first virtual character

~ Limited time offering "Hatsune Miku" cafe experience possible ~

KDDI Corporation (headquartered in Chiyoda Ward, Tokyo, President and CEO: Koji Tanaka, hereinafter referred to as KDDI) and Krypton Future Media, Inc. (Head office: Hokkaido Sapporo City, President: Hiroyuki Itoh, hereinafter referred to as Krypton) Hideo Miku "cafe experience event (hereinafter this event) will be held at" BLUE LEAF CAFÉ "(Sendai city, Miyagi prefecture) with au SENDAI from 8th to 9th and 15th to 17th July To do.

Both companies signed a basic agreement on service development utilizing AR / VR / MR technology on April 26 this year. Based on the same agreement, this event realizes the world's first trial of a cafe experience with virtual characters (Note 1). The two companies will continue to develop services that utilize technologies such as AR / VR / MR (Note 2) so that they can provide a new experience that combines "Hatsune Miku" and other characters and the real world.

In this event, utilizing Google's Tango technology spatial recognition technology to realize AR experience with 3D camera, it is possible to experience as if Hatsune Miku is sitting in front of you and experiencing a cafe together. In addition, this event is a new window opens The advance application system (lottery) (Note 3) has become.

During the period, "Miku ☆ Sanpo ~ CAFÉ edition ~" is launched on Tango compatible smartphone installed in the table in the space of "BLUE LEAF CAFÉ", "Hatsune Miku" appears in front of you, together with a cafe You can enjoy meals and chatting. A limited-time collaboration menu will also be offered and it is possible to taste the world view of "Hatsune Miku" to its fullest. Part of the sales of the limited time collaboration menu will be donated to support Tohoku reconstruction.

Also, the original "Data Charge Card" (limited quantity) with a plastic card with a visual card used on this event on the face of the card and limited goods of 10th anniversary of Hatsune Miku will be delivered from July 8, 2017 to September 3, 2017, We will sell at au direct shop nationwide.

KDDIとクリプトン、世界初のバーチャルキャラクターとのカフェデート体験を実現

~期間限定で「初音ミク」とのカフェ体験が可能に~

KDDI株式会社 (本社: 東京都千代田区、代表取締役社長: 田中孝司、以下KDDI) と、クリプトン・フューチャー・メディア株式会社 (本社: 北海道札幌市、代表取締役社長: 伊藤博之、以下クリプトン) は、2017年7月8日から9日、15日から17日に、au SENDAI併設の「BLUE LEAF CAFÉ」(宮城県仙台市) で「初音ミク」とカフェ体験ができるイベント (以下、本イベント) を実施します

KDDI株式会社 (本社: 東京都千代田区、代表取締役社長: 田中孝司、以下KDDI) と、クリプトン・フューチャー・メディア株式会社 (本社: 北海道札幌市、代表取締役社長: 伊藤博之、以下クリプトン) は、2017年7月8日から9日、15日から17日に、au SENDAI併設の「BLUE LEAF CAFÉ」(宮城県仙台市) で「初音ミク」とカフェ体験ができるイベント (以下、本イベント) を実施します。

両社は、今年4月26日にAR/VR/MR技術等活用したサービス開発に関する基本合意書を締結しました。本イベントは、同合意書に基づき、バーチャルキャラクターとのカフェ体験という世界初 (注1) の試みを実現するものです。 今後も両社は、「初音ミク」らキャラクターと現実世界が融合した、新たな体験を提供できるよう、AR/VR/MR (注2) 等の技術を活用したサービス開発を進めてまいります。

本イベントでは3DカメラによるAR体験を実現するGoogle社のTangoテクノロジーの空間認識技術を活用し、目の前にあたかも初音ミクが座って一緒にカフェ体験をしているかのような体験が可能です。なお、本イベントは新規ウィンドウが開きます事前申込制 (抽選) (注3) となっております。 期間中、「BLUE LEAF CAFÉ」の専用スペースでテーブルに設置されたTango対応スマートフォンにて「ミク☆さんぽ~CAFÉ edition~」を起動すると、目の前に「初音ミク」が現れ、一緒にカフェでの食事やおしゃべりを楽しめます。期間限定コラボメニューも提供予定となっており、「初音ミク」の世界観を存分に味わうことが可能です。 期間限定コラボメニューの売上の一部は、東北復興支援のため寄付されます。

また、本イベントで使用するビジュアルが券面に描かれたプラスチックカード付きのオリジナル「データチャージカード」(数量限定) と初音ミク10周年の限定グッズを2017年7月8日から9月3日まで、全国のau直営店で販売いたします。

Cone: Engadget Experience public document

Hello Engadget and Esteemed Judges,

My name is Stephen Black and I am an artist, writer and producer. Cone is a three part project: a VR experience, an AR film experiment and a book. Thank you very much for your time and consideration.

OnwARd,

Stephen Black

Engadget Experience Cone by Stephen Black PDF

AR, VR, ebook icon: Cone

Stephen Black's Cone is a 3 part project proposed for the 2017 Engadget Experience

Engadget Experience STEPHEN BLACK CONE (VR +AR +ebook)

Stephen Black’s Cone is a conceptual, experiential, multidisciplinary artwork: VR, AR, gaming, audio and text. Cone is conscious—and ignorant-- of fine art, dance, music, sound, design, animation, performance art, branding, storytelling, and installation. Cone has three parts: a short VR film experience, an AR experiment with Vance and a book documenting the creation and ideas associated with these two projects. Cone aims to help bridge the gap between artists and technologists.

Stephen Black is an artist, producer and writer. He was creative director of the Monja Kids Creative Development Kit, a 3D gamemaking kit which was successfully launched in Singapore.

Beach Road, Black’s 360 short film co-production with Hiverlab, was featured at film festivals in Brisbane, Singapore and Las Vegas. He curated SPOKEN, a virtual gallery(Unity) built by Eugene Soh. His text was a significant part of Michael Lee’s Office Orchitect installation at the 2011 Singapore Biennale.

Virtual gallery curators at the opening of their exhibition

Glasses in hand, the avatars of Stephen Black and Eugene Soh welcome visitors

Floating balloon dog

Eugene Soh's tribute to Jeff Koons' balloon dog floats over the SPOKEN landscape

VR graphics for game engine project

One of several designs by Roy Chan.

Black has worked for Cartoon Network, CNN, Fox and Fuji TV. He is also the author of several books, including i ate tiong bahru , which is a national bestseller in Singapore. He collaborated text and concepts to Office Orchitect, Michael Lee’s installation at the 2011 Singapore Biennale.

CONE 360 short film will combine butoh, performance art with 360-specific visual and audio techniques.

Ohno spirits

CONE AR will feature Vance, an animated character, and challenges the limits of AR filmmaking/storytelling.

Vance

Secret Donut World by David Severn w/ Stephen Black

CONEMA MANIFESTO (koh-ne-ma, three syllables as in cinema) An ebook combining existing interviews and essays by SB, with documentation of CONE and examples of short stories which lend themselves to 360 cinema.To be given away free during Engadget Experience.

Emgadget Experience documentation

Cover for ebook of Stephen Black's proposed Cone project for the Engadget Experience

Technologies and Products

Google Tango, depth perception visual/shape recognition algorithms, alternatives to image markers or GPS, Matterport, Unity, Vuforia, Android, Samsung, Ossic Sound, technologies that can scan bodies, technologies that link sound files, lipsynch and AI

Total Budget for VR short film experience, AR experience and ebook production, transportation and expenses: $100,000. Item by item breakdown available upon request.

Current topics of research:

http://www.blacksteps.tv/360-videography-what-would-matisse-do/

http://www.blacksteps.tv/the-potential-of-vr-as-a-collage-medium/

http://www.blacksteps.tv/riffs-on-vives-vr-development-bootcamp-at-digipen-part-1/

http://www.blacksteps.tv/mare-vaporum-open-source-video-source-material/

http://www.blacksteps.tv/virtual-reality-for-artists-workshopmichael-naimarkobjectifs/

http://www.blacksteps.tv/with-bubiko-foodtour-at-the-i-love-penang-festival-in-kl/

http://www.blacksteps.tv/haptics-giving-vr-the-finger-1-of-a-series/

http://www.blacksteps.tv/four-examples-of-a-blog-post-display-on-mobile-instant-article/

http://www.blacksteps.tv/red-dot-sad-stories-art-digitalia-2002-2017/

minimal book covers

red dot SAD (Stories Art, Digitalia 2002-2017) book by Stephen Black

http://www.blacksteps.tv/self-portrait-as-a-game/

http://www.blacksteps.tv/facebook-goes-cameramondo/

http://www.blacksteps.tv/vr-what-would-picasso-do-notes-and-links/

Music/audio/performance: 3how

screenshot of video interview on youtube

Stephen Black discusses his books, including Bali Wave Ghost, Obama Search Words and i ate tiong bahru.Reality TV and VR are also briefly discussed. Video by Aquiles Ascension

AR, VR, ebook icon: Cone

Cone. Engadget Experience. Los Angeles 2017

Haptics: Giving VR the Finger (2 of a series)

(The first of my posts on haptics is here. Some posts in this series are technical, some are interviews, some are essays; all are handy and some are touching.)

To truly understand haptics, one must be aware of those glorious, sensitive tools that are always at arm’s length.

Hand performance

from the Mare Vaporum project

"The human hand is an engineering marvel. There is no more impressive example of functional anatomy. It can grab and release, caress and defend. Learn karate, and you can break bricks with it. It’s a mechanism of precision and flexibility. A maestro can play the piano and the violin with the same hand. It’s a way of seeing. Close your eyes, and you can identify almost anything you touch. It’s an organ of sensuality—the fingers have more nerve endings than almost any other part of the body—and an organ of expression and communication. Not for nothing has Dr. Kodi Azari made the hand—its function, its reconstruction, and its transplantation—his life’s work."

hand transplant

hand, transplanted: photo by Michael Lewis for Los Angeles Magazine

“I’m not a religious person, but if there’s any evidence of divine intervention, it has to be the human hand,” he says. “It’s perfect.”

-Amy Wallace writing for Los Angeles Magazine, March 20, 2017. Her article is highly recommended, for anyone. It continues...

Azari, who is 48, is the surgical director of the Hand Transplant Program at UCLA, where he’s worked since 2008. The field is still in its relative infancy. The first hand transplant to achieve prolonged success was performed 18 years ago in Louisville; by 2015, fewer than 85 procedures had been undertaken worldwide. But Azari is at the forefront. He’s traveled the country as one of the lead surgeons in five hand transplants conducted at the University of Pittsburgh and at Johns Hopkins University, including the first double-hand transplant and the first arm transplant performed in the United States. Then, in 2011, he and a team of 16 others did the first hand transplant west of the Rockies, at UCLA. The recipient was Emily Fennell, a 26-year-old single mom who’d lost her right hand in a traffic accident."

The complete article: http://www.lamag.com/longform/the-hollywood-exec-and-the-hand-transplant-that-changed-his-life/ The Hollywood Exec and the Hand Transplant That Changed His Life In just 30 hours, a superfit reality TV producer went from the top of his game to the precipice of death. What happened next would teach him everything about grace, resolve, and the power of love.

Jersey Finger

Gloves in space: this article, from 2009, details some of NASA’s requirements for hand coverings. https://www.newscientist.com/article/dn18166-nasa-seeks-its-one-true-glove/

hand performance

http://www.blacksteps.tv/mare-vaporum-open-source-video-source-material/

TALK TO THE HAND

Haptics: Giving VR the Finger (1 of a series )

Rethink the body for a moment. The skin; the largest organ. The wondrous organs and processes within this sack of flesh, especially the skeletal, muscular and nervous systems. With everything working together, we can do things like jump, speak and button our clothes.

Zooming in on the act of buttoning a shirt, we see a number of interactions. The brain controls muscles related to the eyes, arms and hands. Information about texture and positioning is exchanged between brain and fingers. Muscles and tendons make movements, some obvious, some extremely subtle. Fingertips maneuver the object. Voila! The shirt is buttoned. All parts of the buttoning operation are important. However, from the viewpoint of haptics, the three nerves connected to the fingers deserve a closer look.

The median nerve controls the thumb and wrist. It also gives feeling to the skin around the palm, thumb, middle and index fingers. It runs down the inside of the arm, crosses the front of the elbow and passes through the wrist bones and connective tissue of the carpal tunnel. Compressing the median nerve over a long period can result in carpal tunnel syndrome.

Another nerve, the ulnar nerve, is connected to the muscles that bend the wrist and fingers. It passes behind the elbow. When someone says, “I hit my funny bone”, the correct reply is,”what you are actually saying is that you’ve unexpectedly stimulated your ulnar nerve, resulting in that unusual, wacky tingling sensation”.

Spock rockin' that ulnar nerve/ flexor digitalis superficialis action.

Finally, the radial nerve, which straightens the wrist, thumb and fingers. It gives feeling to the skin on the back of the hand, as well as the index finger, middle finger, and half of the ring finger. Considered by many to be the second most important nerve in the body, the radial nerve is also responsible for bending the elbow.

My interest in haptics is not yet linked to any projects, commercial or artistic. This series of haptics-related blog posts is open-ended, but, the following topics seem likely to follow, in this order: nerve endings, sensors, and haptic-related products. I am especially interested in the intersection of haptics and music. I hope to also again speak with Stelarc about his possible haptics-related projects. I was fortunate to document some of his third hand projects, as well as chat with his prosthetic head. FWIW, I have only knowingly photobombed once:

Stelarc third ear

Stephen Black's first and only photobomb.Stelarc, Uerich Lau, Steve Dixon and ? LASALLE College of the Arts

Black and white photo courtesy of Toyo Tsuchiya, from his No Se No documentation project.

Part two of this series is here.

now

To find out what nownownow is about, visit!

Hello!

I am an American who has experienced Life mainly in Asia, in the areas of art, television production, music, fine art and commercial photography, food, VR and gaming.

I am now combining these experiences and writing books, creating a new portfolio of visual works and finalizing business plans for two startups one VR-based, one AR-based.

I am especially keen to communicate with Unity or Daydream/Android 7.1 people, as well as literary agents, publishers or anyone who has an interest in anything I do.

If I can help anyone in any of the above areas just ask. Or if you just have a question or want to say hi or meet for a meal or just Skype... get in touch!

Now I am in Kuala Lumpur.

I am very excited about Bubiko Foodtour! Always looking for ways to make another 360 "VR" movie like Beach Road, or be involved with another virtual project like SPOKEN.

MUSIC! I have done everything a band member can do except play an instrument! Lee Wen/Seasons Without Seasons. This series of interviews may be of interest. 3how! (Derek Sivers is connected to this post in more ways than one!)

As for my books, I will be happy to send a free ebook to anyone who requests one. If the titles interest you, check for more info on the internet or click here.

The Agaricus blazei Murrill Notebook

Obama Search Words

On Seng Poh Road

Tiong Bahru Blue

Furikake

Contact With Shadow

Bus Stopping

i ate tiong bahru (a best seller in Singapore)

The classic coffee mug reborn with a glassy pop art, postmodern touch

Bali Wave Ghost

red dot SAD

(rdS uses as Amazon as a base for crowdfunding.)

Something Something About VR (the name keeps changing but the contests are essays about VR, AR, digital cinematography and related topics.Some essays are elsewhere on www.blacksteps.tv

Touching JB (finishing late in 2017)

Tiong Bahru Mouth (2018. images, stories and essays)

Biff “Graybox” Enum: Game Developer

Powerfrog Troopers Revolution Quest 2: The Croak Goes On (100 million units sold). Who wrote it? Me. Is my name on it? No… Tungsten Fortress Golf Romancer III Seventy-five million units. Eight months of my life, a nice chunk of change and another iPhone, but did I get any work because that? NO. Alekhine Defense of Immortal Soccer Regends. Twenty-three million units. Writing nonstop to meet that deadline nearly blinded me, but after launch was my inbox flooded with job offers? No, no and no.

Hi. My name is  Biff Enum and I’m a game designer. “Grayboox “is my middle name and scripting addictive interactive stories is my game.

I”ve contributed to projects that have sold over 585 million cross platform units and yet you’ve never heard of me? Why? Cause I’m a secret agent man. White labellissimo. Ghosty stylee. Incognito.That’s me.

Let’s pretend you are in Kyoto, visiting an “entertainment company” and you are escorted into a room to “have a cup of tea”. You are left alone in a room that looks like the  Videogame Hall of Fame. You correctly sense that if you take a photo, your broken camera and/or body part will remain in the room. Before you can memorize anything, a kawaii OL enters and says,” I am sorry. It is mistake of room, you can drink with tea upstairs. If you mention this room to anyone you will be disemboweled, regardless of your global location. Shall we go?”

My CV is something like that. Guys who are ethically challenged would like to “have a word with me” if I tell anyone about the complete list of projects I’ve worked on. I have been called a “game developer’s game developer” which means my ideas are uncredited and stolen .It’s not always a problem, this whitelabel business. When a clunker like Revenge of Epic of Bloopy Babies falls flat on its face, I’m  search engine safe.

Why do I work so hard for no recognition? Money! I am a narrative artist and since I was a child I wanted to write, with passion, stories that shake and explore the emotional blindspots of people. I want to fundamentally compel them to confront our modern world with all of its contradictions so as to engage better with their fractured lives. My novelistic work is disturbing.The only game I have worked on which references my literary sensibility is Quest of the Galaxy Dancemaster Ninjas.

With the money I’ve earned as a ghostwriter, I am self-publishing a cross-genre novel that combines elements of GTA with an Undine legend, Switezianka, which is about a hunter and a water nymph. Do subscribe to my blog for updates on this unforgettable postmodern tale of fickle love, European women wearing wet clothes, gunfire and ultrahighspeed Pegassi car chases.

Thank you for stopping by.

Biff

VC questions applied to a book and a VR startup

I am presently in Johor Bahru Malaysia, where I am duotasking: writing a book and concluding the research necessary to begin  a VR-related startup. The questions that investors ask are a must for for my startup and an interesting way to look at my book project. The VR section immediately follows the book section.

VC Questions for Touching JB, a book by Stephen Black

What is it?

A 50,00 word book based on the experiences, thoughts and blog posts of Stephen Black, written during an unexpected stay in Johor Bahru, Malaysia in the spring of 2017. Topics and themes include  cultural issues, human relationships, food, comedy, art and virtual reality.

What problem does it solve?

There are no fact-based fiction books about Johor Bahru. As JB continues to gain international recognition, Touching JB will also gain prominence

Competition

There are no comparable books about JB.

Who is making it?

Bestselling author and producer Stephen Black is making it, aided by Book Merah, who made i ate tiong bahru a bestseller in Singapore.

Potential audience?

Ten thousand readers within five years.

What work has been done?

25,000 words have been written. On schedule.

How will it grow?

Book Merah will handle promotion and marketing. The readers of  Black's previous books will be the first group contacted. Once reviews are secured, large scale promotion will begin.

References

Goodreads, Amazon, Art Review Asia, Expat Living Magazine

Schedule

Finish writing in April. E-publishing and promotion to follow immediately.

VC Questions for a VR-related startup being initiated by Stephen Black

Note; Parts of the following are intentionally vague and for now SVRP (Steve’s VR Project) is being used as the project name.

 

What is it?

A Google Daydream app and platform  for nongaming casual VR users.

What problem does it solve?

Entertainment, education, tourism and other industries will have a tool to build audiences with.

Competition

There is, presently, no competition.

Who is making it?

Experienced 3D and gaming producer Stephen Black

Potential audience?

Tens of millions+

What work has been done?

Extensive research, planning and paper grey boxing

How will it grow?

Carefully chosen beta testers, then alpha companies and individuals, freeware

References

Previous projects were successfully used by the Singapore Science Center and the Singapore Ministry of Education

Schedule

Prepare mockup. Find money. Go forth and prosper.

Steve’s VR Startup

I began working with VR in 2002, with a software development kit for children, the CDK. The Creative Development Kit allowed inexperienced children AND serious game developers to create games and projects, using our models and commands. The CDK was studied by the Singaporean Ministry of Education and used in schools throughout Singapore, as well as in the Singapore Science Center. I took a hiatus from VR to write books, one of which has become a best seller in Singapore. I also  began research f0r a book on digital cinematography/VR/art, co-produced/curated SPOKEN, a virtual gallery with Eugene Soh and wrote/co-produced/starred in a 360 short film called Beach Road.

In the middle of 2016, I decided that the time was right for my VR ideas. This blog is filled with posts about research , seminars, meetings etc. I am now refining my pitchdeck for presentation to investors/VCs. I would prefer to bootstrap, but for this company, at this time, that is a challenge that would seem to take a long time to solve.

...................

Here are my replies to some of the basic questions investors want answered:

Potential audience? One billion (yes, that is a 'b')

What work has been done? Extensive pre-production  including: research, research research, paper mockup, paper grey box mockup, troubleshooting  bootcamp with trusted associates, started theoretical command sequences for programmers, UI design(fonts, layout color patterns)

How will it grow? I have compiled a list of personal connections and carefully selected industry leaders (mainly bloggers and journalists). These people would form a base for testing. Additionally, when the time is right, a press release will be sent to the VR media and notification give to VR social media groups. The user base will grow through these channels as well as through word of mouth. Other methods of promotion have been planned.

In addition to meeting a need, the project is fun to use. Though the project is simple and functional, the user experience will feel like the best parts of a five star restaurant, Cirque Soleil and driving a Ferrari.

Business projections: Huge

If you would like to know more or be a beta tester, feel free to get in touch.

Onward!

SB