Tag Archives: VR

AR, VR and Every R in Between (July 8, 2018)

(The first day photos are here.)

Taking place during the Maker Faire Hong Kong, was AR, VR and Every R in Between, organized by Dr. Ludovic Krundel, of the Digital Entertainment Lab, School of Design at HK PolyU. Here is a link to bios of some of the people who made the day so interesting. Plus, there was Kandao and SnapPop. Photos by Stephen Black and Bubiko Foodtour.

(The first day photos are here.) A 360VR clip of the event is here.

AR, VR and Every R in Between (July 7, 2018)

Taking place during the Maker Faire Hong Kong, was AR, VR and Every R in Between, organized by Dr. Ludovic Krundel, of the Digital Entertainment Lab, School of Design at HK PolyU. Here is a link to bios of some of the people who made the day so interesting. Plus, there was Kandao and SnapPop. Photos by Stephen Black and Bubiko Foodtour. 360VR video of the event is here!

360VR video of this is here.

Day 2 is here.

AR, VR and Every R in Between

Hello...

Saturday was an absolute blast... and it seems like the best way to "schedule" things for today (Sunday) is to just listen to you(whenever you show up), and then see who is the most appropriate person for you to speak to! SO stop by the Dome and play around with AR, VR , music and the Dome itself. Ask me or Ludovic about anything and we will be happy to share what we know and put you in touch with others who can share as well. Here is what we are about:

The Dome!

神奇的圓屋頂

Located on the 4th floor of Innovation Tower, The Dome features a 360 degree sound system, hand-made speakers and a light show. The Dome is a place of art, technology and communication. Welcome!

剩余字数: 圓屋頂位於創新大廈4樓,擁有360度音響系統、手工製作的音響和燈光秀。它是一個藝術、科技與交流場所!歡迎您的到來!

AR, VR and every R in between!

增強現實,虛擬現實與混合現實!

Experience interactive art, attend short lectures, listen to the blues and spend as much time as you like on computers loaded with a variety of AR & VR software. Coders,"noncoders" and those interested in digital entertainment are welcome. On the fourth floor of Innovation Tower.

體驗互動娛樂,參加講座,聆聽藍調音樂並且並盡情在電腦上體驗各種不同擴增實境和虛擬實境的軟件。無論您是否會編程,只要您對數碼娛樂感興趣,我們都歡迎您的到來!

Stephen Black: AR and VR in 2018, from a maker’s perspective

從製作者的角度看2018的增強現實與虛擬現實

Examples and discussions about AR and VR creation softwares, some of which attendees can experiment with in class and on their own. Plus Beach Road, his VR film and a surprise or two!

在這裡,參加者可以認識并討論製作增強現實和虛擬現實的軟件,更有機會可以親自動手製作一個你自己的作品!

Provide a short profile of presenter... Ex-Cartoon Network, CNN, Fuji TV. Next: a book about AR/entrepreneurship/the food of SE Asia. Then Bubiko Foodtour and Secret Donut World!

之前就任于卡通網絡、CNN、富士電視臺,緊接著成為增強現實/企業家精神/東南亞視頻書籍的作家,最後探索Bubikon美食之旅和秘密甜甜圈世界!

food in Ipoh

Bubiko Foodtour is AR's first superstar.

http://www.deltabluesaudio.com/

Tony Tam: Talking About Speakers, Playing the Blues

Tony Tam makes distinctive, award-winning audio speakers. His company is called Delta Blues Audio.) His speakers are featured in The Dome. This is a rare opportunity to share Tony's knowledge and love for sound, music and the blues.

Biofeedback: Before and After Music

Before listening to music, the participant has a bio-rhythmic record created. Then, after listening to calming music, another record is created. The before and after results are then analyzed.

參加者將被邀請聆聽令人平靜的音樂,同時將被記錄前後兩次生物節奏。我們將帶領您分析這兩項數據!

AR/VR: Artworks and Noteworthy Projects: Curated by Stephen Black

虛擬現實與增強現實:藝術品和令人矚目的作品

On Vive headsets and mobile phone viewing devices. Films and projects by the United Nations, National Public Radio, Stephen Black, Poly U students, Eugene Soh and more. Featuring Storyhive, a new method of VR presentation by Hiverlab.

佩戴Vive頭盔和手機觀影設備;由聯合國、國家公共廣播電台、Stephen Black、香港理工大學學生以及Eugene Soh 等製作的電影和項目。Hiverlab將提供一種新的以Storyhive為特色的虛擬現實的展現形式!

Thanks to Giovanni Lion, for technical support. Gio's on this team: 3dsnd.

Kandao Obsidian Publicity!

Life is exciting sometimes: opportunities suddenly appear: opportunities that can vanish unless we act decisively.

Yesterday, Viki Yuan from Kandao sent me an email outlining the great features on the Obsidian 360 camera, "a beast of quality and speed".

A few months ago, on Facebook, I e-met Laura Lieu from Kandou.

The following is from an an email I sent to Laura a few hours ago. It is Friday night. One week from now, everything must be secured for a successful VR workshop. I hope this great opportunity does not become lost.

Following are excerpts from my email to Laura:

Hello...

This email is about our small world and a huge opportunity for Kandao.

Next weekend is the Maker Faire at HK PolyU.

With Dr. Ludovic Krundel and his team of students, we are doing a two day AR/VR event.

This would be an excellent showcase for the Obsidian. The number of people who can be reached via the internet could be 100,000. Maker Faire predicts 40,000 attendees over the two days. Of course, we are documenting everything: live broadcasts, social media posts and making documentation for reference and promotion purposes.

Kandao would be promoted at a top university, at an international event, with a huge reach. At no cost.

Plus, for several months, Dr. Krundel has been communicating with Jack Tan about using KanDao products at PolyU.

Showcasing the Obsidian next week will be a great opportunity.

We are also premiering Hiverlab's Storylab (full approval and support) and showcasing Styly.

It would be great to have KanDao on board for this dynamic and popular event. Again, no charges... just bring your camera(s)!

Thank you VRy much for your help in trying to make this happen!

Stephen Black

PS I am now contacting media of all kinds. Additionally, I have been in communication with the Hong Kong Virtual Reality Network, who have been interested and supportive.

PSS FWIW, Beach Road, my 360 VR video has been featured at festivals in Las Vegas, Singapore and Brisbane.

Haptics: Bubiko, Lei Cha and Data Science (Ingredients)

This is the second post in a series in which I have fun with lei cha, haptics and Bubiko. Later, when things are more organized and clear, I hope this catch the interest of data scientists, information specialists and CG filmmakers/animators. There is a fun dimension to all of this, but I seriously wonder what would happen if 1% of the earth's population ate one bowl of lei cha a week...10%? 100% ?What would happen environmentally, economically and to the health of everyone and the planet?

For now, a list of ingredients. In a future post, I will describe the ingredients and add links.If you know some ingredients that I missed, please add them in the comments section. Also, tips on places that make great lei cha are always welcome! Those too, can go in the comments section.

OK...the ingredients.(NOT a recipe)

The tea broth above is from Vege Station in Johor Jaya, one of my favorite places for lei cha.

INGREDIENTS for BROTH

100 gram basil

30 grams cilantro

Some salt

Sweet potato leaves

Broccoli

Garlic

Green beans

Chinese long beans (long-podded cowpeas)

Celery stalks

Basil

Oregano

Acenthopanax trifoliateus

Coriander

Artemisia

Sawtooth

Moringa leaves

Dill

INGREDIENTS FOR BOWL

Dried peeled shrimp

Sautéed meat

Dried tofu

Peanuts

Dried radish

Snow lotus

Ginko

Lotus

Gordon Euryale seeds

Green peas

Job’s tears

Chinese yam

Adzuki

Rice

Jack

Mung or scarlet runner beans

Soybeans

Black soybeans

Millet wheat

Wheat or red wheat

Barley

Buckwheat

Oats

Brown rice

It is likely that there are other ingredients.

Haptics: Bubiko, Lei Cha and Data Science (Finger, Hand and Arm Movements)

This post is a resource, a continuation of my series of posts about haptics . It also references Bubiko Foodtour and builds upon my interest in food as art. By deconstructing and pondering the processes involved in making lei cha, I will create a data base. I hope to find a data scientist and or/data presentation artist who can reveal new things and an interesting structure from the information and experiences collected.

WHAT IS LEICHA?

Lei Cha is also known as thunder tea rice. A tea-based broth is served with a plate or bowl with rice, vegetables, peanuts and other ingredients. The broth can be poured over the other ingredients or the two can be eaten separately. It is a simple food and very healthy. This description will become more detailed later). Usually the name is written as lei cha. The two words mean “pounded tea”.

HAND and ARM MOTIONS FOR MAKING LEI CHA

Handling:

-moving of ingredients

-natural ingredients such as teal leaves, basil and peanuts

- containers: jars, cardboard boxes, plastic boxes, tupperware, bottles

Pounding: the tea leaves are crushed by using a mortar and pestle

Fire creation: hand and arm motions are required to operate the mechanisms of the stove (could include sparking gas to create a flame or turning a knob)

Pouring Notes: This assumes the ingredients are all with one area, there is no need for motions comparable to walking. An overhead diagram is needed Next post: Ingredients

Hatsune Miku virtual character cafe experience

The following article really interested me and I used Google Translate to get the English text below. My desire to work with AR/VR is summarized here, in the public part of a submission for a grant for the 2017 Engadget Experience.

I found this on the KDDi website, where it was labeled as a corporate news release.

KDDI and Krypton realize a cafe date experience with the world's first virtual character

~ Limited time offering "Hatsune Miku" cafe experience possible ~

KDDI Corporation (headquartered in Chiyoda Ward, Tokyo, President and CEO: Koji Tanaka, hereinafter referred to as KDDI) and Krypton Future Media, Inc. (Head office: Hokkaido Sapporo City, President: Hiroyuki Itoh, hereinafter referred to as Krypton) Hideo Miku "cafe experience event (hereinafter this event) will be held at" BLUE LEAF CAFÉ "(Sendai city, Miyagi prefecture) with au SENDAI from 8th to 9th and 15th to 17th July To do.

Both companies signed a basic agreement on service development utilizing AR / VR / MR technology on April 26 this year. Based on the same agreement, this event realizes the world's first trial of a cafe experience with virtual characters (Note 1). The two companies will continue to develop services that utilize technologies such as AR / VR / MR (Note 2) so that they can provide a new experience that combines "Hatsune Miku" and other characters and the real world.

In this event, utilizing Google's Tango technology spatial recognition technology to realize AR experience with 3D camera, it is possible to experience as if Hatsune Miku is sitting in front of you and experiencing a cafe together. In addition, this event is a new window opens The advance application system (lottery) (Note 3) has become.

During the period, "Miku ☆ Sanpo ~ CAFÉ edition ~" is launched on Tango compatible smartphone installed in the table in the space of "BLUE LEAF CAFÉ", "Hatsune Miku" appears in front of you, together with a cafe You can enjoy meals and chatting. A limited-time collaboration menu will also be offered and it is possible to taste the world view of "Hatsune Miku" to its fullest. Part of the sales of the limited time collaboration menu will be donated to support Tohoku reconstruction.

Also, the original "Data Charge Card" (limited quantity) with a plastic card with a visual card used on this event on the face of the card and limited goods of 10th anniversary of Hatsune Miku will be delivered from July 8, 2017 to September 3, 2017, We will sell at au direct shop nationwide.

KDDIとクリプトン、世界初のバーチャルキャラクターとのカフェデート体験を実現

~期間限定で「初音ミク」とのカフェ体験が可能に~

KDDI株式会社 (本社: 東京都千代田区、代表取締役社長: 田中孝司、以下KDDI) と、クリプトン・フューチャー・メディア株式会社 (本社: 北海道札幌市、代表取締役社長: 伊藤博之、以下クリプトン) は、2017年7月8日から9日、15日から17日に、au SENDAI併設の「BLUE LEAF CAFÉ」(宮城県仙台市) で「初音ミク」とカフェ体験ができるイベント (以下、本イベント) を実施します

KDDI株式会社 (本社: 東京都千代田区、代表取締役社長: 田中孝司、以下KDDI) と、クリプトン・フューチャー・メディア株式会社 (本社: 北海道札幌市、代表取締役社長: 伊藤博之、以下クリプトン) は、2017年7月8日から9日、15日から17日に、au SENDAI併設の「BLUE LEAF CAFÉ」(宮城県仙台市) で「初音ミク」とカフェ体験ができるイベント (以下、本イベント) を実施します。

両社は、今年4月26日にAR/VR/MR技術等活用したサービス開発に関する基本合意書を締結しました。本イベントは、同合意書に基づき、バーチャルキャラクターとのカフェ体験という世界初 (注1) の試みを実現するものです。 今後も両社は、「初音ミク」らキャラクターと現実世界が融合した、新たな体験を提供できるよう、AR/VR/MR (注2) 等の技術を活用したサービス開発を進めてまいります。

本イベントでは3DカメラによるAR体験を実現するGoogle社のTangoテクノロジーの空間認識技術を活用し、目の前にあたかも初音ミクが座って一緒にカフェ体験をしているかのような体験が可能です。なお、本イベントは新規ウィンドウが開きます事前申込制 (抽選) (注3) となっております。 期間中、「BLUE LEAF CAFÉ」の専用スペースでテーブルに設置されたTango対応スマートフォンにて「ミク☆さんぽ~CAFÉ edition~」を起動すると、目の前に「初音ミク」が現れ、一緒にカフェでの食事やおしゃべりを楽しめます。期間限定コラボメニューも提供予定となっており、「初音ミク」の世界観を存分に味わうことが可能です。 期間限定コラボメニューの売上の一部は、東北復興支援のため寄付されます。

また、本イベントで使用するビジュアルが券面に描かれたプラスチックカード付きのオリジナル「データチャージカード」(数量限定) と初音ミク10周年の限定グッズを2017年7月8日から9月3日まで、全国のau直営店で販売いたします。

Cone: Engadget Experience public document

Hello Engadget and Esteemed Judges,

My name is Stephen Black and I am an artist, writer and producer. Cone is a three part project: a VR experience, an AR film experiment and a book. Thank you very much for your time and consideration.

OnwARd,

Stephen Black

Engadget Experience Cone by Stephen Black PDF

AR, VR, ebook icon: Cone

Stephen Black's Cone is a 3 part project proposed for the 2017 Engadget Experience

Engadget Experience STEPHEN BLACK CONE (VR +AR +ebook)

Stephen Black’s Cone is a conceptual, experiential, multidisciplinary artwork: VR, AR, gaming, audio and text. Cone is conscious—and ignorant-- of fine art, dance, music, sound, design, animation, performance art, branding, storytelling, and installation. Cone has three parts: a short VR film experience, an AR experiment with Vance and a book documenting the creation and ideas associated with these two projects. Cone aims to help bridge the gap between artists and technologists.

Stephen Black is an artist, producer and writer. He was creative director of the Monja Kids Creative Development Kit, a 3D gamemaking kit which was successfully launched in Singapore.

Beach Road, Black’s 360 short film co-production with Hiverlab, was featured at film festivals in Brisbane, Singapore and Las Vegas. He curated SPOKEN, a virtual gallery(Unity) built by Eugene Soh. His text was a significant part of Michael Lee’s Office Orchitect installation at the 2011 Singapore Biennale.

Virtual gallery curators at the opening of their exhibition

Glasses in hand, the avatars of Stephen Black and Eugene Soh welcome visitors

Floating balloon dog

Eugene Soh's tribute to Jeff Koons' balloon dog floats over the SPOKEN landscape

VR graphics for game engine project

One of several designs by Roy Chan.

Black has worked for Cartoon Network, CNN, Fox and Fuji TV. He is also the author of several books, including i ate tiong bahru , which is a national bestseller in Singapore. He collaborated text and concepts to Office Orchitect, Michael Lee’s installation at the 2011 Singapore Biennale.

CONE 360 short film will combine butoh, performance art with 360-specific visual and audio techniques.

Ohno spirits

CONE AR will feature Vance, an animated character, and challenges the limits of AR filmmaking/storytelling.

Vance

Secret Donut World by David Severn w/ Stephen Black

CONEMA MANIFESTO (koh-ne-ma, three syllables as in cinema) An ebook combining existing interviews and essays by SB, with documentation of CONE and examples of short stories which lend themselves to 360 cinema.To be given away free during Engadget Experience.

Emgadget Experience documentation

Cover for ebook of Stephen Black's proposed Cone project for the Engadget Experience

Technologies and Products

Google Tango, depth perception visual/shape recognition algorithms, alternatives to image markers or GPS, Matterport, Unity, Vuforia, Android, Samsung, Ossic Sound, technologies that can scan bodies, technologies that link sound files, lipsynch and AI

Total Budget for VR short film experience, AR experience and ebook production, transportation and expenses: $100,000. Item by item breakdown available upon request.

Current topics of research:

http://www.blacksteps.tv/360-videography-what-would-matisse-do/

http://www.blacksteps.tv/the-potential-of-vr-as-a-collage-medium/

http://www.blacksteps.tv/riffs-on-vives-vr-development-bootcamp-at-digipen-part-1/

http://www.blacksteps.tv/mare-vaporum-open-source-video-source-material/

http://www.blacksteps.tv/virtual-reality-for-artists-workshopmichael-naimarkobjectifs/

http://www.blacksteps.tv/with-bubiko-foodtour-at-the-i-love-penang-festival-in-kl/

http://www.blacksteps.tv/haptics-giving-vr-the-finger-1-of-a-series/

http://www.blacksteps.tv/four-examples-of-a-blog-post-display-on-mobile-instant-article/

http://www.blacksteps.tv/red-dot-sad-stories-art-digitalia-2002-2017/

minimal book covers

red dot SAD (Stories Art, Digitalia 2002-2017) book by Stephen Black

http://www.blacksteps.tv/self-portrait-as-a-game/

http://www.blacksteps.tv/facebook-goes-cameramondo/

http://www.blacksteps.tv/vr-what-would-picasso-do-notes-and-links/

Music/audio/performance: 3how

screenshot of video interview on youtube

Stephen Black discusses his books, including Bali Wave Ghost, Obama Search Words and i ate tiong bahru.Reality TV and VR are also briefly discussed. Video by Aquiles Ascension

AR, VR, ebook icon: Cone

Cone. Engadget Experience. Los Angeles 2017

Haptics: Giving VR the Finger (2 of a series)

(The first of my posts on haptics is here. Some posts in this series are technical, some are interviews, some are essays; all are handy and some are touching.)

To truly understand haptics, one must be aware of those glorious, sensitive tools that are always at arm’s length.

Hand performance

from the Mare Vaporum project

"The human hand is an engineering marvel. There is no more impressive example of functional anatomy. It can grab and release, caress and defend. Learn karate, and you can break bricks with it. It’s a mechanism of precision and flexibility. A maestro can play the piano and the violin with the same hand. It’s a way of seeing. Close your eyes, and you can identify almost anything you touch. It’s an organ of sensuality—the fingers have more nerve endings than almost any other part of the body—and an organ of expression and communication. Not for nothing has Dr. Kodi Azari made the hand—its function, its reconstruction, and its transplantation—his life’s work."

hand transplant

hand, transplanted: photo by Michael Lewis for Los Angeles Magazine

“I’m not a religious person, but if there’s any evidence of divine intervention, it has to be the human hand,” he says. “It’s perfect.”

-Amy Wallace writing for Los Angeles Magazine, March 20, 2017. Her article is highly recommended, for anyone. It continues...

Azari, who is 48, is the surgical director of the Hand Transplant Program at UCLA, where he’s worked since 2008. The field is still in its relative infancy. The first hand transplant to achieve prolonged success was performed 18 years ago in Louisville; by 2015, fewer than 85 procedures had been undertaken worldwide. But Azari is at the forefront. He’s traveled the country as one of the lead surgeons in five hand transplants conducted at the University of Pittsburgh and at Johns Hopkins University, including the first double-hand transplant and the first arm transplant performed in the United States. Then, in 2011, he and a team of 16 others did the first hand transplant west of the Rockies, at UCLA. The recipient was Emily Fennell, a 26-year-old single mom who’d lost her right hand in a traffic accident."

The complete article: http://www.lamag.com/longform/the-hollywood-exec-and-the-hand-transplant-that-changed-his-life/ The Hollywood Exec and the Hand Transplant That Changed His Life In just 30 hours, a superfit reality TV producer went from the top of his game to the precipice of death. What happened next would teach him everything about grace, resolve, and the power of love.

Jersey Finger

Gloves in space: this article, from 2009, details some of NASA’s requirements for hand coverings. https://www.newscientist.com/article/dn18166-nasa-seeks-its-one-true-glove/

hand performance

http://www.blacksteps.tv/mare-vaporum-open-source-video-source-material/

TALK TO THE HAND

Haptics: Giving VR the Finger (1 of a series )

Rethink the body for a moment. The skin; the largest organ. The wondrous organs and processes within this sack of flesh, especially the skeletal, muscular and nervous systems. With everything working together, we can do things like jump, speak and button our clothes.

Zooming in on the act of buttoning a shirt, we see a number of interactions. The brain controls muscles related to the eyes, arms and hands. Information about texture and positioning is exchanged between brain and fingers. Muscles and tendons make movements, some obvious, some extremely subtle. Fingertips maneuver the object. Voila! The shirt is buttoned. All parts of the buttoning operation are important. However, from the viewpoint of haptics, the three nerves connected to the fingers deserve a closer look.

The median nerve controls the thumb and wrist. It also gives feeling to the skin around the palm, thumb, middle and index fingers. It runs down the inside of the arm, crosses the front of the elbow and passes through the wrist bones and connective tissue of the carpal tunnel. Compressing the median nerve over a long period can result in carpal tunnel syndrome.

Another nerve, the ulnar nerve, is connected to the muscles that bend the wrist and fingers. It passes behind the elbow. When someone says, “I hit my funny bone”, the correct reply is,”what you are actually saying is that you’ve unexpectedly stimulated your ulnar nerve, resulting in that unusual, wacky tingling sensation”.

Spock rockin' that ulnar nerve/ flexor digitalis superficialis action.

Finally, the radial nerve, which straightens the wrist, thumb and fingers. It gives feeling to the skin on the back of the hand, as well as the index finger, middle finger, and half of the ring finger. Considered by many to be the second most important nerve in the body, the radial nerve is also responsible for bending the elbow.

My interest in haptics is not yet linked to any projects, commercial or artistic. This series of haptics-related blog posts is open-ended, but, the following topics seem likely to follow, in this order: nerve endings, sensors, and haptic-related products. I am especially interested in the intersection of haptics and music. I hope to also again speak with Stelarc about his possible haptics-related projects. I was fortunate to document some of his third hand projects, as well as chat with his prosthetic head. FWIW, I have only knowingly photobombed once:

Stelarc third ear

Stephen Black's first and only photobomb.Stelarc, Uerich Lau, Steve Dixon and ? LASALLE College of the Arts

Black and white photo courtesy of Toyo Tsuchiya, from his No Se No documentation project.

Part two of this series is here.