Experiment_04

Computer vision

• Talked with Kyle McDonald
  • My project reminded him of anonymous hugging
  • Suggested testing different ways to max the performance, setting benchmark and see which part costs the most
• Face detection
  • Use small canvas for executing face detection, display the image with big size of canvas.
  • From below test pics you can see, it’s much better to analyze with smaller canvas, but there’s no big difference between displaying big and small canvas, so for better resolution, it seems ok to display bigger canvas.

bigCanvasAnalyze

bigCanvasDisplay

smallCanvasDisplay

Greyscale + Blur

multiple faces detection, yet not stable due to changing lightness

• Collect personal moment as taking photos –> accompany with you all the time to comfort you to confront unknown
• Affecting virtual world

Wireless Wooo

Thanks to Andy‘s advice on hooking up localhost of my laptop through itpsandbox wifi, now I can run codes on mobile phone using laptop as server! (ps. It also works at home, just in NYU because of the security issue, using ITPSANDBOX is needed.)

*Note* It’s not advised to run server elsewhere (e.g. heroku, digitalOcean) because it takes more time to transfer the data back and forth. Localhost with laptop is the best option for proof of concept!

Paper Mache

–> Decide to do it after finalizing the virtual content.

MASK_01 – Control Room

First prototype (or maybe not just a prototype…) of MASK collection – Control Room.

Story

It’s the kind of fantasy castle that a child builds up and role-play inside. The interior is rough and the space is tiny, but with the protection and imaginary friends, you feel less timid to the outside world.

Features

1. It’s a townhouse cardboard mask
2. User is virtually in a cardboard room, and sees the real world through different windows
3. The distance between self and the world is created, thus decreased the threatening feeling
4. When you stay still, imaginary friends start to encourage you

Things I learned

1. For improving performance of phone, reducing face amount
2. Detailed model –> NO, simple yet interesting shape –> YES
3. Texture’s effect is more powerful than model
4. …

Content test:

Imagination friend test

Fabrication process:

Failure

• Normal, discarded cardboard is too thick… have to buy a good thin quality cardboard.

• Scale up for eyeglasses. Too big unfortunately. Width between them will be perfect. One good thing is although the mat board is a little bit heavier, it’s not that big difference.

Experiment_03

Control Room

• The first mask I’m going to make is Control Room. The user is virtually in a small room and sees the world through different windows. It creates a feeling of controlling a robot, which is the physical form of self. The distance between self and the world is created, thus decreased the threatening feeling from outside world.
• It’s also a space for your imaginative friends.
• Possible purposes
  • Although hiding in control room, the user still hope to interact with others. Inside control room is just a way to deal with the social awkwardness
• Appearance: Townhouse
• Verb
  • User
    • Lives daily life, sees through different windows (passive v.)
    • Interacts with imaginative friends (active v.)
      • What kinds of interaction?
  • Others
    • Have few interactions with the user in general
    • Windows and doors invited to be knocked to start conversations –> not like small talk but have certain level of efforts
• Features to have: multi-camera input, prosthetic limbs,

And here’s a video explaining what’s going on.

Touch Event

• Copper tape extension
• For other to trigger sounds, as part of the “An Afternoon Under A Mask” experiment

https://vimeo.com/120315575

But then I found out it’s super finicky if I use multiple ones and extend them T_T

https://vimeo.com/120407665

An Afternoon Under A Mask

– How does it feel to live daily life under a mask exactly? What’s the reaction of others? What do I hope to happen? I’m going to try to answer those questions on Monday(2/23).

Couldn’t do it because the copper tapes are too finicky..

WTF Moment_01

Last night I found out that the idea that “Wearing mask = isolating yourself” is totally wrong. If I really want to isolate myself, I can just escape and hide myself in an empty room. On the moment that I put on the mask, I choose to stay in the environment and deal with it. Wearing mask is not isolating myself. It’s a way to interact with others relaxedly.

WTF.

I spent so much time on thinking about examples based on the “mask = isolate” rule, which is wrong.

WTF.

Oh well. At least I figured it out. Yay.

MASK fantasy

The construction of this MASK fantasy is

1. Purpose of the mask.
2. What does it do?
3. What’s the effect of it to user?
4. What’s the effect of it to the other?

And the symbol ▲ stands for under the category of SHELTER, and ▼ for IDENTITY SHIFT, and ◎ for THE SELECTED (probably).

Temporary result: ▲*5, ▼*6,  ◎*3 (▲*2, ▼*1 )

Here we go!

Block annoying person (ref. tv series Black Mirror) ▲
– Blur face, muffle sound / music volume goes along with the volume of environment noise
– Ignore the person without being noticed, decrease interference
– Able to finish the unaware annoying conversation, maybe irritated because the user is wearing a mask

“I wonder what he/she is doing now?” –> { Duet } ▼
– Geolocation as blinking sphere in virtual world
– Sense of secure, feel the existence of someone under Spatial awareness
– Under the agreement, the participant might feel being watched and surveillance
&
– Change perspective of the other when you want to, shorten the distance
– Less paranoid, less nostalgic, closer relationship
– People will know the user is missing someone

Not be afraid to talk to people/be social –> { Control Room } ▲ ◎
– Virtually in a tiny room, and see world through a window on the wall, like controlling a robot (= your physical body)
– To improve social ability, the wall next to the window having top 5 news of the day for conversation start point
– Can have multiple windows on the wall, and each windows show different views of the world
– The distance between self and the world is created, thus decreased the threatening feeling.
– This is a funny guy. He/she seems know what to say. ???

Be an awesome listener –> { Awesome Listener } ▲ ◎
– Mask speaks for the user with single note yet different tune sound to represent the emotions e.g. “Oh” expresses “Yes”, “No”, “What?”, “Alright”, “Really?”, “Hah”. And the mask is made of mirror
– The user can keep on the conversation nonverbally
– The other has to guess what the user means by listening carefully to the single note sound, and analyzes to comprehend. Might be annoyed because of limited feedback
– Because of the reflection in mirror, and the universal sound as feedback, the other feels like talking to his/her subconscious. The other might have narcissistic moment during the conversations, thus will be attracted by the user

Stop comparing yourself to other people ▼
– Turn everyone “you”, replacing the head image
– Feel like talk to yourself, surprised when “you” say/do something unexpected, exploring the possibilities that you might have those hidden characters as “you”
– The other might has a “murmuring” conversation because the user is talking to “him/herself”

Provide protection from ▲
– Propaganda (of gov policy, commercial)
– Mainstream (fashion e.g. everyone wears black in NYC, brand, music, slang)
– Peer pressure
– For user, easier to maintain who he/she is
– For other, the user seems very unique and weird

Avoid judgement ▲ ◎
– Flash texts or audios to compliment the user, and the mask is made of mirror
– User’s confidence will be boosted up
– The other feels weird to talk to him/herself, might have narcissistic moment during the conversations, thus the other will be attracted by the user

Crave to be liked(as “Like” button of Facebook, opposite to block ppl) –> { Like Me } ▼ ◎
– Buttons on the mask inviting others to press, the user’s vision gets clearer once buttons being pressed, or it’ll gradually blur
– The user has to create conversations and interact with people in order to get clear vision
– The other has incentive to enter the conversation (because of lovely buttons!) and has fun

Story sharing anonymously –> { Anonymous Story  } ▼
– With virtual recording button, user upload the recorded vision and audio, just as writing blog posts. It could be a diary, an instruction, or a fiction of daily life.
– The user creates movies about the user self, effortlessly. And since it’s a POV, point of view shot, the user expresses self anonymously
– It’s an unconditional way to comprehend other by literally taking non-self perspective.

Be animalized to avoid having human emotions ▼
– Provide powers of different animals, flying vision with air fan, hear only small sound, see yourself with mirror rig
– The user express him/herself as the animal, freely. No moral burden as a human
– The other will be surprised by the unusual ability of the user. Might be scared. Might ask to use the user’s superpower

Escape from reality –> { Evasive Wander } ▲
– In virtual world, real world is just a standing screen in a forest, and there are other masked creatures wandering around
– User can isolate self completely in a second, and communicate with other masked creatures. Identify self as a group
– The other might feels the existence of two world, and one of which belongs to the masked people. Difference might be widen, yet the other might want to join the virtual world as well

Train to be used to possible future distorted perception ▼
– Providing experience of Alice in Wonderland Syndrome
– Different kind of distortions let user to externalize the perception. Under the assumption that what he/she sees is not real, the user can repress instinct reaction and makes rational judgement.
– The unusual calmness of the user might terrify the other. Or the other might consult the user’s…

Experiment_02

Mask Iteration

– doodle of mask ideas

– 3D models built in Maya

– Pattern unfold by Pepakura

– Prototyping with paper

– Prototyping with fabric

– Mask iteration display –> Mask Gang

From left to right, dirty design based on the different functions:

• Spikes – being inhuman, scary and aggressive
• ChickenCow – ???
• Box – attached to body, so the mask is hard to take off
• Ears – the sound is magnified by funnels sticking out near the ears,  thus user becomes more aware of the environment around

Virtual World Construction

– doodle of world: 1) Closed, 2) Open

– Coding coding coding….

Production Schedule

Research_02

For deeper thesis research, I first looked more into Nonsense, then on the format – Helmet, and discovered some traces and had some thoughts:

• In this loud, information overloaded, rapid speedy world, people might use nonsense as a way to stand out and be noticeable, thus created this nonsense everywhere phenomenon.
• With a contrary character of hiding the face and being conspicuous, helmet might represent the contradiction/dynamic equilibrium between introversion and extroversion.
• Helmets could be utilized to bring out the good old value of nonsense in current society.

Deeper into Nonsense  

—Different kinds of nonsense in history. Why did they arise? What are they about? What’s the nonsense now? Nonsense used to be able to shock people, yet now it is everywhere. What’s the impact of it currently compared to in the past? Does nonsense still have value?

{ Past }

Cubism

• 1907, Picasso
• instead of depicting objects from one viewpoint, the artist depicts the subject from a multitude of viewpoints
• unhistorical deductions

Dada

• started around 1910
• thinks the logic and reason of bourgeois caused the WWI, so express the rejection by embracing chaos and illogic
• anti-war, anti-art
• a systematic work of destruction and demoralization

Surrealism

• 1920’s
• resolve the previously contradictory conditions of dream and reality
• pure psychic automatism, expressing the subconscious
• Freud’s work with free association, dream analysis, and the unconscious
• aimed to revolutionize human experience

Fluxus

• 1960’s
• blending different artistic media and disciplines
• anti-commercialism and an anti-art sensibility

{ Now }

Frankly, I can’t define what’s the Nonsense is nowaday. But below are what I found related:

Arty Narcissism

“…pretentious, meaningless, tongue twisting nonsense spoken in some artists’ statements. The culprits are mainly the conceptual artists who need to bamboozle you with an attempt at philosophical genius in order to camouflage the insignificance of the poorly executed end product.“

“The contemporary market has been subject to extreme speculation, but there is a difference between speculation and fraud. The economic downturn will moderate the speculative bubble that has seen some less deserving artists command extreme prices.”

Justwalkingism

“A game that you just walk in. It’s not about winning, it’s not about overcoming the challenges, it’s not even about challenges anymore… Justwalkingism is giving you something to go through and what is important is that you actually go through it. You.”

“Justwalkingism is an art movement, meaning that its artists express themselves on many platforms. It’s like colouring books: the outlines are there but the finished piece is still yours to make.”

Helmet/Mask – Interconnection between Nonsense and Introversion

Introvert vs Extrovert (by Carl Jung)

• Introversion: an attitude-type characterised by orientation in life through subjective psychic contents (focus on one’s inner psychic activity)
• Extraversion: an attitude type characterised by concentration of interest on the external object (the outside world)

Mask

• The existence is the clashing of introversion and extroversion
• Identify/Mindset changing
• A shelter / lense / armor to approach the physical world

Some notes/thoughts after reading The Power of Introverts in a World That Can’t Stop Talking

• We have the ability to be whomever we want –> power of free will.
• Because I consider myself as an introvert, be careful DON’T beautify introversion.
• Solitude can be a catalyst to innovation? What about work in a group?
• If introvert and extrovert do complete each others, a person can be a “complete” one, by shifting between introvert and extrovert?

Research_01

Artists – John Baldessari, Bruce Nauman, René Magritte

• long and vague titles
• mixed media
• viewing things with different angles, dimensions
• displays a collection of ordinary objects in an unusual context, giving new meanings to familiar things
• open-ended, making you wonder and be bit a more imaginative for a while
• playing with reality and illusion, constant shifting back and forth
• contradiction, allusion
• provocative, surreal

To me, I’m most impressed about how they reminded me of everyday objects/events, also to view them in different way. Simply altering of angles, locations, combinations, scale, or colors seems to be enough to create big conflicts.

Literature – I LOST MY NOTEBOOK! So to be finished… T_T

Book to read: Philosophy of Nonsense, The Intuitions of Victorian Nonsense Literature.

And this is a part I’m fond of in Alice’s Adventures in Wonderland:

“Who are you?” said the Caterpillar.

This was not an encouraging opening for a conversation. Alice replied, rather shyly, “I—I hardly know, Sir, just at present—at least I know who I was when I got up this morning, but I think I must have changed several times since then.”

“What do you mean by that?” said the Caterpillar, sternly. “Explain yourself!”

“I can’t explain myself, I’m afraid, Sir,” said Alice, “because I’m not myself, you see.”

Subject Matter Projects

Sensory Masks – Lygia Clark (super related<3)

Sensory masks were gas mask-like hoods, that had herbs and aromatic seeds at the end of the “nose” or small mirrors at the location of the eyeholes. Thus the senses of the people that wear them are cut off the external world and a different vision is provided. However, there’s a darker side to the work as well; the masks could be seen as an entrapment, an imprisonment and prohibition of contact with the outer world.

These artifacts force us to rediscover the meaning of our routine gestures, to turn inwards. These objects help to experience rather than to been looked at.

Maxence Parache, Hyper(reality) – Maxence Parache

It uses a Microsoft Kinect to scan your physical environment and display it inside a virtual-reality helmet, so you can rotate the visual angle any way you like, with an Arduino-powered glove equipped with force sensors. In other words, you’re still able to physically interact with all the “real stuff” around you, but you can also pan your “mind’s eye” around the scene separate from your own body, just like you would in a video game.

A Way To Go – Studio AATOAA

It is like a grey squirrel balanced on a branch, fearless. It is a game and a solace and an alarm, a wake-up call to the hazards of today. At a moment when we have access to so much, and see so little, Way to Go will remind you of all that lies before you, within you, in the luscious, sudden pleasure of discovery.

Bonus: Bla Bla.

Augmented Hand Series – Golan Levin, Chris Sugrue, and Kyle McDonald

It is a real-time interactive software system that presents playful, dreamlike, and uncanny transformations of its visitors’ hands. Our investigation takes a position of exploration and wonder. Can real-time alterations of the hand’s appearance bring about a new perception of the body as a plastic, variable, unstable medium? Can such an interaction instill feelings of defamiliarization, prompt a heightened awareness of our own bodies, or incite a reexamination of our physical identities?

Thesis Reconstruct

After talking to Gabe, I knew it’s time to force myself to answer hard question to find the motivation.

Why Nonsense?

The origin of the idea arose from the research of phrase “down the rabbit hole”, leading me to Alice’s Adventures in Wonderland, of Literature Nonsense, which deeply inspired me with its description:

… The nonsense world, on the other hand, has no system of logic, although it may imply the existence of an inscrutable one, just beyond our grasp.

Invisible, obscure logic, ridiculous but not annoyed. Bumping into this kind of things is like having current to flow from bottom to top of my body, and dipping my brain into bubbling soda. Nonsense is an indispensable catalyst to daily life.  Its open-ended character lets imagination grows. It’s how I got inspired and motivated, and I want to create Nonsense too.

Thesis reconstruct

After reviewing previous projects in ITP and seeing repetitive helmet related projects:

• introvert
• because of lack of confidence, afraid of ppl looking at my face (heavy self-awareness)
• shelter / lense / armor to approach world → saver
• as another identity → braver

And asking myself those questions:

• Why ITP? –> Not only animation. Because ITP is more than pure graphics and that excited me a lot, e.g. Puppet class, Codes to make non traditional unchangeable linear animation.
• What did I learn? –> Code; ability to realize the ideas both visually and physically; build stuff based on imagination; be social; quest for deep thoughts and share with others (but still not good at); be insincere; hug; loneliness control
• What should I do but I didn’t? –> Be more social; stop avoiding conversations; stop being too pragmatic to choose classes; social hacking stuff to help ppl conquering social awkwardness
• What do I want to come out with from ITP? –> Dream realization; the method how I conquer social awkwardness; positive impact like a seed; something funny, lighthearted, and weird.

Here I tried to depict a less obscure map for my thesis. Under the realm of Nonsense, I want to make something that will assist introverts approaching this world, and it can also be a channel to providing introversion moments, e.g. being isolated, observant, and analytical. Along with the description of introversion-extraversion on Wiki:

“… Humans are complex and unique, and because introversion-extraversion varies along a continuum, individuals may have a mixture of both orientations. A person who acts introverted in one situation may act extraverted in another, and people can learn to act “against type” in certain situations.”

My project aims to use nonsense contexts to let users experience the introversion, and also the transition between it and extroversion.