Body In Motion week02 -Tracking Body

After calibrating the camera, first thing we have to do is put on tracking suit. A tracking suit consist of shoes cover, gloves, pant and jacket. There are some precautions for wearing this suit.


Tuck your jacket into pants.






The close must be totally tight to your body. If the close is too loose, the reflection spot will move and produce dirty data.







Then, we can start to stick the marker onto the dancer. We can open the create panel and select the skeleton tab on the right side of the window. There will be a 3D body figure reference about where should we put the markers.






The lower marker on the back must align to the mid point of higher marker.

Markers must be place right on the moving joint. And the tips of foot.


After locate the markers, the dancer have to do a T pose and we have to make sure Motive app is tracking total amounts of markers we put on it. After everything are done, we just click “create”.


Design For Live Performance Week02

The Lasso of Truth

Concept sentences of The Lasso of Truth

Short: Lasso of Truth is about the long way to egalitarian. (Lasso of Truth is about how a man can have two wife at the same time)

Long:Lasso of Truth is about how the inventor of wonder woman first experience then reverse the power in between two sex and inspire the descendants toward egalitarian. (Lasso of Truth is about how a men can get girls in this feminism world)

Version of story: Lasso of Truth is about how the inventor of wonder women, his wife and Amazon adjust their moral believe to accommodate their new type of relationship, and afterward inspire descendants to not just feminism but egalitarian.

Elinor Fuchs Questions to The Lasso of Truth.

The play molded into a planet. What is seen?
Space: a house, a comic book store, a place not in real world where is the source of truth with the machine
Time: time before the creation of wonder woman which time goes very fast. time in the comic book store, time goes very slow. time in front of machine, timeless
Climate: warm and humid weather that people my sweat. The weather in front of the machine is cold with clean air.

Mood: it a complicated mood, it’s annoyance wrapped with love. hope and experiment of the break through from the worries toward opinion moral society. it’s belief about what they value
Hidden spaces: I saw there’s a single direction love from Inventor to Amazon, although she said she do love him,too. Another hidden space is the sexuality Identity of the Guy. I’m not mean he is a gay, but he is different.

I hear ambient jazz music in the scene, it’s relax and exciting. I hear chant in front of the machine and then it being distorted

Social world: a world reflect what the machine values. a world inside this world is where these characters live. It’s just like a free space in Greek for people to talk about philosophy. Pure, controlled and experimental.

Changes: When they start to decide their future, who should leave? or stay? They Guy and the Girl are more dedicate and ambiguous on the change. Their position upon the truth flips a couple times and also offer a cue like “you got this point”

Changes In Myself: In a very long time, as a man, I continues feel hostilities from certain portion of feminist, although I did nothing wrong but keep my gentlemen behavior and they are all comes out from true goodwill. I’m also not understand how they ignore the nature difference between genders? However, as the progress of the play. I start to think and ask more questions I was not interested at all.

Theatrical mirrors: I’m not sure…don’t really watch many play before which can mirror to this

Cornell’s Box of The Lasso of Truth

Body In Motion week01 -Calibration

Sync Optitrack System with Unreal Engine
Calibrate Camera in Motive Application
-Mask or move out all the reflective objects in the studio with the map
-Click Calibration Panel on the right side and start wanding until every camera have 10k+ sample
-After wanding, click Calculate button and then Apply button the result.
-Put the ground plane on the floor pointing to the opposite of the screen, and click set the ground plane button in the ground tab.


Setup Rigid Body and Recording Motion Data
-Select the points of a rigid body and right click select “create rigid body”
-Click recording to record motion data or click live to streaming data

Sending Data to Unreal
-Find out the IP address of the PC in terminal which run Motive application
-Create the Optitrack-client in the Unreal, put it in the center of the scene and input the IP of the tracking PC

Add Motion Data to Move GameObject
-Create Optitrack objectset, set both this and the object we want to control as movable.
-Make Optitrack objectset as a parent object(set location of child object 0 in xyz)
-Select the tracking ID(starting from 1)

Click play in the Unreal Engine
Stream or play the motion data from the tracking PC


A World

Design For Live Performance Week01

EFs Visit to a Small Planet

There’s no accident in an play. Nothing occurs “by chance”.

In comparison to what ”the empty space” present a drama is a more organic creature link to our true life, I more like how this article view a play is a well crafted event which may create a seperate time a space. This article offer a wonderful workflow and checklist for a ordinary person to get into the world of play. Moreover, it’s so detail that it almost like offer a framework for people to analysis their life and environment. By figuring out the answer mentioned in the article, we can dissect this planet layer by layer, and also the dynamics between inner-self of one character, between characters, between plays and between director, actor and audiences.

However, when we want to dive deep into the world of theatre more. The empty space supplement the insufficient of  ”EFs Visit to a Small Planet” which is more like a execution manual.

PETER BROOK – The Empty Space

When we talk about theatre but not a single play, we are talking a culture, a paradigm. At this moment, the topic become much more complicated because we are talking a whole ecosystem. The stage, actors, directors, critics, audiences, different theatre systems and even the economics and business. I have to admit that I not totally understand what this book try to convey. The structure is chaotic and transformation among topics so unexpectedly, but I do find lots of interesting points of views and insights.

In the first chapter the deadly theatre, it hard for me to understand how deadly the whole situation is if the writer don’t define the meaning of deadly first. I do agree some issue such as the price for people to participate into this art activities is so hard and the upcoming phenomena, but when He explore how modern theatre being deadly when directors decide to follow the way of tradition training or not, it’s confuse me. It may be the problem of myself from not familiar with the system in different culture such as USSR, French or English.

My favorite two parts of this book are the description of how the entering of audiences will change the play in the chapter “the immediate theatre” and the situation about the actors in first chapter. I had acted in a drama when I was an undergrad student. In practical, I didn’t really experienced the information flow between myself and audience. I’m more more focus into the world created in this play and my counter actors. I’m not sure if it’s because U act in an standard stage or I’m not proficient as an actor. However, theoretically, I do believe the resonance happen in the theatre. Especially I feel so connected with actors when I was an audience.

About the situation about the actors as artists start from page 31. I think this observation interesting that this phenomena happen not in theatre sphere, but other form of art. People, or so called artists get lost in their life. They tried to search and  keep a regular drill on certain direction but still lost at the end.


Nature of Code -EmoChat

Originally, I want to train my own model to do emotion recognition, but I realize it takes too long. Only 10mb data take me 3 hour to train, and not to mention I have 400mb data in total to finish the model.

So I turn to cmltrackr to do the emotion recognition.

To insert a emoji whenever user send a message, I have two work to do. First, I have to capture the html element that Facebook store our message in. Second, I have to make sure when users hit enter key, my insert event goes before the message is sent.

The second is quite complicate because large website like Facebook, they usually separate the the front-end and back-end. When I only insert the emoji to the .innerText, it will only change the view of user, which means the user “can” see there’s an emoji at the end of the message. However, as users hit enter, the emoji disappear at the end of the message, because we don’t really send the Facebook server the a emoji as it listen to our keyboard typing event which we have to simulate. So I have to:
1. Pause the Facebook eventListener which listen to enter key event
2. Remove this eventListener so it won’t block our enter key event simulate bu our code
2. Insert the emoji
3. Simulate the user hit enter key event to send out message
4. Add a new stopEnterKey eventListener so every time people type enter will trigger the insert action again

* The reason why our eventListener goes before the original enter key eventListener is because the bubbling and capturing feature of javascript.

Now this chrome extension can only work partially because chrome browser do not give the extension the permission to access the web cam, so my next step may be write it as an Electron app to listen to laptops’ keyboard event.

Final Project- Flappy Shadow

Final Project

by Tong W,  Kai H

Concept & Reference

    The idea of this  project comes from our childhood memory- shadow puppet. Before we grown up and become more sophisticated to this world , we usually play with and connection meanings and objects with a more creative way. A stick can be a sword of a warrior. A shadow can be a monster hiding in the room. But most of us lose this ability of imagination. In this project, we want to waken people’s early  habit of imagination and revivify the shadow into our living environment.

    Our reference is “The Treachery of Sanctuary” from Chris Milk’s. The installation art takes viewers through three stages of flight through the use of Kinect controllers and infrared sensors. Viewers could come closer to the screen and start waving their hands. The “shadow” of their arms are transformed into two giant wings and move as viewers waving their arms and walk closer toward or further from the screen.


Design & Prototype



    In the original design, we want users can first create a real shadow with their bird gesture, which is the easiest shadow animal gesture. Then, the shadow can fly into the screen become a graphic bird which represent the imagination being vivified. At last, bird goes to the projection and live in the real environment.   

    We choose Kinect sensor, but leap motion or the combination flex sensor and accelerometer as our input sensor is owing to that it have a great range of sensing zone and intuitional experience. For the output, we use overlook viewpoint to mimic the shape of shadow. The bird image is draw by illustrator and animated by P5.js.

    The first problem we faced is the position arrangement of the flashlight, projection and the Kinect. They influence each other and the movement of users.The second problem is the control of Kinect. We spent lots of times to erase the noise when Kinect detect more than one person. At last, we originally want to use three.js to show a 3D bird in the browser but fail.


Technique & Source Code



Intro TO FAB -Enclosure (W4)

For the enclosure assignment this week, I use a candy box with painting of Miyazaki Hayao animation. At first I want to build a noise generator with basic analog circuit which I seen before.

However, I find that the analog isn’t that easy to build. So I turn to build a arduino enclosure, because I can’t really spare more time from the final project. Then I remove the lid of the box.



I build a new lid with acrylic which is done by laser cutter.

Shockingly, I fail to wrap the wire well and it connect together form a short circuit through the metal box. This burn my battery holder, but lucky, this is the only lost to learn this lesson.