Category Archives: Blog
All my recent posts.
{Rabbit_Hole}
{currently works with Chrome and Firefox browser}
For the composition assignment the final of Coding for Emotional Impact class, I want to create something with multiple layers and is self-explained. Inspired by the description of computer vision is a rabbit hole from Andy(because I’m learning Three.js by myself recently), I wanted to make a game about “Rabbit Hole”, and my biggest assumption is that everyone is sort of down the rabbit hole.
ps. It’s not really a fun game to play. Still confusing should it be fun to play or just an emotion-building nowhere…
Literary Nonsense- has no system of logic, although it may imply the existence of an inscrutable one, just beyond our grasp.
And below are three snapshots of what I’ve built so far. I made my own models in Maya and drew textures in Photoshop. Can’t view online because of some web-related issue I can’t solve to load the music(SOLVED_by hard coding the url of music file path). But have no ideas how to do the transition from scene to scene…
SCENE_ZERO: http://www.rabbithole.link/
SCENE_ONE: http://www.rabbithole.link/index_D.html
SCENCE_TWO: http://www.rabbithole.link/index_G.html
SCENE_THREE: http://www.rabbithole.link/index_S.html
SCENE_FOUR: http://www.rabbithole.link/index_M.html
SCENE_FIVE: http://www.rabbithole.link/index_T.html
SCENE_SIX: http://www.rabbithole.link/index_F.html
SCENE_SEVEN: http://www.rabbithole.link/index_V.html
SCENE_EIGHT: http://www.rabbithole.link/index_E.html
( Three.js + web stuff ) == super deep rabbit hole.
Rejected(again) Poster Design for ITP Spring Show!
internet_feedbackLoop
Awareness
(3/25_Updated_footage version)
It’s a project of material experiment and mycelium network simulation. The ultimate goal is to pull closer humans’ relationship with fungus, increase awareness, and explore the usage of mycelium by holding workshop and gathering public source.
material experiment
In 2007, Eben Bayer and Gavin McIntyre noticed mycelium’s self-assembling glue-like character. By growing mycelium with agricultural byproducts, they discovered a biological, durable, and compostable material that performs, and they found a company called ecovatice. Their products are pressed with pressure during production, and are thick, chunky, and volumetric. Inspired by artist Eric Klarenbeek‘s 3D printed case with straw, I guessed as long as I follow the principle that “mycelium digests nutrient and water and grows harder”, the process of production can be free-formed and without boundary. So I gave it a try.
For the blender part, the ratio of mycelium+straw & water is approximately 2:1.
Hang the balls in a separated area in order to avoid be contaminated. And after 3~5 days the ball will become obvious white, showing the growing of mycelium.
After 10 days, harvest the balls and pop the balloons, and voila!
Put them aside and dry their interiors for a day(because they were blocked by the balloon).
mycelium network
I’m also interested in how mycelium communicates with each others. The roots of most land plants are colonised by mycorrhizal fungi that provide mineral nutrients in exchange for carbon, and based on “Underground signals carried through common mycelial networks warn neighbouring plants of aphid attack” on Ecology Letter, by Zdenka Babikova, Lucy Gilbert, Toby J. A. Bruce,3 Michael Birkett, John C. Caulfield, Christine Woodcock, John A. Pickett and David Johnson, mycorrhizal mycelia can also act as a conduit for signaling between plants, acting as an early warning system for herbivore attack.
The experiment is based on the fact that Vicia Faba will emit plant volatiles, particularly methyl salicylate, making this bean plants repellent to aphids but attractive to aphid(bugs) enemies such as parasitoids. It sets up 5 Vicia Faba, having only one of them attacked by aphids, and having it either connected to other plants with roots or without roots, with mycelium or without mycelium(as picture right above). And the result(as picture left above) shows that the plants, which are connected to the Donor(infested w/ aphids) by mycelium, act same as the Donor, producing volatiles to repel aphids and attract aphids’ enemy. It means This underground messaging system allows neighboring plants to invoke herbivore defenses before attack.
It interests me a lot, and I want to use it as the content to inform people about the amazing behavior of fungus by visualizing the network of mycelium. The idea is–>
- when there’s no one around, the mycelium bulb will breathe in its own pattern, presenting w/ LEDs, and there is a video playing footages of fungus & mycelium life.
- once someone comes near, the mycelium bulbs will communicate with each other, lighting up and off one by one, and the video will change to broadcast the human-related footages(e.g. garbage, oil spill, and mycoremediation).
footage Breathing, password: fungus
footage Aware, password: fungus
And here are my Arduino code. I wrote digitalWrite into PMW pins.
//#include <LED.h>
#include <NewPing.h>
#define TRIGGER_PIN 8
#define ECHO_PIN 7
#define MAX_DISTANCE 30
//for ultrasonic sensor
NewPing sonar(TRIGGER_PIN, ECHO_PIN, MAX_DISTANCE);
int value;
int interval; //to trigger the change of LEDs
//for smoothing
const int numReadings = 5;
int readings[numReadings];
int oriReading;
int index = 0;
int total = 0;
int average = 0;
//pin
int ledPins[] = {
3,5,6,9,10,11 };
int lastFade[6] = {
0};
int level[] = {
10, 23, 45, 50, 100, 205};
//output
int maxV = 220;
int minV = 5;
//slope & intercept
double ain[6], bin[6], aex[6], bex[6];
//time
double inTime[] = {
1500, 1700, 1900, 2000, 2100, 2300};
double pauseTime[] = {
350, 400, 450, 500, 550, 600};
double outTime[] = {
2000, 2200, 2400, 2500, 2600, 2800};
double thirdT[6], cycleT[6];
double levels[6];
boolean lightUp[6];
int awareTime[] = {
0, 1, 2, 3, 4, 5};
int awareOriTime[] = {
0, 1, 2, 3, 4, 5};
void setup() {
Serial.begin(9600);
//smoothing
for(int i=0; i<numReadings; i++){
readings[i] = 0;
}
for(int i=0; i<6; i++) {
pinMode(ledPins[i], OUTPUT);
thirdT[i] = inTime[i] + pauseTime[i];
cycleT[i] = inTime[i] + pauseTime[i] + outTime[i];
ain[i] = (maxV - minV)/inTime[i];
bin[i] = minV;
aex[i] = (minV - maxV)/outTime[i];
bex[i] = maxV - aex[i]*(inTime[i]+pauseTime[i]);
lightUp[i] = false;
}
}
unsigned long tstart[6];
double time;
void loop() {
//ultrasonic sensor
oriReading = sonar.ping();
value = (int) oriReading/US_ROUNDTRIP_CM;
for(int thisChannel=0; thisChannel<6; thisChannel++) {
//if detect ppl, all light up
if(value > 0) {
//if time can be dividable by 60
if ( (awareTime[thisChannel])%6 == 0 ) {
lightUp[thisChannel] = !lightUp[thisChannel];
}
if(lightUp[thisChannel] == true)
levels[thisChannel] = 255;
else
levels[thisChannel] = 0;
analogWrite(ledPins[thisChannel], levels[thisChannel]);
//determin whether to restart the cycle of time
awareTime[thisChannel] += 1;
if( awareTime[thisChannel] >= (180) )
awareTime[thisChannel] = awareOriTime[0];
}
//if not, do LED pattern
else {
if (lastFade[thisChannel] <= inTime[thisChannel]) {
levels[thisChannel] = int( ain[thisChannel]*lastFade[thisChannel] + bin[thisChannel] );
}
else if (lastFade[thisChannel] <= thirdT[thisChannel]) {
levels[thisChannel] = maxV;
}
else {
levels[thisChannel] = int( aex[thisChannel]*lastFade[thisChannel] + bex[thisChannel] );
}
analogWrite(ledPins[thisChannel], levels[thisChannel]);
delay(1);
//determin whether to restart the cycle of time
if(lastFade[thisChannel] >= cycleT[thisChannel]) {
lastFade[thisChannel] = 0;
tstart[thisChannel] = millis();
}
else {
lastFade[thisChannel] = millis() - tstart[thisChannel];
}
}
}
}
And my Processing code to switch footages based on the Serial signal got from Arduino.
import processing.serial.*;
import processing.video.*;
import java.awt.MouseInfo;
import java.util.Arrays;
import java.util.Collections;
import java.awt.Rectangle;
Movie aware;
Movie grow;
boolean playGrow = true;
Serial myPort;
void setup() {
size(displayWidth, displayHeight);
if (frame != null) {
frame.setResizable(true);
}
background(0);
// Load and play the video in a loop
aware = new Movie(this, "aware_2.mp4");
grow = new Movie(this, "grow_v2.mp4");
aware.loop();
grow.loop();
// println(Serial.list());
String portName = Serial.list()[5];
myPort = new Serial(this, portName, 9600);
}
void movieEvent(Movie m) {
m.read();
}
void draw() {
if(playGrow)
image(grow, 0, 0, width, height);
else
image(aware, 0, 0, width, height);
}
void serialEvent (Serial myPort) {
int inByte = myPort.read();
println(inByte);
if (inByte > 10)
playGrow = false;
else
playGrow = true;
}
void keyPressed() {
if(key == '1')
playGrow = true;
if(key == '2')
playGrow = false;
}
int mX;
int mY;
boolean sketchFullScreen() {
return true;
}
void mouseDragged() {
frame.setLocation(
MouseInfo.getPointerInfo().getLocation().x-mX,
MouseInfo.getPointerInfo().getLocation().y-mY);
}
public void init() {
frame.removeNotify();
frame.setUndecorated(true);
frame.addNotify();
super.init();
}
For further development, I’m thinking about maybe cooperate with Kate‘s “mushroom craft” and have some craft workshops! After all the process of making those mycelium light bulbs, I’ve been through the fabrication works which I’ve never tried before, and it felt great! I think direct “Hand” touch is the most effective way to pull closer the relationship between people and materials.
By starting the production from searching and growing the material, we can appreciate more about the resource we take from nature and also be more aware about the environmental issues. Not just sitting there receiving the news from TV, but actually caring and being aware of it because you feel it affecting the fabrication process directly. Maker/Crafter spirit is one of the answer to the future.
css update: Healthy Movie Night
One page web-fantasy UPDATE! GO PLAY.
- Type in the movie you’re going to see.
- Type in the food you’re going to eat.
- Choose which exercise you’re going to take.
- Type in your weight, in kg or lbs.
- Base on the duration of movie, the calories of the food, the amount of calories born in certain exercise, and your weights, Healthy Movie Night gives you back how much food you can eat without worrying gaining any weights!
e.g. “The Grand Budapest Hotel”, pizza, Jog in Water, 51kg.

e.g. “Wanted”, spaghetti, fishing, 51kg.

Timing and Pacing
For this week’s subject Timing and Pacing, I chose “No Safe-House” in the soundtrack of The Grand Budapest Hotel to decode.
effect I intend to achieve
–> emotion accumulation, cheerful and narrative.
notes
- library I used for camera in 3D –> http://mrfeinberg.com/peasycam/#about
- using PShape to store the tetrahedron I made and set their movements with trigonometry functions, noise, hsl, and hard-coding frameCount!!!(see how long and tedious my codes are :P)
- issues to work on, since I used frameCount, it’s different all the time, depending how fast my computer run. need to use millis() next time!
- next step will be using library Minim to generate the patterns directly from the analysis of sound file.
codes
Roofwing
A flying + walking, surreal experience design for rooftop. Work done with amazing John.
It’s all start from an assignment in the class Spatial Media, with specific requirement as below:
+ be site specific (i.e. be designed for an actual location)
+ be designed for use by more than one person
+ involve a horizontal surface
START FROM SPACE
Because we wanted the experience to be strongly connected with space, we developed the idea starting from space. We chose rooftop because its exciting yet rusted characters, and we thought it has the potential to be a relaxing playground for citizens, especially for cities with limited space.
CONCEPT
+ Utilize the height and windy characters directly from space
+ Cooperate with your teammates to maximize and exaggerate the excitement
SWINGS PRODUCTION(making miniature!)
+ woods
+ necklace chains & rings
+ thin hemp rope
+ webcam
+ monitor
+ white board
TECHNIQUES
+ Openframeworks
+ videoGrabber
+ videoPlayer
+ color detection
+ image sequences
+ soundPlayer
Swing range test
Infinite Loop
This is one of the amazing beautiful mistake with the infinite loop between monitor showing what camera capturing and camera capturing monitor.
HOW IT WORKS
+ Team A & Team B
+ swing people*5 need to cooperate to swing as high as they can to shoot out the strong thunder, or either weak thunder or NO thunder will be shoot out(different thunder sound effects).
+ people in the center can block the thunders by stepping on them(scoring sound effect + spark sequence), so two team have to try to rope in the people in the center
+ once thunders reach the other side, strong thunder gets 2 scores, weak thunder gets 1 score.
+ SWING OR DIE.
Noise3D
Processing first 3D attempt, using sin, cos, tan and noiseDetail(octaves, fallOff) to control the movement and spinning. No physical interaction, but just single objects follow their individual pathes.
Codes






































