Was selected as one of the ITP Resident Research Fellows for AY 2105-16.
Keep moving. Nonstop 🙂
Category Archives: Blog
All my recent posts.
Final – Muscle Sensor for Duet the MASK
WTF Moment_04
Was fabricating my Duet mask,
and someone showed me this
WTFFFFFFF. SO SIMILAR. And it’s fabricated better too!
Have to find a way to make it looks different…
_ / Fighting!!
MASK_04 – Duet
Fourth of MASK collection – Duet
Story
It’s a remedy mask for two people who hesitate to talk to each other. Separated from outside world with the mask, users sit with legs crossed, face to face, and communicate with each other through smiles. It’s for the eager of communicating without seeing each other’s face yet still feeling the intimacy. In the virtual world, users are surrounded by huge monsters, who will help the remediation process.
Features
- Two-people, foldable accordion origami mask
- Portable intimate space
- Self-made surface mounted circuit board as Muscle Sensor * 2
- One for each users
- For detecting the muscle on face. In this scenario, will be used to detect Zygomaticus major muscle, which is associated with smiling
Content Test
Fabrication Process
Small scale paper testing (Thank Origami master Uttam for the help!)
Then use mylar sheet for the final material. Got an angel helper Gladys!
Test putting it on two people! Need to add paper in the bottom part to increase the distance between two users, allowing the space for sitting with legs crossed face to face comfortably
Experiment_06
— CODING —
Hand recognition
- FINALLY working…
- Work good with handfist 🙂 recognition, very finicky with handopen 🙁 recognition
JSARToolkit
- Won’t be used in my project. Just procrastinated like crazy.
- Issues to solve
- Transform position from 2d to 3d
- Recognition stability
muscle sensor schematics
WTF Moment_03
Debug forever and ever yeahhhhhhh.
Too big delta(speed to move the camera), just changing from 0.1 to 0.5
Muscle Sensor MASK version
For my final project in Circuit Design and Prototyping, I plan to make a customized muscle sensor (EMG) for my thesis MASK, and the idea is to use the data as a measurement of mask wearer’s nervousness, and try to cope with it with MASK (virtually and hopefully also physically).
Research
- Tutorials: DIY EEG Circuit, DIY EMG Circuit
- Documents: 1(general introduction ppt), 2(detailed paper), 3(a chapter of a book)
- Products: Sparkfun, Backyard Brains(1, 2, 3[2 channels!])
Breadboarding
This is the first attempt to breadboard the muscle sensor, based on the design of the one on Sparkfun and also the tutorials on instructables. Because I don’t have the component, e.g. instrumentation amp, specific resistors, there are a lot of hacky moves, and I need sticker patch electrodes, 9v batteries*2, and components to know if it’s working or not :/
<– originally thinking to hook up two power supplies, but because it requires one’s positive connecting to another’s negative, I think I should ask Eric first to see if it’s safe to do that instead of using two batteries
Next steps
- Order components (Should I order both surface mount(for final) and through hole(for testing)?)
- Combine and adjust SpikeShield 2-Channel SpikerBox’ schematics, so having two inputs for microcontroller (using ATTINY)
- Design the shape and arrangement of the circuit to fit on the mask
- Qs to answer
- What’s the power supply strategy to integrate microcontroller on the same board, with 9V for sensors and 3~5V for microcontroller?
- …
Getting excited :DDD Lots of work and to be continued!
MASK_03 – Puppet
Third of MASK collection – Puppet
Story
It’s a puppet mask that speaks for you when you are not in the mood of socializing but still wanting to be nice. It also helps you to escape the real world, and provides temporary healthy self-pity for you to enjoy
Features
- Nonverbal communication
- Tunnel between real & virtual world
- Deal with social behaviors for you
- Take you exploring the 100% reality-unrelated world
- Four Corners
- self pity zone
- so many escapees zone
- white noise zone
- connect to other masks
- Four Corners
Content Test
Fabrication Process
Use upholstery foam as paper. Trace the pattern on the foam and cut it.
Glue them with hot glue! Perfect match with foam. Thanks for the tips from awesome Jingwen!
So many hot glue sticks to make a head.
Body without hands and legs yet.
Waiting for elastic band to assemble all together! (Look like a creepy baby)
MASK_02 – Hive
Second of MASK collection – Hive
Story
It’s a community nest that connect people to overcome the distance. During the day, you walk and work as a worker bee. During the night, you come back to the nest and share what you got
Features
- It’s a honeycomb mask
- Two modes (switchable)
-
Resting Mode: User is virtually situated in one cell of the honeycomb
- See and communicate with other people, just like a video conference
- w/ Queen & Baby larvae
-
Working Mode: User is virtually in the air, outside the honeycomb
- Not like in Resting Mode, the camera screen will follow the head, so the user can see and walk
- w/ Worker
-
Resting Mode: User is virtually situated in one cell of the honeycomb
To do:
- Activities & interactions
- Resting Mode – Since it’s about living as a community, what will a community usually do?
- Vote
- Self supply
- Recycle
- Working Mode – Like honeybee, workers go out to collect pollen etc
- Activities of worker bee
- gather pollen into the pollen baskets on their back legs
- create wax for comb
- feed larvae
- guard
- Having a swarm of worker bees with you
- assist you
- protect you
- accompany you
- Activities of worker bee
- Resting Mode – Since it’s about living as a community, what will a community usually do?
- When other people connect to the Hive, the certain cell of the mask will light up, otherwise in “breathing” mode
Content Test
Fabrication
leftover from laser cut
version 1
version 2 – mask
so many combs and mask of Frank! (Thank you Vicci!)