SHUHANHUI_ZHUANG_DESMA9_MIDTERM

1. DESMA 9
Art + Science + Technology
Spring 2012
Professor Victoria Vesna
Section 1C
Title:
[Special Contact Lens]
Name: [Shuhanhui Zhuang]

2. ABSTRACT
“I love you but … we do not match”
In a relationship, boys and girls often think in different ways
toward a same thing. Such difference is unavoidable
because male and female are two different kinds of human
beings. Sadly, Countless romances finally break up with
regrets because of a random small quarrel and this makes
the couple reconsider the maintenance of their relationship.
However, if the two people still mentally and deeply love
each other, their love should not be bothered by the natural
differences of thinking.
This project is designed to assist young couples to
understand each other better by wearing a special contact
lens with the use of the technologies of facial expression
recognition, OHMD and “big data”.

3. CONCEPT / TOPIC
I am interested in helping boys to know what his girlfriend is
actually thinking in a relationship. To achieve this goal, I want
to design a contact lens which is a technological combination
of facial expression recognition and big data, and OHMD.
The concept “big data”: A collection of data sets so large and
complex that it becomes difficult to process using on-hand data
base management tools or traditional data processing
applications. The technologies include capture, curation,
storage, search, sharing, transfer, analysis, and visualization.
Facial expression recognition: A various facial motions and
behaviors are based on muscle actions and they moves in a
certain patterns to represent various expressions. By reading
these specific “code”, people’s emotions could be identified
based on their facial changes.
OHMD: An optical head-mounted display is a wearable display
that has the capability of reflecting projected images as well as
allowing the user to see through it.

4. CONTEXT & PRECEDENTS
IBM uses big data technology to enhance the view of its customers.
Extend existing customer views by incorporating additional internal
and external information sources. Gain a full understanding of
customers—what makes them tick, why they buy, how they prefer to
shop, why they switch, what they’ll buy next, and what factors lead
them to recommend a company to others.
Google Glass is a wearable computer with an optical head-mounted
display that is being developed by Google in the Project Glass
research and development project, with a mission of producing a
mass-market ubiquitous computer.
FG
2011
Facial
Expression
Recognition
and
Analysis
Challenge(FERA 2011) is held in conjunction with the IEEE
International conference in Santa Barbara. And the accuracy of facial
expression recognition is about 0.45 nowadays

5. PROJECT PROPOSAL
The contact lens “Love Assistant” is actually a nanometre computer, and its CPU
is supposed to have three major characteristics.
1. The contact lens are able to receive and
record audio and image, and also display
images and words in front of the head of users
as well as allowing the user to see through it.
1
2
2. The contact lens have a backstage
functioning as a cloud storage and cloud
computing with huge amount of data such as
facial expression recognition and tone
identification.
3. The contact lens could identify the
context at the moments it receives any kinds
of information since all the analysis and
decision-making are based on the context.

6. PROJECT PROPOSAL
Words
1.
2.
Contact lens
————— Cloud Storage
Facial Expression —————
[ nanometre computer ] ————— [ Data in past ]
—————
Context
4.
3.
1. Case:
[In a certain context, the girl says something with certain emotions.]
2. Step 1. The words said by the girl, her facial expression and the context at the
moment are projected and recorded into the contact lens.
3. Step 2. The contact lens is a nanometre computer. After gathering the current
information, it begins to upload the words, facial
expression as well as
the girl’s feedbacks to the backstage.
Step 3. *The backstage begins to analyze the data, compares them to the past
ones. And then the backstage projects a feedback on the contact lens
of what the girl really wants to mean beyond the words’ literal
meanings.
Step 4. *The boy says the words given by the backstage to the girl.
Step 5. *The contact lens continue to record the girls feed backs with emotions.

7. Project Proposal (cont.)
5
3
4
As the process happens more times, the
backstage has more data of the girls
words and emotions to analyze, and then
according to the context at the moment, it
will provide more accurate suggestions
for the boy. As the boy become more able
to understand his girlfriend, the
relationship will be more smooth. And
more importantly, the boy does not have
to be struggled as before when he is
trying to figure out what he should really
reply.

8. Conclusion
Communication is the major contributor to affect a romantic relationship. If
the couple can understand each other better, their romance might more
possibly grows to a marriage.
This project is designed to achieve this goal by using technological
method to assist and improve communications between couples. On the
one hand, emotions are the most true language of human beings, and
facial expression recognition technology is a use of science to explore the
art of emotions. On the other hand, thoughts are the most random flows
in minds, and with the use of “big data”, the thoughts could be analyzed
more and more clear according to the contexts. Furthermore, love is the
most beautiful art in the world and now we might possibly use technology
to read it and assist it. Hope in future, there is no “but” after “I love you”.

9. References
1. <http://spie.org/x88964.xml>
2. <http://www.dgp.toronto.edu/~victorng/research.html>
3. <http://www.greenbookblog.org/2012/03/21/big-data-opportunity-or-threat-for-market-research/>
4. <http://www.socialliteracytoday.com/?page_id=74>
5. <http://www.cloudstoragebest.com/cloud-storage-risks-vs-cloud-storage-benefits/>
6. FG 2011 Facial Expression Recognition and Analysis Challenge (FERA2011)
<http://sspnet.eu/fera2011/>
7. “Google Glass” http://en.wikipedia.org/wiki/Google_Glass
8. “5 Game changing big data use cases.” IBM. 2013 <http://www01.ibm.com/software/data/bigdata/use-cases.html>

10. Bibliography / Links
1. “Big Data: The Next Frontier for Innovation, Competition and Productivity.” McKinsey & Company. 2011-5-4
<http://www.mckinsey.com/insights/business_technology/big_data_the_next_frontier_for_innovation>
2. “5 Game changing big data use cases.” IBM. 2013 http://www-01.ibm.com/software/data/bigdata/use-cases.html>
“How Cloud Storage Works.” Jonathan Strickland. 2012 <http://computer.howstuffworks.com/cloud-computing/cloud-storage.htm>
3. “Big Data Transforms Business” EMC2. 2013 <http://www.emc.com/campaign/bigdata/index.htm>
4. “Analytics: The Real-world use of big data” IBM <http://www-935.ibm.com/services/us/gbs/thoughtleadership/ibv-big-data-at-work.html>
5. “Big Data study Reveals Enterprise Attitudes, Engagement, and Challenges.” James E. Powell, 2013-10-22 <http://tdwi.org/articles/2013/10/22/big-datastudy.aspx>
6. “Big Data Study – The 10 Key Findings” TSC, 2013 http://sites.tcs.com/big-data-study/big-data-study-key-findings/
7. “Webinar Replay: What You Can Do With Hadoop: Building Big Data Applications with Hadoop & Spring.” Nikesh Shah, Mark Fisher, James Williams, 2013
<http://spring.io/blog/2013/10/29/webinar-replay-what-you-can-do-with-hadoop-building-big-data-applications-with-hadoop-spring>
8. “'Big data' applications bring new database choices, challenges.” Andy Hayler 2012 <http://www.computerweekly.com/feature/Big-data-applications-bringnew-database-choices-challenges>
9. ” 2014, the year of Big Data applications | #BigDataNYC 2013” Valentia Craft, 2013-10-31 <http://siliconangle.com/blog/2013/10/29/2014-the-year-of-bigdata-applications-bigdatanyc-2013/>
10. “Abhi Mehta on Big Data apps | #BigDataNYC 2013” Maria Deutscher, 2013-10-31 <http://siliconangle.com/blog/2013/10/31/abhi-mehta-on-big-data-appsbigdatanyc-2013/>
11. “Facial expression recognition based on Local Binary Patterns: A comprehensive study.“ Caifeng Shan, Shaogang Gong, Peter W, McOwan. 2009-4-4
<http://www.sciencedirect.com/science/article/pii/S0262885608001844>
12. “Is there universal recognition of emotion from facial expressions?” Russell, James A.
Psychological Bulletin, Vol 115(1), Jan 1994, 102-141. doi: 10.1037/0033-2909.115.1.102
13. “Comparison between geometry-based and Gabor-wavelets-based facial expression recognition using multi-layer perceptron” Zhengyou Zhang ; Inst. Nat.
de Recherche en Inf. et Autom., Sophia Antipolis, France ; Lyons, M. ; Schuster, M. ; Akamatsu, S. 14-16 Apr 1998. 10.1109/AFGR.1998.670990
14. “Comprehensive database for facial expression analysis ” Robotics Inst., Carnegie Mellon Univ., 2000, 10.1109/AFGR.2000.840611
15. “Emotion recognition via facial expression and affective prosody in schizophrenia: A methodological review.
” Jane Edwards, Henry J Jackson, Philippa E Pattison, 2002, <http://www.sciencedirect.com/science/article/pii/S0272735802001307>
16. “Understanding the recognition of facial identity and facial expression.” Andrew J. Calde, Andrew W. Young, 2005-8
<http://www.nature.com/nrn/journal/v6/n8/abs/nrn1724.html>
17. “Impaired recognition of emotion in facial expressions following bilateral damage to the human amygdala” R. Adolphs, D. Tranel,
H. Damasio & A. Damasio, 1994 <http://www.nature.com/nature/journal/v372/n6507/abs/372669a0.html>
18. “Google Glass: what you need to know” By James Rivington, August 8th, <http://www.techradar.com/us/news/video/google-glass-what-you-need-to-know1078114>
19. “Stigma and expressed emotion: a study of people with schizophrenia and their family members in China.” Michael R. P., Veronica Pearson, 2012,
<http://bjp.rcpsych.org/content/181/6/488.short>
20. “SAP Developer Lead: HANA Is Ready To Code Big Data Apps” Adrian Bridgwater, October 24, 2013 <http://www.drdobbs.com/tools/sap-developer-leadhana-is-ready-to-code/240163087>
21. ^ "Google Glasses Sound As Crazy As Smartphones And Tablets Once Did". Forbes. 5 April 2012. Retrieved 5 April 2012.