2. Outline
… learn from people
… a world of data
… the notion of sensing
… raw sensing
… life sensing
… behaviorial information
… social judgment
… contextual awarness
… continuum experience
… living metadata
… ontology
… personal content management
3. Learning Experience
Kolb (1984) model inspired by the work of Kurt
Lewin.
Concrete Reflective
Experience Observation
Abstract
Active
Conceptualisation
Experimentation
4. Learn from people
SAY
EXPLICIT
THINK
DO
OBSERVABLE
USE
KNOW
TACIT AND LATENT
FEEL
DREAM
Source: Sanders (2002)
5. A world of data
Data are often viewed as a lowest level of
abstraction from which information and knowledge
are derived.
Data is usually collected as the result of experience,
observation, experiment or processes within a
computer system and may consist of numbers,
words, or images.
6. The notion of sensing
Aristotle: Traditional five senses: sight, hearing,
touch, smell, taste.
Humans have six additional senses: pain
(nociception), balance (equilibrioception), joint
motion and acceleration (proprioception &
kinesthesia), sense of time, sense of temperature
differences (thermoception), and the sense of
direction (magnetoception).
7. Raw sensing
Localization
Accelerometers
Proximity
Touch
Light
Temperature
Speed
Humidity
Etc.
8. Life Sensing
What if we could sense people's life ??
SMS
Emails
Life Logging + Raw Sensing
Call logging
Phonebook
Pattern
Blogs Extraction
Forums
Social Website
Life Sensing
Galleries
...
Behavior, Social Judgment, Context
9. Life Sensing
Pattern Extraction
Who??
What ??
Recursive Experience
When ??
Where ??
With Whom ??
: Every Sunday, when with my family, at my grandma´s cottage, we
take a traditional family picture and I send it to all the members of
my family.
Source: SeeSaw Adv. 2008
10. Life Sensing
Behaviorial Information
Exhibited by human beings and influenced by
culture, attitudes, emotions, values, ethics,
authority, rapport, hypnosis, persuasion,
coercion and/or genetics.
Geographic
Historic
Associative
Emotive
etc...
11. Life Sensing
Social Judgment
The idea of Social Judgement is that attitude
change is mediated by judgmental processes
and effects used to persuade people.
Personality
Mood
Intelligence
Education
Sincerity
Trustworthiness
Source: Sherif, Sherif, & Nebergall (1965)
12. Life Sensing
Contextual Awareness
Any information that can be used to characterize
the situation of an entity, be it a person, place,
object that is relevant to the interaction between
a user and an application, including themselves.
Self- Awareness
Group- Awareness
World- Awareness
13. Experience
Social
Judgement
Behavior
Contextual
Awareness
Ra w
g
Sen s in
14. Continuum Experience
Raw Sensing
Behavior
Continuum Experience
Social Judgement
Contextual Awareness
Before, Now and After
16. Ontology
“An ontology is an
explicit specification of a
conceptualization”
(Gruber, 1995)
“A conceptualization is a
set of conceptual
relations defined on a
domain space”
Provides ways to define
new relations when
needed and defined in a
detailed manner.
17. Experience- based
Ontology
Upper:
Raw Data, Life
Patterns, Time,
Location
Domain: Task:
Family, Sport, Voice, Conversation,
Tourism, Work... Video, Audio, Photo
Application Ontology
19. Conclusion
Full Sensing potential to enrich multimedia content
Raw sensing
Life sensing
Close the loop
Continuum experience
Living metadata
Experience-based Ontology
Experience-based
PCM