DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
Using Smartphones to Research Daily Life
1. Using Smartphones to Research Daily Life
Dr. Neal Lathia
Computer Laboratory, University of Cambridge
neal.lathia@cl.cam.ac.uk
2. “First were mainframes, each shared by
lots of people. Now we are in the
personal computing era, person and
machine staring uneasily at each other
across the desktop. Next comes
ubiquitous computing [...] when
technology recedes into the background
of our lives.”
- Weiser
5. Phone Calls
Text Messages
Social Media
E-mail
Camera
Calendars
Maps
Transport
Games
News
Music
Videos
Communication
Patterns;
Social Networks and
Sharing; Information
Diffusion;
Points of Interest;
Mobility; App Usage
...
9. How can we sense, identify, and
capture high-level behaviours (e.g.,
walking, running) from low-level
sensors (e.g., accelerometer)?
“Classic” Research Question (1):
For ever higher level behaviours
Given energy, computation constraints
10. How can we verify or understand
qualitative aspects of behaviour that
can be sensed (i.e., the why)?
“Classic” Research Question (2):
Choices, feelings, reasons, semantics (e.g., home vs.
lat/lon).
16. Hypothesis
Measure
Test
ESM Design
Ready for the public...
Sensor-Sampling Design
User Experience
Design
Build App
Test App
Deploy App
Market App
Debug App
Update App
Re-design UX
User Support
De-noise data
17.
18. Emotion Sense Basics:
(a) Complete a “long”
survey about how you feel
& your current context
(b) Receive notifications
that ask you to complete a
“short” survey
(c) View how your survey
responses compare to the
sensor data your phone has
collected.
19. Emotion Sense Surveys
(momentary)
Positive/Negative Affect
Day “Goodness”
Current Location
Texting/Calling Habits
Current Activity
Device Interaction
Recent Speech
Personality
Sociability
Connectedness
Engagement
(non-momentary)
Demographics
Satisfaction with Life
Personality
Gratitude
Health
Sociability
Job Satisfaction
Life Aspirations
Connectedness
26. How are people interacting?
– 12,000 interacting users;
– 650,000+ survey responses
– ~6% answer only 1 survey
– ~800 daily user responses
– Average of 60+ days
responding to surveys per
user
– ~15% users > 3 months
– App demographics ~
published Android user
demographics
31. Emotion Sense: Ongoing Work
– Making sense of noisy sensor data: various
devices, time zones, participation lengths
– Analysing quality, content of survey responses
– Investigating the future of these tools:
generalising (for researchers) vs. specialising (for
a particular context).
32. Easy M:
Can I run a study like
Emotion Sense?
(Without going back to the drawing board)
Generalised sensor-
enhanced experience
sampling tool.
33. Easy M Basics:
(a) Enter a “participant
code” to join an experiment;
app reconfigures itself (with
timeout)
(b) Receive notifications
that ask you to complete
your researchers' survey
(c) Volunteer additional
responses
34. Easy M Basics:
Allows for both
“momentary” and
“volunteered” survey types.
Questions include all the
same types as Emotion
Sense.
User feedback is limited to
response time and
compliance.
36. Using Smartphones to Research Daily Life
Dr. Neal Lathia
Computer Laboratory, University of Cambridge
neal.lathia@cl.cam.ac.uk
http://emotionsense.org/
http://www.cl.cam.ac.uk/~nkl25/easym/