This is my Mobile Health 2010 (#mh2010) talk that I gave on May 24th for the session: "The Sweet Spot of Behavior Change via Mobile Devices."
I use lots of animations, so I strongly encourage you to download the PowerPoint pptx here:
http://www.cs.washington.edu/homes/jfroehli/talks.html
Maybe add in social persuasion here?Maybe write on arrow instead?
So, from a technology perspective, there’s two things going on here: (1) we have a sensing system that can track location and infer particular decision moments and (2) we have a navigation application that uses persuasion tactics to motivate behavior.
Thus, for these applications to work, there needs to be some _sensing_ and some _feedback_
one potential opportunity here is to use sensing systems that passively sense and infer human activities---http://www.adajournal.org/article/S0002-8223(02)90316-0/abstractEnergy Intake and Energy Expenditure: A Controlled Study Comparing Dietitians and Non-dietitiansCATHERINE M. CHAMPAGNE, PhD, RD, FADAa, GEORGE A. BRAY, MDa, APRIL A. KURTZ, MS, RDa, JOSEFINA BRESSAN RESENDE MONTEIRO, PhDb,ELIZABETH TUCKER, JULIA VOLAUFOVA, PhDa, JAMES P. DELANY, PhDahttp://content.nejm.org/cgi/content/abstract/327/27/1893Discrepancy between self-reported and actual caloric intake and exercise in obese subjectsSW Lichtman, K Pisarska, ER Berman, M Pestone, H Dowling, E Offenbacher, H Weisel, S Heshka, DE Matthews, and SB HeymsfieldInt J ObesRelatMetabDisord. 1999 Aug;23(8):881-8.Dietary underreporting is prevalent in middle-aged British women and is not related to adiposity (percentage body fat).Samaras K, Kelly PJ, Campbell LV.Twin Research and Genetic Epidemiology Unit, St Thomas' Hospital, London, UKhttp://www.ncbi.nlm.nih.gov/pubmed/10490791?ordinalpos=6&itool=EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DefaultReportPanel.Pubmed_RVDocSum
In the last 20 years, sensing and activity inference has come a very long way—originally much work was looking at instrumenting the environment with sensors like cameras to infer what people were doing in that space; with the costs and sizes of hardware shrinking, the early 2000s were marked by instrumenting the person or clothing with wearable sensorsThese wearable sensors are now making their ways into our cell phones in the form of GPS, accelerometers, proximity sensors and cameras. The mobile phone is, of course the ideal platform because it’s nearly always on and always with us.
It’s a new source of measurement information for behavior change.
The sounds are acquired with a microphone located insidethe ear canal. This is an unobtrusive location widely accepted inother applications (hearing aids, headsets). To validate our method we present experimental results containing 3500 seconds of chewing datafrom four subjects on four different food types typically found in a meal.Up to 99% accuracy is achieved on eating recognition and between 80%to 100% on food type classification.
Sensing system need not be on phone; can also be communicated via the cloud.System used optical, ion selective electrical pH, and conductivity sensors in order to sense and classify liquid in a cup in a practical way. Feedback system can still be phone.Drinks make up a surprisingly large portion of daily caloric intake with some research suggesting that 21% of a person’s daily caloric intake comes from beverages (458 calories) [5]. These tend to be ‘optional’ calories, not consumed exclusively to satiate hunger, and thus potentially easier to eliminate or replace with healthier alternatives Automatic Classification of Daily Fluid Intake by Jonathan Lester, Desney Tan, Shwetak Patel, and A.J. Brush22 March 2010; IEEE Pervasive Health 2010 Proceedings
Coughing is the most frequently cited symptom when people seek medical advice in the united states…
In our lab, we’ve been exploring the use of commodity mobile phones to automatically detect and classify when a person coughs.Sensing system doesn’t have to be complicated; it’s the software algorithms that are smart.
Ratio of about 4 to 1 annotation hours to recording hours
The participants were informed to monitor….
similar findings for people estimating their caloric intake and the amount of exercise they get per week.If you can’t measure it, you can’t change it.http://www.adajournal.org/article/S0002-8223(02)90316-0/abstracthttp://content.nejm.org/cgi/content/abstract/327/27/1893http://www.ncbi.nlm.nih.gov/pubmed/10490791?ordinalpos=6&itool=EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_DefaultReportPanel.Pubmed_RVDocSum
One of the best established findings in psychology is the role of feedback on performance.Think about how ingrained feedback is in our environment. For example, driving:this type of feedback is always available, passively given allowing us to sort of pre-attentively recognize it
We want to create these sorts of passive awareness systems.
Passive sensing enables a new type of application space I call “zero-effort applications”Avoid the challenging problem of determining when is the right time to prompt people with information; instead surround the user with persuasive information in a very accessible manner.
The goal is for the primary interactions to be completely passive; for both ubifit and ubigreen
As Jon mentioned, we had real time access to participant’s phone data so we could monitor the state of their phones in real timeThis screen shot was taken on a Monday, towards the beginning of the week, and shows the initial stages of their transit behavior. [next slide] Here, the shot was taken towards the end of the week; you can see how participants’ icons progressed throughout the week. At the bottom left you can see that one participant reached the final state of the progression and saw the Northern Lights.
[The glanceable display] was a constant reminder…whereas if you didn’t have a screen [glanceable display], you probably—I wouldn’t think about it [physical activity] as much, you know, I think about it maybe subconsciously every time I look at my phone. {S5}
Abstractions allowed for playfulnessProgress was visibleAchievements were rewardedCould build collection of achievements
I don’t have time to go through all of the persuasive/influence tactics that we thought about… but it’s worth mentioning that we specifically didn’t use loss aversion as a motivation technique here…We wanted people to enjoy using and feel good about using the applications.
I would like to see some graph or raw data. - Participant 13
Consolvo conducted a 3-month study with a control and experimental group and found that those with the ambient display outperformed those without.
This talk was not meant to be prescriptive but rather to inspire thought and creativity around the ideas of passive sensing for human activities. And secondly, to think creatively about how information can be passively displayed to the user.In the next 3 – 5 years, I believe activity inference will be the key technological innovation in mobile phone technology.* New opportunities in passively sensing activitiesOne of the biggest problems in hospitals is hygiene and hand washing; we
The sounds are acquired with a microphone located insidethe ear canal. This is an unobtrusive location widely accepted inother applications (hearing aids, headsets). To validate our method we present experimental results containing 3500 seconds of chewing datafrom four subjects on four different food types typically found in a meal.Up to 99% accuracy is achieved on eating recognition and between 80%to 100% on food type classification.
ubigreen context-triggered survey
with] a web site, it’s so easy, ‘Oh, I didn’t do anything, I'm not going to click on it.’ It’s so easy to ignore it. But on the phone, you can’t really ignore it as easily…otherwise, it’s just…out of sight, out of mind. {S9}