Games With Sensors: CommonSenses - A proposed health game platform

A Proposal (requesting game community feedback)
Jim Burns
Elbrys
jeb@elbrys.com, @jebpublic

www.gamesforhealth.org

Agenda
• Problem
• Solution
• Miller Time!
• Game Ideas Throughout


Played Lately…


Who Am I?
• Strategic gamer – board/electronic
• Wireless Network security software architect
• Recovering Board game developer
• Vice-Chair, Wi-Fi Alliance, Healthcare Marketing Task Group


The Problem
• Health care professionals need more physical
data about us.
• We don’t have time (= boooooring) to enter
the data. Furthermore, who trusts us to enter
data correctly?


The Solution

Do it for me.


Solution Requirements
• Step 1: Engage Users….with Games
• Step 2*: Connect with sensors, collect sensor
data and transform and route to health care
systems
• Step 3: Health care systems improves my life


Connecting Data To Health Workers
-External Sensors -Internal Sensors -Device Services -Electronic -Health Workers
(optional) -Aggregation Medical
-Game Platform Records

Game CommonSenses
Service
CommonSenses -Disease
Client SDK Management

-Personal
CommonSenses Health
Embedded SDK Records

-Social Network


Sensors Native on Phones
Type Uses Platform Notes

<all> -Lots of data
-Orientation
Accelerometer 3 axis acceleration iPhone -No background usage

Android -Tricky background usage

Speed and distance Provides speed and distance <Smart phones> Utilizes location
monitor
Magnetometer Detects direction and strength of magnetic <Many smart phones>
fields. Compass heading. Detect gestures of
hand wearing a magnet.
Camera Paper sensor reader, <Many mobile phones>
Heart rate
Near Field Radio RFID reader Android Nexxus S
More in Q3 2011
Microphone Detect noise/voice commands <Smart phones>

Light detection Detect ambient light level <Smart phones>, ipod Not highly accurate.
touch, ipad
Proximity sensor Detect something is near iPhone, Android Not too useful. Detects
when something is very
close to ear speaker.
On/off
Location Detect the location of device <Smart phones>, ipod
touch, ipad


Stand-alone Sensors
Type Uses Platform Notes

Blood Oximeter Blood oxygen, Heart rate Finger tip, ear clip

Weight Weight scale
Weight scale
Body fat %

Galvanic Skin Response Anxiety Bicep, finger tip

Blood pressure monitor Systolic, diastolic and pulse Arm cuff

Peak expiratory flow Detects flow of air from exhalation Handheld device (kazoo)
(Spirometry)
Electrocardiograph Wave form of heart activity Clip-on module and electrodes

Thermometer Body temperature Worn on bicep

Blood glucose meter Monitors blood glucose level using drop of Small portable device and test strips
blood
Adherence monitor Detect opening of pill container Pill container

Bike speed and cadence Detects bike speed, crank cadence Spoke and frame mounted

Heart Rate Monitor Heart rate Chest strap, watch touch pads

Stride-based speed and Detects steps and calculated speed, Shoe mounted
distance monitor cadence and distance from stride length
Brainwave cycles Detect electricity generated by brain Head mounted Neurosky
activity.


Application of Sensors To Games
Metadata Other Players Metadata

NPC
Environment

Resources
Player’s
Friends Metrics
Player Metrics
Rules

Player character
/ avatar

Input


Our Game Focus - Games with Sensors
• Mobile platform
• Quick – 5-15 minutes at a time
– Pause/Resume for long story line
– Repeated quick levels
• Multiplayer/Social
– Asynchronous
– Synchronous
• Competition == Friction (PvP, PvM, PvS)


Seek ‘n Spell
Metric Ideas
1. ((Heart rate/movement)-Avg hr/mov
of friends) makes it harder to get
letter (handicapping)
2. A number of steps can be used as
a long-distance grab of a letter
(using up the charge til it is
recharged)

Link http://www.youtube.com/watch?v=vofSU97GWfA (Retronyms)
Game type Real-World Augmented Play
Audience Non-gamers
Time per play Short
Lifespan Short
Metric usage Location applied to environment
Motivations Fun competition
Social interaction In-person


Platform Design

(drink caffeine here…)


Design Goals
Standards based – IEEE, IHE PCD-01, HL7 CDA (CCD)
Encapsulate networking complexities
Encapsulate regulatory issues (HIPAA, MDDS, PPACA)
Server regulated and unregulated markets
Player centric: abstract away from sensor hardware/software
Hardware and software ‘sensors’
Interface with games using popular techniques – RESTful, JSON, OAUTH 2
Multiplayer - Integrated with social networks
Mobile – Android, iPhone
Largest source of available ‘plastic’ – Android, iPhone, ANT+
Work within the game
Player (or care-giver) administered
Extensible Security


Carcassone (board/card games)
Metric Ideas
1. Health clout provides one-
time/limited-time ‘rule breaker’ card
– store a tile for later usage.

Link http://www.youtube.com/watch?v=wzWa9gDoQUg (Hans im Gluck. Rendered on iPhone by
CodeMonkeys)
Game class Board game
Audience Strategy gamers
Time per play Short
Lifespan Short
Metric usage None
Motivations Competitive fun
Social interaction Asynchronous multiplayer. Chat.


System Functional Architecture

User
Game
Collect Play Admin
Admin
Aggregation Mobile Game Mobile Game Web Game CommonSenses
Appliance (peer-to-peer) (client/server) (client/server) Admin Web
CommonSenses CommonSenses CommonSenses CommonSenses Page
Embedded SDK Client SDK Client SDK Client SDK

Web Server
(client/server)

CommonSenses Service

PHR EMR DM

Zen Station (Jannis Kreft)
Metric Ideas

1. GSR of opponent displayed.
2. Three chances to use the heart
rate of my friends instead of my
own.

Link http://walyou.com/zen-station-bio-feedback-controlled-game/

Game class Biofeedback Action
Audience Non-gamers
Time per play Short
Lifespan Short
Metric usage Heart rate and Blood Oxygen used as input
Motivations Fun competition
Social interaction In-person


Service Functional Architecture
External
Services

Configuration
Grooming Inference
Algorithms Services

Data Router Alerts Alerts

Data Data
Transform
Store
Algorithms
Network
Transports Notification Services (APNS, WebHooks)
(IHE IT SOAP, IHE XDS)

Create A New Metric
SERVICE POINT: Rules:
POST /users/<uId>/metrics 1.Sample time may
not overlap with the
SEND BODY: same metric from
{“ver”:”1”,
the same collector.
“metrics”:[
2.If profile indicates
{“metric”:”heartRate”,
"profile”:”heartRate",
accumulator (sum
“data”:[
or avg) then vals
{“start”:”20110522112233-0005”, must indicate
“end”:”20110522112233-0005”, sample number.
“vals”:[{“v”:[83],"at":20110522112233-0005}]
}]}]}

RETURN:
<id> for new Metrics


Ghost Patrol
Metric Ideas
1. Heart rate and/or GSR attracts
ghosts.
2. ‘Light’ weapon charged by light
collected during the day.
3. Running allows escape from an
attack ghost

Link http://www.youtube.com/watch?v=CrgNQXZimxs (GPS Mission Pro by Orbster GmbH)
Game class Augmented reality
Audience Gamers
Time per play Short
Lifespan Short
Metric usage Location selects game environment
Motivations Fun
Social interaction None


Client Functional Architecture
Application Configuration
Metrics
Player Metrics

Derivation
Functions

Data Router

Data
Transform Cache
Algorithms

Network
Buffer

Network
Transports
(IHE IT SOAP, RESTful)

Aurora Feint II
Metric Ideas
1. Extra gold for the number or
readings taken during the day.
2. Extra reputation for health clout.
3. Strengthen your ghost during the
day by increasing number of steps.

Link http://www.youtube.com/watch?v=kE47Ghtkbkc (Aurora Feint)
Game class Puzzle
Audience Gamers
Time per play Short
Lifespan Short/Long
Metric usage None
Motivations Time filler
Social interaction Asynchronous multiplayer (ghost)


Problem Solved! It’s Miller Time.

(Not quite…)


Platform Feature Priorities
Initial Beta Release (8/2011) – Weight, Blood pressure, Movement, Social
Thresholds & Alerts
Steps Bank
Continua Sensors Collected Via Android Phones
Group Metrics
iPhone
Paper sensors (bar and QR codes), RFID, Fitbit
More authentication providers (Google, OpenId, Twitter, LinkedIn)
More Personal Health Records (Microsoft Healthvault, Google Health)
Skin Conductance Level (SCL) sensor


GoldWalker
Metric Ideas
1. Heart rate could increase speed of
travel.
2. Meeting daily metrics grants a
unique item (rule breaker).

Link http://itunes.apple.com/us/app/goldwalker/id372683234?mt=8 (Humana)
Game class Re-action Iterative
Audience Non-gamers
Time per play Short
Lifespan Short
Metric usage Accelerometer as resource
Motivations Fun
Social interaction None


Open Discussion - Priorities
User authentication/authorization experience
Meta-data namespaces
Regulations (HIPAA, MDDS, PPACA)
Client Library vs. Service
Latency
Free living
Fairness ( 847 youtube.com hits for Pokewalker cheat )
• Identify person wearing sensor
•Fraud detection
Calibration
• Consistency
• Handicapping
ANT+ - 3 phones, 1 dongle


More Information
• Me
– jeb@elbrys.com
– @jebpublic
• Product/Community (alpha)
– dev.CommonSenses.com


Questions/Comments/Ideas?


Image Attributions
• The following images are used under Creative Commons license that includes attribution:

Image Title Licensor

Master Chief Portrait Eightfold-Studios

Bill Gates Bar Code Scott Blake


Games With Sensors: CommonSenses - A proposed health game platform

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (7)

Similar to Games With Sensors: CommonSenses - A proposed health game platform

Similar to Games With Sensors: CommonSenses - A proposed health game platform (20)

Recently uploaded

Recently uploaded (20)

Games With Sensors: CommonSenses - A proposed health game platform