Madelaine Sayko's presentation at the Cognitive Systems Institute Speaker Group Series call on October 22, 2015.

1. Enabling Abilities
with Smart Support
Systems
Madelaine Sayko, CEO
Patrice Tremoulet, PhD
Meira Josephy

2. What Is Cognition
● Cognition: the process by which sensory inputs are transformed,
reduced, elaborated, stored, recovered, and used. (APA, 2013)
● Includes; the mental processes of attention, memory,
comprehending and producing language, monitoring mental and
physiological states, calculating, reasoning, planning, problem
solving, sequencing, wayfinding and decision making. (from ICF cognitive
functions)
● Cognition is not necessarily the same as intelligence
© Cognitive Compass
2015

3. What Is A Cognitive Disability?
● Standard Definition: Because of a physical, mental, or emotional condition, this
individual has more difficulty than the average person with concentrating,
remembering, or making decisions
● Additional features include:
 Deficits in initiation, problem solving, abstract reasoning insight, judgement,
planning, information processing, interpreting social cues, and organization.
(NIH Consensus Development Panel of Rehabilitation of Persons with
Traumatic Brain Injury)
 Cognitive disabilities range from significant to mild.
 They occur across a broad spectrum (Armstrong – continuum of
competence)
 Cognitive disabilities are not always apparent (invisible)
 Many individuals can perform at very high levels but may have a problem
with a specific function such as attention or social skills
 Cognitive disabilities may include physical attributes such as vision or balance
 Many cognitive disabilities improve throughout a lifetime, no matter when
they occurred or how (Chapman 2015)
© Cognitive Compass
2015

4. Why Cognitive Assistants for
Disability
• Almost ½ of all disabilities are cognitive (43%)
• 25% of the workforce are baby boomers who will experience mild
cognitive impairments even as they continue to work
• First generation of students graduating from school under ADA are
now in the workforce
• 95% of clinicians report that people with brain injury need technology
to support organization and memory
• Over 1/3 of employers have difficulty filling positions; persons with
cognitive disabilities may be able to meet these needs with Assistive
Technology for Cognition (ATC)
© Cognitive Compass
2015

5. What Is Assistive Technology
For Cognition
• Technologies Are Human Created Artifacts that
Extend Human Capabilities (Kapp 1877, Lawson
2010)
• Assistive Technology for Cognition are human
created artifacts that enable, enhance or extend
cognitive function (Gillespie and Zittoun, 2010)
© Cognitive Compass
2015

6. Evolution of Cognitive
Model
Technology Type/
User Group/ Rehab
Goals
Modular/
Neuropsychological
View/Functional
Specificity/ ICF
Neuro-Socio-
Technical /ATC as a
circuit
• Similar deficits arise in
different user groups.
• Single technology can support
multiple cognitive functions
DESIGN FOR ALL
Cognition as an
interactive process –
Cognition and Behavior
linked (Bateson)
© Cognitive Compass
2015

7. Executive Function
(Norman and Shallice)
Environmental
Triggers
Mobilize
Scripts
Action in the
Environment
Regulating and Monitoring
Supervisory Attentional System
© Cognitive Compass
2015

8. Socio-Neuro-Technical Model
• A full understanding of human cognition must consider the elements
beyond the brain itself; including interaction with environmental
factors
• Environmental factors include
o Psycho-social
o Physical Space
o Task
o Resources
• Seamless Interaction with the world – Zero effort technology
• Neural structure of individual adapts to the tools in the environment
and the modes of social interaction – supports compensation
© Cognitive Compass
2015

9. What Are The Challenges Of
Addressing Cognitive Disability
● Very individualized needs – wide spectrum
● Challenges with initiation may impact ability to enter or actively use
tools
● Memory issues may make it harder to learn tools
● Lack of self- awareness
● Socio-Neuro-Technical model is needed – must address
 Context
 Task
 Ability
 Personality
 Supports
 Environment
© Cognitive Compass
2015

10. Examples
• Neuropage
• PEAT (Brain Aid)
• Memex
• Bionic Brain
• Smart Calendaring
• SIRI et al
• Remembrance Agent
• Word processing tools – spell check
• CALO
© Cognitive Compass
2015

11. New Product
Development
© Cognitive Compass
2015

12. A New Solution Set for a
Cognitive Assistant
• Based on Semantic Knowledge
• Start with one function built into a service system
• Based on organizational norms
• Utilize built in decision making, cuing and custom
prompts for minimal effort and to mitigate initiation
problems
• Creates a status for documents, email and contacts
for projects
© Cognitive Compass
2015

13. Key Features
• Service System
• Zero Effort Technology (approximates)
• Smart System – learns the users
• Cognitively Friendly UI - NLP
• Assessment and Recommender Component
• Captures User Data
• Mobile
• Focus on Function & Task Interaction NOT a given
disability
• Integrates task functions into one system
• Uses external prompts and aids to ‘scaffold’ the user
© Cognitive Compass
2015

14. Functions
• Set of Assistive Tools that are “aware” of accepted social norms in
work organizations
• Monitor work patterns
• Offer assistance and appropriate reminders and cues
• Offloads some task management to technology
• Provide insight in cognitive disability in the workplace
• ‘Canary in the coal mine’ for understanding cognition overall
© Cognitive Compass
2015

15. Learning Models
• Guide the User – high level of system feedback, instructs user when
mistakes are made, encourages when right path is chosen (think
video games)
• Understand the User – responds to user needs and preferences,
response speed, accuracy etc. shape system presentation (think
cognitive games)
• Support the User- present information in ways that are easy to follow,
step by step (highly structured)
© Cognitive Compass
2015

16. AN INTELLIGENT TASK STATUS MANAGER
Task Status Management
Functionality
Knowledge of Social / Org norms and
practices related to tasks statuses
Monitoring
Cues & Advise Adjustments
*1) Supplier X hasn’t responded to inquiry for a week, follow up with him
*2) email requests from Manager needs respond within 24 hours,
*3) monthly work status report pre-warning 5 days in advance of deadline
© Cognitive Compass
2015

17. Future Vision For A Cognitive Support Service System
Private Data
Store
Behavioral
Physiological &
Environmental
Models
Recommender & Integrated Work Assist
Environment
Smart Assessor
Individualized cuing
and aids to ‘scaffold’
the user for task needs –
Cognitive Assistant
Task & Status
Management
Attention /
Initiation
Planning &
Organization
Communication/
Behavior
Time
Management/
Cognitive Budget
Usage
Patterns
Biometric
Devices
Image
Collection
Dialogue Module
User
Preferences
© Cognitive Compass
2015

18. Contact Information
• Madelaine Sayko
• msayko@cognitivecompass.com
• (610) 715-2057