The document discusses applied distributed cognition using foundation models and biosensing, citing contributions from notable figures in cybernetics and psychology. It explores the integration of human and computer systems to enhance cognitive functions, emphasizing new biosensing technologies and their applications in medical decision-making and healthcare. Various sources and projects are referenced to illustrate the advancements and risks associated with these technologies.

1. APPLIED
DISTRIBUTE
D
COGNITION
USING FOUNDATION
MODELS AND
BIOSENSING
Mike Kuniavsky
UC Davis
May 30, 2024

2. ABOUT ME

3. APPLIED DISTRIBUTED COGNITION – MAY 30, 2024 6

4. APPLIED DISTRIBUTED COGNITION – MAY 30, 2024 7

5. APPLIED DISTRIBUTED COGNITION – MAY 30, 2024 8

6. APPLIED DISTRIBUTED COGNITION – MAY 30, 2024 9

7. APPLIED DISTRIBUTED COGNITION – MAY 30, 2024 10
Accenture Labs

8. APPLIED DISTRIBUTED COGNITION – MAY 30, 2024 11

9. A LITTLE
CYBERNETICS
The May 1942 Macy Foundation Conference on
Cerebral Inhibition, and how it changed our world

10. 1946-1953: THE MACY
CONFERENCES ON
CYBERNETICS
• Margaret Mead,
anthropologist
• Arturo Rosenblueth,
physiology
• Gregory Bateson,
anthropologist
• Warren McCulloch,
neuropsychiatry
• Walter Pitts,
mathematics
• John von Neumann,
mathematics
• Norbert Wiener,
mathematics
• Joseph Licklider,
psychology
• Claude Shannon,
engineering
• Harold Abramson,
medicine
APPLIED DISTRIBUTED COGNITION – MAY 30, 2024 13

11. APPLIED DISTRIBUTED COGNITION – MAY 30, 2024 14
CYBERNETICS SAW BIOLOGY AND ELECTRONICS AS
TWO EXAMPLES OF THE SAME THING

12. APPLIED DISTRIBUTED COGNITION – MAY 30, 2024 15

13. HUMAN COMPUTER INTEGRATION:
PREEMPTIVE ACTION
APPLIED DISTRIBUTED COGNITION – MAY 30, 2024 16
Source: Kasahara, Shunichi, Jun Nishida, and Pedro Lopes. “Preemptive Action: Accelerating Human Reaction
Using Electrical Muscle Stimulation Without Compromising Agency.” (2019)

14. HUMAN COMPUTER INTEGRATION: HINDSIGHT
APPLIED DISTRIBUTED COGNITION – MAY 30, 2024 17
Source: Schoop, Eldon, James Smith, and Bjoern Hartmann. “HindSight: Enhancing Spatial Awareness by
Sonifying Detected Objects in Real-Time 360-Degree Video.” (2018)

15. APPLIED
DISTRIBUTED
COGNITION
Enacting an explanatory framework

16. APPLIED DISTRIBUTED COGNITION – MAY 30, 2024 19
DISTRIBUTED COGNITION

17. APPLIED DISTRIBUTED COGNITION
APPLIED DISTRIBUTED COGNITION – MAY 30, 2024 21

18. NEW BIOSENSORS TO IDENTIFY COGNITIVE
STATES
Apple (published 2023) Meta (published 2023)

19. FOUNDATION MODELS
APPLIED DISTRIBUTED COGNITION – MAY 30, 2024 26
Source: Bommasani, Rishi, Drew A. Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von
Arx, Michael S. Bernstein, et al. “On the Opportunities and Risks of Foundation Models.” (2021)

20. FOUNDATION MODELS TO ANTICIPATE NEEDS
AND ACTIONS
APPLIED DISTRIBUTED COGNITION – MAY 30, 2024 27
Source: Bommasani, Rishi, Drew A. Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von
Arx, Michael S. Bernstein, et al. “On the Opportunities and Risks of Foundation Models.” (2021)

21. EXAMPLES OF
BIOSENSING +
FOUNDATION
MODELS
Modeling human responses to anticipate,
compensate, and augment cognition

22. ASKWELL: A MEDICAL DECISION-MAKING AI ASSISTANT
Accenture Labs
Project team: Hardika Gawde, Tina Shih, Maya Stack, Matthew
Tung

23. CARE: CV+AI COACHING FOR HOME
HEALTHCARE WORKERS
APPLIED DISTRIBUTED COGNITION – MAY 30, 2024 32
Accenture Labs
Source: Alexandra Bremers + Accenture
Labs

24. BAD ROBOT
APPLIED DISTRIBUTED COGNITION – MAY 30, 2024 33
Stimulus video
Time-stamped response video
Source: Bremers et al, 2023;
Parreira et al, 2024
Accenture Labs

25. DUAL BODY BIMANUAL COORDINATION (W/POV
SHIFT)
APPLIED DISTRIBUTED COGNITION – MAY 30, 2024 34
Accenture Labs
Source: Smith, James, Xinyun Cao, Adolfo G. Ramirez-Aristizabal, and Bjoern
Hartmann. “Dual Body Bimanual Coordination in Immersive Environments.”
(2023)

26. IN CONCLUSION?
APPLIED DISTRIBUTED COGNITION – MAY 30, 2024 35
No Maybe?

27. THANK YOU
Mike Kuniavsky kuniavsky@gmail.com
APPLIED DISTRIBUTED COGNITION – MAY 30, 2024 36