SlideShare uma empresa Scribd logo
1 de 35
Embodied Cognition as a basis for
Researching and Designing Interaction
Part 1:
Distributed Computation and Representation
Overview
• Introduction
• Cognitive Science
• Embodied Cognition: the general idea
• Three flavors
BREAK
• Distributed Computation and Representation
• Applications in design:
• Discussion of the DRC perspective
Introduction
Jelle van Dijk
Utrecht, The Netherlands, 1975
Werkplaats Kees Boeke Bilthoven
Cognitive Science Nijmegen
Embodied Cognitive Development (neural network model) Pim Haselager
fMRI on language learning FC Donders Centre Nijmegen
Human Technology Den Haag
Interactive Media Products Hogeschool Utrecht, Remko van der Lugt
Industrial Design Eindhoven, Kees Overbeeke, Caroline Hummels
Phd thesis: Creating Traces, Sharing Insight (2013)
www.jellevandijk.org
Interaction design „beyond‟ the desktop
Emerging themes:
• Tangibility, physical-digital
integration
• Body augmenting devices,
Movement detection
• Social mediators
• Context-aware systems
• Intelligent „agents‟
Tags: Ubicomp, Wearables, Tangible Media, Augmented reality,
Mobile computing, Ambient Intelligence, Human-Brain interfacing,
And more…
Conference: Tangible, Embodied and Embedded Interaction (TE
Theoretical perspective strongly influences the
design
A table-top surface… is a horizontal screen
interface on which to present and manipulate
digital information in an easy way
A table-top surface… is a social mediator on
which you express yourself skillfully, a physical
table augmented with digital interactivity
What is a table top surface?
Cognitive Science
Cognitive science
Babbage‟s Mill (1837)
Reacting against Behaviorism (192
Brain imaging (1970-present)
I think,
Therefore I
am
Computers (1940‟s - present)
Mind as an inner exercise
“Thinking can best be
understood in terms of
representational structures in
the mind and computational
procedures that operate on
those structures.”
(Wikipedia quoting Paul
Thagard)
Clark quoting Gleick quoting
Feynman
Embodied Cognition
Embodied Cognition
Clark 97 Kelso 95
Varela 91 Suchman 87Dourish 01
Kirsh 11
Clancey 97
Merleau-Ponty 62
Ingold 12
Dreyfus 72
Cognition is
Sensorimotor
Coupling
Cognition is
Socially Situated
Cognition is
Distributed Info-
Processing
Embodied Cognition: 3 flavors
Modest………………………………………………………………………………………………………………Radical
Time for coffee!
Distributed representation and –computation (DR
Don Norman (1987)
• knowledge in the world
External representation (External memory)
How many „external representations‟ can you see in this scene?
• Real objects as „stand-in‟ for „mental objects‟
Hutchins (1995)
• Ethnographical approach
• Tools (e.g. the nautical slide-rule for ship
navigation) provide:
– Representational media (external memory)
– Constraints on the organization of action
(computation)
• Cognition is distributed over a system of
people and tools
• Clark (1997) Scaffolding.
Use the physical structure in the world to “think with”
• Kirsh (1994) Epistemic action
Reorganize the world such that the problem representation
becomes more easy (or trivial)
Montessori blocks (discussed in Klemmer et al,
2006)
Abacus
Distributed computation
Distributed computation, continued
• Clark (1997) 007 principle:
Information will be given to you on a need to know basis
(by the locally available structure in the environment)
• Agre et al (1997) Lifeworld analysis:
human environments are pre-organized: this simplifies
tasks (e.g. things that are needed together for a task
are often found in the same location).
Applications in design
How NOT to do it:
Some bad designs
…more bad designs
Classic application of DRC
Ishii & Ullmer (1997) Tangible User Interfaces
1997
(TEI „08)
Djajadiningrat
Augmenting Fun and Beauty: A Pamphlet
J.P. Djajadiningrat C.J. Overbeeke S.A.G.
Wensveen
Delft University of Technology, Department of
Industrial Design
Discussion of DRC and design
• Straightforward opportunities for application in
interfaces and products.
• Intuitive vocabulary for computer engineers
• „Modest‟ adaption of cognitive science principles
But
• How to design good mappings?
• Who determines the (predefined) mappings?
• What grounds the meaning of the digital content?
• Are humans part of computational systems, or is
computation part of human practice?
• Do we want technology to take over the cognitive
load?
• Is the body only a „physical constraint‟ or is there more
to it?
• Can we explain the significance of concrete design
cases with DRC or do we need more?
DRC applied to design: take home
msg
Distributed representation and computation leads to the
design of predefined mappings to digital meanings
Next lecture (2 weeks from now)
Cognition is Distributed Computation Socially Situated!

Mais conteúdo relacionado

Mais procurados

Wearable computing and embodied interaction
Wearable computing and embodied interactionWearable computing and embodied interaction
Wearable computing and embodied interactionUTFPR
 
Topic Maps: Romancing Conversation Topics
Topic Maps: Romancing Conversation TopicsTopic Maps: Romancing Conversation Topics
Topic Maps: Romancing Conversation TopicsJack Park
 
A room for understanding
A room for understandingA room for understanding
A room for understandingSjors Timmer
 
The Culture of Scheme Programming
The Culture of Scheme ProgrammingThe Culture of Scheme Programming
The Culture of Scheme ProgrammingMaciek Godek
 
New Media New Technology 2011 - Back to the future
New Media New Technology 2011 - Back to the futureNew Media New Technology 2011 - Back to the future
New Media New Technology 2011 - Back to the futurePeter Van Der Putten
 
Printversion ice summer school 1 7-2013.key
Printversion ice summer school 1 7-2013.keyPrintversion ice summer school 1 7-2013.key
Printversion ice summer school 1 7-2013.keyJun Hu
 
Where The Action Is In Psychology
Where The Action Is In PsychologyWhere The Action Is In Psychology
Where The Action Is In PsychologyJ S
 
Mini thesis presentation
Mini thesis presentationMini thesis presentation
Mini thesis presentationYou-Wen Liang
 
A room for understanding
A room for understandingA room for understanding
A room for understandingSjors Timmer
 
Luigina Ciolfi inaugural lecture 2019
Luigina Ciolfi inaugural lecture 2019Luigina Ciolfi inaugural lecture 2019
Luigina Ciolfi inaugural lecture 2019Luigina Ciolfi
 
Free the Patterns! The Vital Challenge to the Pattern Community
Free the Patterns! The Vital Challenge to the Pattern CommunityFree the Patterns! The Vital Challenge to the Pattern Community
Free the Patterns! The Vital Challenge to the Pattern CommunityDouglas Schuler
 
The Foundations of Spatial Computing
The Foundations of Spatial ComputingThe Foundations of Spatial Computing
The Foundations of Spatial ComputingSjors Timmer
 
What way is_up_3
What way is_up_3What way is_up_3
What way is_up_3plugster
 
Human-Computer Interaction
Human-Computer InteractionHuman-Computer Interaction
Human-Computer InteractionTarek Amr
 
Tools for a whole range of Scholarly Activities (at DH2015)
Tools for a whole range of Scholarly Activities (at DH2015)Tools for a whole range of Scholarly Activities (at DH2015)
Tools for a whole range of Scholarly Activities (at DH2015)John Bradley
 

Mais procurados (20)

Wearable computing and embodied interaction
Wearable computing and embodied interactionWearable computing and embodied interaction
Wearable computing and embodied interaction
 
Topic Maps: Romancing Conversation Topics
Topic Maps: Romancing Conversation TopicsTopic Maps: Romancing Conversation Topics
Topic Maps: Romancing Conversation Topics
 
A room for understanding
A room for understandingA room for understanding
A room for understanding
 
Virtual Identity
Virtual IdentityVirtual Identity
Virtual Identity
 
The Culture of Scheme Programming
The Culture of Scheme ProgrammingThe Culture of Scheme Programming
The Culture of Scheme Programming
 
New Media New Technology 2011 - Back to the future
New Media New Technology 2011 - Back to the futureNew Media New Technology 2011 - Back to the future
New Media New Technology 2011 - Back to the future
 
Printversion ice summer school 1 7-2013.key
Printversion ice summer school 1 7-2013.keyPrintversion ice summer school 1 7-2013.key
Printversion ice summer school 1 7-2013.key
 
Where The Action Is In Psychology
Where The Action Is In PsychologyWhere The Action Is In Psychology
Where The Action Is In Psychology
 
Mini thesis presentation
Mini thesis presentationMini thesis presentation
Mini thesis presentation
 
A room for understanding
A room for understandingA room for understanding
A room for understanding
 
Luigina Ciolfi inaugural lecture 2019
Luigina Ciolfi inaugural lecture 2019Luigina Ciolfi inaugural lecture 2019
Luigina Ciolfi inaugural lecture 2019
 
Free the Patterns! The Vital Challenge to the Pattern Community
Free the Patterns! The Vital Challenge to the Pattern CommunityFree the Patterns! The Vital Challenge to the Pattern Community
Free the Patterns! The Vital Challenge to the Pattern Community
 
Spatial Interaction Design_Space
Spatial Interaction Design_SpaceSpatial Interaction Design_Space
Spatial Interaction Design_Space
 
The Foundations of Spatial Computing
The Foundations of Spatial ComputingThe Foundations of Spatial Computing
The Foundations of Spatial Computing
 
What way is_up_3
What way is_up_3What way is_up_3
What way is_up_3
 
In The Game
In The GameIn The Game
In The Game
 
Human-Computer Interaction
Human-Computer InteractionHuman-Computer Interaction
Human-Computer Interaction
 
Hci Presentation
Hci PresentationHci Presentation
Hci Presentation
 
Tools for a whole range of Scholarly Activities (at DH2015)
Tools for a whole range of Scholarly Activities (at DH2015)Tools for a whole range of Scholarly Activities (at DH2015)
Tools for a whole range of Scholarly Activities (at DH2015)
 
Tm keynote
Tm keynoteTm keynote
Tm keynote
 

Destaque

Sensory Design, Embodied Cognition & The Future of Wearables
Sensory Design, Embodied Cognition & The Future of WearablesSensory Design, Embodied Cognition & The Future of Wearables
Sensory Design, Embodied Cognition & The Future of WearablesKatja Forbes
 
The Problem with Building Usability
The Problem with Building UsabilityThe Problem with Building Usability
The Problem with Building UsabilityJakub Krukar
 
Holcombe Theory Map 1
Holcombe Theory Map 1Holcombe Theory Map 1
Holcombe Theory Map 1northavorange
 
Karl Fast - Deep Interaction
Karl Fast - Deep InteractionKarl Fast - Deep Interaction
Karl Fast - Deep Interactionuxbri
 
04 man as embodiment
04   man as embodiment04   man as embodiment
04 man as embodimentPeter Miles
 
Philosophy of the human person
Philosophy of the human personPhilosophy of the human person
Philosophy of the human personZahra Zulaikha
 
Design in Tech Report 2017
Design in Tech Report 2017Design in Tech Report 2017
Design in Tech Report 2017John Maeda
 

Destaque (9)

Space and Situated Cognition
Space and Situated CognitionSpace and Situated Cognition
Space and Situated Cognition
 
Sensory Design, Embodied Cognition & The Future of Wearables
Sensory Design, Embodied Cognition & The Future of WearablesSensory Design, Embodied Cognition & The Future of Wearables
Sensory Design, Embodied Cognition & The Future of Wearables
 
The Problem with Building Usability
The Problem with Building UsabilityThe Problem with Building Usability
The Problem with Building Usability
 
Cognition in Space
Cognition in SpaceCognition in Space
Cognition in Space
 
Holcombe Theory Map 1
Holcombe Theory Map 1Holcombe Theory Map 1
Holcombe Theory Map 1
 
Karl Fast - Deep Interaction
Karl Fast - Deep InteractionKarl Fast - Deep Interaction
Karl Fast - Deep Interaction
 
04 man as embodiment
04   man as embodiment04   man as embodiment
04 man as embodiment
 
Philosophy of the human person
Philosophy of the human personPhilosophy of the human person
Philosophy of the human person
 
Design in Tech Report 2017
Design in Tech Report 2017Design in Tech Report 2017
Design in Tech Report 2017
 

Semelhante a Dijk 2013 embodied cognition lecture 1 drc small

Analytical-frameworks - Methods in user-technology studies
Analytical-frameworks - Methods in user-technology studiesAnalytical-frameworks - Methods in user-technology studies
Analytical-frameworks - Methods in user-technology studiesAntti Salovaara
 
Distributed cognition
Distributed cognitionDistributed cognition
Distributed cognitionHongbo Zhang
 
ChemnitzDec2014.key.compressed
ChemnitzDec2014.key.compressedChemnitzDec2014.key.compressed
ChemnitzDec2014.key.compressedBrian Fisher
 
A myth or a vision for interoperability: can systems communicate like humans do?
A myth or a vision for interoperability: can systems communicate like humans do?A myth or a vision for interoperability: can systems communicate like humans do?
A myth or a vision for interoperability: can systems communicate like humans do?Milan Zdravković
 
Introduction to Artificial Intelligence - Cybernetics Robo Academy
Introduction to Artificial Intelligence - Cybernetics Robo AcademyIntroduction to Artificial Intelligence - Cybernetics Robo Academy
Introduction to Artificial Intelligence - Cybernetics Robo AcademyTutulAhmed3
 
Education, technologies, cognition: triangulations possibles
Education, technologies, cognition: triangulations possiblesEducation, technologies, cognition: triangulations possibles
Education, technologies, cognition: triangulations possibleselena.pasquinelli
 
Place Making: A Theory Of Knowledge Work
Place Making:  A Theory Of Knowledge WorkPlace Making:  A Theory Of Knowledge Work
Place Making: A Theory Of Knowledge WorkTrond Arne Undheim
 
Introduction-Chapter-1.ppt
Introduction-Chapter-1.pptIntroduction-Chapter-1.ppt
Introduction-Chapter-1.pptssuser99ca78
 
Artificial Intelligence PPT.ppt
Artificial Intelligence PPT.pptArtificial Intelligence PPT.ppt
Artificial Intelligence PPT.pptDarshRawat2
 
Multimodal Interaction: An Introduction
Multimodal Interaction: An IntroductionMultimodal Interaction: An Introduction
Multimodal Interaction: An IntroductionAbdallah El Ali
 

Semelhante a Dijk 2013 embodied cognition lecture 1 drc small (20)

Analytical-frameworks - Methods in user-technology studies
Analytical-frameworks - Methods in user-technology studiesAnalytical-frameworks - Methods in user-technology studies
Analytical-frameworks - Methods in user-technology studies
 
A.i.
A.i.A.i.
A.i.
 
Distributed cognition
Distributed cognitionDistributed cognition
Distributed cognition
 
ChemnitzDec2014.key.compressed
ChemnitzDec2014.key.compressedChemnitzDec2014.key.compressed
ChemnitzDec2014.key.compressed
 
Chemnitz dec2014
Chemnitz dec2014Chemnitz dec2014
Chemnitz dec2014
 
A myth or a vision for interoperability: can systems communicate like humans do?
A myth or a vision for interoperability: can systems communicate like humans do?A myth or a vision for interoperability: can systems communicate like humans do?
A myth or a vision for interoperability: can systems communicate like humans do?
 
HUMAN MACHINE INTERACTION
HUMAN MACHINE INTERACTIONHUMAN MACHINE INTERACTION
HUMAN MACHINE INTERACTION
 
Lect 01, 02
Lect 01, 02Lect 01, 02
Lect 01, 02
 
Introduction to Artificial Intelligence - Cybernetics Robo Academy
Introduction to Artificial Intelligence - Cybernetics Robo AcademyIntroduction to Artificial Intelligence - Cybernetics Robo Academy
Introduction to Artificial Intelligence - Cybernetics Robo Academy
 
AI Introduction
AI Introduction AI Introduction
AI Introduction
 
Cognitive Science.ppt
Cognitive Science.pptCognitive Science.ppt
Cognitive Science.ppt
 
AI.ppt
AI.pptAI.ppt
AI.ppt
 
Unit 1 AI.pptx
Unit 1 AI.pptxUnit 1 AI.pptx
Unit 1 AI.pptx
 
Ai introduction
Ai introductionAi introduction
Ai introduction
 
Education, technologies, cognition: triangulations possibles
Education, technologies, cognition: triangulations possiblesEducation, technologies, cognition: triangulations possibles
Education, technologies, cognition: triangulations possibles
 
Place Making: A Theory Of Knowledge Work
Place Making:  A Theory Of Knowledge WorkPlace Making:  A Theory Of Knowledge Work
Place Making: A Theory Of Knowledge Work
 
Introduction-Chapter-1.ppt
Introduction-Chapter-1.pptIntroduction-Chapter-1.ppt
Introduction-Chapter-1.ppt
 
Artificial Intelligence PPT.ppt
Artificial Intelligence PPT.pptArtificial Intelligence PPT.ppt
Artificial Intelligence PPT.ppt
 
Ai introduction
Ai  introductionAi  introduction
Ai introduction
 
Multimodal Interaction: An Introduction
Multimodal Interaction: An IntroductionMultimodal Interaction: An Introduction
Multimodal Interaction: An Introduction
 

Último

Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024The Digital Insurer
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsRoshan Dwivedi
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesBoston Institute of Analytics
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdflior mazor
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Principled Technologies
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businesspanagenda
 

Último (20)

Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 

Dijk 2013 embodied cognition lecture 1 drc small

  • 1. Embodied Cognition as a basis for Researching and Designing Interaction Part 1: Distributed Computation and Representation
  • 2. Overview • Introduction • Cognitive Science • Embodied Cognition: the general idea • Three flavors BREAK • Distributed Computation and Representation • Applications in design: • Discussion of the DRC perspective
  • 4. Jelle van Dijk Utrecht, The Netherlands, 1975 Werkplaats Kees Boeke Bilthoven Cognitive Science Nijmegen Embodied Cognitive Development (neural network model) Pim Haselager fMRI on language learning FC Donders Centre Nijmegen Human Technology Den Haag Interactive Media Products Hogeschool Utrecht, Remko van der Lugt Industrial Design Eindhoven, Kees Overbeeke, Caroline Hummels Phd thesis: Creating Traces, Sharing Insight (2013) www.jellevandijk.org
  • 5. Interaction design „beyond‟ the desktop Emerging themes: • Tangibility, physical-digital integration • Body augmenting devices, Movement detection • Social mediators • Context-aware systems • Intelligent „agents‟ Tags: Ubicomp, Wearables, Tangible Media, Augmented reality, Mobile computing, Ambient Intelligence, Human-Brain interfacing, And more… Conference: Tangible, Embodied and Embedded Interaction (TE
  • 6. Theoretical perspective strongly influences the design A table-top surface… is a horizontal screen interface on which to present and manipulate digital information in an easy way A table-top surface… is a social mediator on which you express yourself skillfully, a physical table augmented with digital interactivity What is a table top surface?
  • 8. Cognitive science Babbage‟s Mill (1837) Reacting against Behaviorism (192 Brain imaging (1970-present) I think, Therefore I am Computers (1940‟s - present)
  • 9. Mind as an inner exercise “Thinking can best be understood in terms of representational structures in the mind and computational procedures that operate on those structures.” (Wikipedia quoting Paul Thagard)
  • 10. Clark quoting Gleick quoting Feynman
  • 12. Embodied Cognition Clark 97 Kelso 95 Varela 91 Suchman 87Dourish 01 Kirsh 11 Clancey 97 Merleau-Ponty 62 Ingold 12 Dreyfus 72
  • 13.
  • 14.
  • 15. Cognition is Sensorimotor Coupling Cognition is Socially Situated Cognition is Distributed Info- Processing Embodied Cognition: 3 flavors Modest………………………………………………………………………………………………………………Radical
  • 17. Distributed representation and –computation (DR
  • 18. Don Norman (1987) • knowledge in the world
  • 19. External representation (External memory) How many „external representations‟ can you see in this scene? • Real objects as „stand-in‟ for „mental objects‟
  • 20.
  • 21.
  • 22. Hutchins (1995) • Ethnographical approach • Tools (e.g. the nautical slide-rule for ship navigation) provide: – Representational media (external memory) – Constraints on the organization of action (computation) • Cognition is distributed over a system of people and tools
  • 23. • Clark (1997) Scaffolding. Use the physical structure in the world to “think with” • Kirsh (1994) Epistemic action Reorganize the world such that the problem representation becomes more easy (or trivial) Montessori blocks (discussed in Klemmer et al, 2006) Abacus Distributed computation
  • 24. Distributed computation, continued • Clark (1997) 007 principle: Information will be given to you on a need to know basis (by the locally available structure in the environment) • Agre et al (1997) Lifeworld analysis: human environments are pre-organized: this simplifies tasks (e.g. things that are needed together for a task are often found in the same location).
  • 25.
  • 27. How NOT to do it: Some bad designs
  • 29. Classic application of DRC Ishii & Ullmer (1997) Tangible User Interfaces 1997
  • 31. Djajadiningrat Augmenting Fun and Beauty: A Pamphlet J.P. Djajadiningrat C.J. Overbeeke S.A.G. Wensveen Delft University of Technology, Department of Industrial Design
  • 32. Discussion of DRC and design
  • 33. • Straightforward opportunities for application in interfaces and products. • Intuitive vocabulary for computer engineers • „Modest‟ adaption of cognitive science principles But • How to design good mappings? • Who determines the (predefined) mappings? • What grounds the meaning of the digital content? • Are humans part of computational systems, or is computation part of human practice? • Do we want technology to take over the cognitive load? • Is the body only a „physical constraint‟ or is there more to it? • Can we explain the significance of concrete design cases with DRC or do we need more?
  • 34. DRC applied to design: take home msg Distributed representation and computation leads to the design of predefined mappings to digital meanings
  • 35. Next lecture (2 weeks from now) Cognition is Distributed Computation Socially Situated!

Notas do Editor

  1. Introduction (5 min)Jelle van DijkRecent trends: Tangibles, wearables, ubicomp, location awareness, mobile: Embodied TechnologySome conferences…Cognitive Science: classical view (10 min)Most popular in 1970’s, 1980’s, and still today. Originated in cyberneticsReaction to behaviorismFodor (philosopher), Chomsky (Linguist), Simon (organizational theorist/economist), Newell, Marr, Minsky (computer scientists/theorists)Read: … (the one seminal paper)The mind (implemented by brain activity) is a computer: an information processing system.The purpose of the mind is to ‘understand’ the world by modeling it internally as a system of ‘mental representations’ of that worldInput (before) -output model: first perceive new state of world, update internal world model, calculate appropriate responseFrom serial to network-style models: big revolution in cognitive science, still very much ‘representational’ (internal vs outer world)Embodied Cognition: general idea (10 min)Going beyond neural networks: what if the world itself becomes part of the ‘network’ of interacting components that brings about the cognitive process?Modest positions (perhaps some things are dealt with without explicit internal reasoning) and extreme positions (the whole of western rationalistic philosophy and materialist science needs to be abandoned)Clark: (modest) Being There: putting brain, body and world together again; Suchman: (more radical) Plans and Situated Action; Dreyfus, Chemero (radical)Historic antecedents (dust brushed off) MerleauPonty, Heidegger, Schutz, Dewey, bits of ‘cybernetics’ (early fore-runner of cognitive science in 1940’s)Three strands: DRC, SSH, SCE (based on my thesis)BREAKDistributed Computation and Representation (15 min)Norman: memory in the worldHutchins: reasoning in the world: cognition as systemic outcome of interactions of people and tools in network (ship navigation)Kirsh: reasoning in the world: epistemic actions Cottage cheese.Clark: scaffolded mind piggy backing on reliably presdentxternal structure, (niche’s, Agre’s principles). 007 principle, Clark 2: using your body as physical tool for thinking (let lower level dynamics ‘solve’ the problem, e.g. robot rubber joints). Applications in design: (15 min)DjajadiningratIshiiDiscussion of the DRC perspective (15 min)Straightforward opportunities for application. Both in GUI and in TUI.Speaks the language of information processing, easy to understand for designers with computer engineer backgroundBUTWho decides on the mapping between form and content? How to get to the good mapping? (How Donald, tell us how?)Where does the meaning of the content itself comes from?Are humans computational units? (Or is computation a human practice?)What does it mean for human autonomy, if your technology ‘takes over for you’?How ‘embodied’ is this? Is it just a ‘physical constraint’ (norman) or is there a deeper sense in which cognition is ‘embodied’?
  2. THEORETICAL CONCLUSIONSMy theoretical analysis revealed three different interpretations of embodied cognition. The first focuses on the idea that people use the external world as a representation of information. The second focuses on the process of social coordination between people. And the third emphasizes the way sensorimotor couplings are formed while interacting with the environment.