SlideShare uma empresa Scribd logo
1 de 14
Cognitive Intersections: Meeting
Narrative, Semiotics, and Neuroscience in
Video Game Characters
Cody Mejeur
Department of English
Michigan State University
mejeurco@msu.edu
@cmejeur
A Question… Or Two.
What is the relationship between the cognitive and semiotics?
Addition: What is the relationship between the cognitive,
semiotics, and narrative?
Focus: Video Game Characters
Semiotics and Narrative
Signs in games (including characters) come
together
Play between them is narrative
Question of scale?
Analysis of narrative (particularly close
reading/analysis) requires focus on particular
signs and groups of signs
Extract out to larger structures
Always scripted and emergent qualities
Helpful Comparison: Pyramid of Popular Formula
Borrowing…
The Problem of Structure
Does structure actually match experience?
What do structures miss or exclude?
Always building yet another model?
What would narrative look like without structure?
Narrative as less of a structure, system,
taxonomy, etc., more of a force or cognitive
process? Less what it is, more what it does?
Can we design structures that are more fluid,
dynamic, adaptable, experiential?
A Thought Experiment
Striving for Dynamism
Semiotics and Cognition
Cognitive Semiotics and Cognitive Linguistics
Focus on neuroscience of individual letters,
sounds, words
Expanding to compound words, clauses,
phrases, sentences.
How does player use/interact with it?
Communication?
Constructing a Narrative?
Do signs accumulate?
Change over time according to scripted and
emergent relations
Character Sign
Signs and Players
All signs in games, especially characters, have
some relationship to the player
Signs are never fully stable
Always moving, changing
Limits to change, sign must cohere
Force relations within and between signs
Speaking of Player Perception… Narrative and
Cognition
Signs coming together in narrative
Difficulty of studying narrative via neuroscience
Assumption that activity or interface=narrative?
Challenging the Narrative/Play Distinction
Theory?
 Jenkins, Ryan, Walsh, Prince
 Degrees of Narrativity, Embedded/Emergent/Experiential
Narrative
Social Scientific Methods?
 Interview players
 Forums research
 Problem of sample sizes-is this inevitable?
Designing a fMRI experiment
 Test distinction/relationship between
narrative and play
 Problem: Controls, Isolating
“Narrative”
 Choice: Use First Person games
(shooters, exploration, etc.)
 Avoid character entanglements
 Mirror/Mimic Player
POV/Consciousness
 Question of interface
 Alexander Galloway–what
assumptions are built into the
interface?
 What are the narrative and cognitive
implications of the interface?
Screening Questionnaire
 Control for experience, predisposition toward or against
narrative
fMRI Play
 MRI compatible controller
 Eye-tracking, video recording
 Play segments of three games: Halo, Half-Life 2,
Bioshock. Similar play, different narrative
configurations.
Post Scanner Questionnaire and Oral Interview
 Modified Game Experience Questionnaire, Eindhoven
University of Technology
Steps to Experiment
Final Suggestions/Questions
Bringing together Semiotics, Narrative, and Cognition
(inc. Cognitive Neuroscience) can help us understand
video game characters and narrative meaning-making
in games
The reverse is also true: games can change our
concepts and theories
Challenge us to rethink narrative and our reliance
on structure
To what extent is this possible?
What are the benefits and limitations of neuroscience?
What does the study of game narrative look like when
it moves past model-making?

Mais conteúdo relacionado

Semelhante a Cognitive intersections: Meeting Narrative, Semiotics, and Neuroscience in Video Game Characters

The role of ai in social games eladhari2011 uppsalauni
The role of ai in social games eladhari2011 uppsalauniThe role of ai in social games eladhari2011 uppsalauni
The role of ai in social games eladhari2011 uppsalauniMirjam Eladhari
 
vgAlt ~ Video Games as Learning Tools
vgAlt  ~ Video Games as Learning ToolsvgAlt  ~ Video Games as Learning Tools
vgAlt ~ Video Games as Learning ToolsBrock Dubbels
 
Video games textual analysis
Video games textual analysisVideo games textual analysis
Video games textual analysishammonda
 
Teaching inception
Teaching inceptionTeaching inception
Teaching inceptionMike Gunn
 
Psychology of Design (UX Intensive for MySkills4Afrika)
Psychology of Design (UX Intensive for MySkills4Afrika)Psychology of Design (UX Intensive for MySkills4Afrika)
Psychology of Design (UX Intensive for MySkills4Afrika)Cheryl Platz
 
Modellazione affettiva sull’utente per migliorare l’interazione uomo-computer...
Modellazione affettiva sull’utente per migliorare l’interazione uomo-computer...Modellazione affettiva sull’utente per migliorare l’interazione uomo-computer...
Modellazione affettiva sull’utente per migliorare l’interazione uomo-computer...Women&Technologies
 
Playing with Digital Meaning: Video Games, Narrative, Cognition
Playing with Digital Meaning: Video Games, Narrative, CognitionPlaying with Digital Meaning: Video Games, Narrative, Cognition
Playing with Digital Meaning: Video Games, Narrative, CognitionCody Mejeur
 
Instructional Gaming
Instructional GamingInstructional Gaming
Instructional GamingKarl Kapp
 
Designing Ethical Dilemmas - Long
Designing Ethical Dilemmas - LongDesigning Ethical Dilemmas - Long
Designing Ethical Dilemmas - LongManveer Heir
 
Story-Game Design for Learning
Story-Game Design for LearningStory-Game Design for Learning
Story-Game Design for LearningNelson Zagalo
 
My Avatar and Me. Toward a Cognitive Theory of Game Characters
My Avatar and Me. Toward a Cognitive Theory of Game CharactersMy Avatar and Me. Toward a Cognitive Theory of Game Characters
My Avatar and Me. Toward a Cognitive Theory of Game CharactersFelix Schröter
 
Usd340gamesineducation 100216170518-phpapp02
Usd340gamesineducation 100216170518-phpapp02Usd340gamesineducation 100216170518-phpapp02
Usd340gamesineducation 100216170518-phpapp02niccel21
 
"Flipped, Agile, Gamiformed Pedagogy for Game Design" By Bill Guschwan - Seri...
"Flipped, Agile, Gamiformed Pedagogy for Game Design" By Bill Guschwan - Seri..."Flipped, Agile, Gamiformed Pedagogy for Game Design" By Bill Guschwan - Seri...
"Flipped, Agile, Gamiformed Pedagogy for Game Design" By Bill Guschwan - Seri...SeriousGamesAssoc
 
Emotions and Agents in Games
Emotions and Agents in GamesEmotions and Agents in Games
Emotions and Agents in GamesRui Prada
 

Semelhante a Cognitive intersections: Meeting Narrative, Semiotics, and Neuroscience in Video Game Characters (20)

The role of ai in social games eladhari2011 uppsalauni
The role of ai in social games eladhari2011 uppsalauniThe role of ai in social games eladhari2011 uppsalauni
The role of ai in social games eladhari2011 uppsalauni
 
vgAlt ~ Video Games as Learning Tools
vgAlt  ~ Video Games as Learning ToolsvgAlt  ~ Video Games as Learning Tools
vgAlt ~ Video Games as Learning Tools
 
382 sspin2011 melaniestegman
382 sspin2011 melaniestegman382 sspin2011 melaniestegman
382 sspin2011 melaniestegman
 
2011 1- the role of the game designer
2011  1- the role of the game designer2011  1- the role of the game designer
2011 1- the role of the game designer
 
Video games textual analysis
Video games textual analysisVideo games textual analysis
Video games textual analysis
 
Teaching inception
Teaching inceptionTeaching inception
Teaching inception
 
Games As Sims
Games As SimsGames As Sims
Games As Sims
 
Psychology of Design (UX Intensive for MySkills4Afrika)
Psychology of Design (UX Intensive for MySkills4Afrika)Psychology of Design (UX Intensive for MySkills4Afrika)
Psychology of Design (UX Intensive for MySkills4Afrika)
 
Modellazione affettiva sull’utente per migliorare l’interazione uomo-computer...
Modellazione affettiva sull’utente per migliorare l’interazione uomo-computer...Modellazione affettiva sull’utente per migliorare l’interazione uomo-computer...
Modellazione affettiva sull’utente per migliorare l’interazione uomo-computer...
 
Playing with Digital Meaning: Video Games, Narrative, Cognition
Playing with Digital Meaning: Video Games, Narrative, CognitionPlaying with Digital Meaning: Video Games, Narrative, Cognition
Playing with Digital Meaning: Video Games, Narrative, Cognition
 
Instructional Gaming
Instructional GamingInstructional Gaming
Instructional Gaming
 
2011 the role of the game designer
2011   the role of the game designer2011   the role of the game designer
2011 the role of the game designer
 
Designing Ethical Dilemmas - Long
Designing Ethical Dilemmas - LongDesigning Ethical Dilemmas - Long
Designing Ethical Dilemmas - Long
 
Designing
DesigningDesigning
Designing
 
Story-Game Design for Learning
Story-Game Design for LearningStory-Game Design for Learning
Story-Game Design for Learning
 
My Avatar and Me. Toward a Cognitive Theory of Game Characters
My Avatar and Me. Toward a Cognitive Theory of Game CharactersMy Avatar and Me. Toward a Cognitive Theory of Game Characters
My Avatar and Me. Toward a Cognitive Theory of Game Characters
 
Usd340gamesineducation 100216170518-phpapp02
Usd340gamesineducation 100216170518-phpapp02Usd340gamesineducation 100216170518-phpapp02
Usd340gamesineducation 100216170518-phpapp02
 
VR Engagement
VR EngagementVR Engagement
VR Engagement
 
"Flipped, Agile, Gamiformed Pedagogy for Game Design" By Bill Guschwan - Seri...
"Flipped, Agile, Gamiformed Pedagogy for Game Design" By Bill Guschwan - Seri..."Flipped, Agile, Gamiformed Pedagogy for Game Design" By Bill Guschwan - Seri...
"Flipped, Agile, Gamiformed Pedagogy for Game Design" By Bill Guschwan - Seri...
 
Emotions and Agents in Games
Emotions and Agents in GamesEmotions and Agents in Games
Emotions and Agents in Games
 

Último

Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Celine George
 
Science 7 Quarter 4 Module 2: Natural Resources.pptx
Science 7 Quarter 4 Module 2: Natural Resources.pptxScience 7 Quarter 4 Module 2: Natural Resources.pptx
Science 7 Quarter 4 Module 2: Natural Resources.pptxMaryGraceBautista27
 
Grade 9 Q4-MELC1-Active and Passive Voice.pptx
Grade 9 Q4-MELC1-Active and Passive Voice.pptxGrade 9 Q4-MELC1-Active and Passive Voice.pptx
Grade 9 Q4-MELC1-Active and Passive Voice.pptxChelloAnnAsuncion2
 
Karra SKD Conference Presentation Revised.pptx
Karra SKD Conference Presentation Revised.pptxKarra SKD Conference Presentation Revised.pptx
Karra SKD Conference Presentation Revised.pptxAshokKarra1
 
Q4 English4 Week3 PPT Melcnmg-based.pptx
Q4 English4 Week3 PPT Melcnmg-based.pptxQ4 English4 Week3 PPT Melcnmg-based.pptx
Q4 English4 Week3 PPT Melcnmg-based.pptxnelietumpap1
 
ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4MiaBumagat1
 
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptx
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptxMULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptx
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptxAnupkumar Sharma
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONHumphrey A Beña
 
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdfAMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdfphamnguyenenglishnb
 
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...Nguyen Thanh Tu Collection
 
ENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomnelietumpap1
 
Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Celine George
 
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxiammrhaywood
 
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Celine George
 
ACC 2024 Chronicles. Cardiology. Exam.pdf
ACC 2024 Chronicles. Cardiology. Exam.pdfACC 2024 Chronicles. Cardiology. Exam.pdf
ACC 2024 Chronicles. Cardiology. Exam.pdfSpandanaRallapalli
 

Último (20)

Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17
 
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptxYOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
 
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
 
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptxYOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
 
Science 7 Quarter 4 Module 2: Natural Resources.pptx
Science 7 Quarter 4 Module 2: Natural Resources.pptxScience 7 Quarter 4 Module 2: Natural Resources.pptx
Science 7 Quarter 4 Module 2: Natural Resources.pptx
 
Grade 9 Q4-MELC1-Active and Passive Voice.pptx
Grade 9 Q4-MELC1-Active and Passive Voice.pptxGrade 9 Q4-MELC1-Active and Passive Voice.pptx
Grade 9 Q4-MELC1-Active and Passive Voice.pptx
 
Karra SKD Conference Presentation Revised.pptx
Karra SKD Conference Presentation Revised.pptxKarra SKD Conference Presentation Revised.pptx
Karra SKD Conference Presentation Revised.pptx
 
Raw materials used in Herbal Cosmetics.pptx
Raw materials used in Herbal Cosmetics.pptxRaw materials used in Herbal Cosmetics.pptx
Raw materials used in Herbal Cosmetics.pptx
 
Q4 English4 Week3 PPT Melcnmg-based.pptx
Q4 English4 Week3 PPT Melcnmg-based.pptxQ4 English4 Week3 PPT Melcnmg-based.pptx
Q4 English4 Week3 PPT Melcnmg-based.pptx
 
ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4
 
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptx
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptxMULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptx
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptx
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
 
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdfTataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
 
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdfAMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
 
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
 
ENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choom
 
Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17
 
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
 
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
 
ACC 2024 Chronicles. Cardiology. Exam.pdf
ACC 2024 Chronicles. Cardiology. Exam.pdfACC 2024 Chronicles. Cardiology. Exam.pdf
ACC 2024 Chronicles. Cardiology. Exam.pdf
 

Cognitive intersections: Meeting Narrative, Semiotics, and Neuroscience in Video Game Characters

  • 1. Cognitive Intersections: Meeting Narrative, Semiotics, and Neuroscience in Video Game Characters Cody Mejeur Department of English Michigan State University mejeurco@msu.edu @cmejeur
  • 2. A Question… Or Two. What is the relationship between the cognitive and semiotics? Addition: What is the relationship between the cognitive, semiotics, and narrative? Focus: Video Game Characters
  • 3. Semiotics and Narrative Signs in games (including characters) come together Play between them is narrative Question of scale? Analysis of narrative (particularly close reading/analysis) requires focus on particular signs and groups of signs Extract out to larger structures Always scripted and emergent qualities
  • 4. Helpful Comparison: Pyramid of Popular Formula
  • 6. The Problem of Structure Does structure actually match experience? What do structures miss or exclude? Always building yet another model? What would narrative look like without structure? Narrative as less of a structure, system, taxonomy, etc., more of a force or cognitive process? Less what it is, more what it does? Can we design structures that are more fluid, dynamic, adaptable, experiential? A Thought Experiment
  • 8. Semiotics and Cognition Cognitive Semiotics and Cognitive Linguistics Focus on neuroscience of individual letters, sounds, words Expanding to compound words, clauses, phrases, sentences. How does player use/interact with it? Communication? Constructing a Narrative? Do signs accumulate? Change over time according to scripted and emergent relations
  • 10. Signs and Players All signs in games, especially characters, have some relationship to the player Signs are never fully stable Always moving, changing Limits to change, sign must cohere Force relations within and between signs
  • 11. Speaking of Player Perception… Narrative and Cognition Signs coming together in narrative Difficulty of studying narrative via neuroscience Assumption that activity or interface=narrative? Challenging the Narrative/Play Distinction Theory?  Jenkins, Ryan, Walsh, Prince  Degrees of Narrativity, Embedded/Emergent/Experiential Narrative Social Scientific Methods?  Interview players  Forums research  Problem of sample sizes-is this inevitable?
  • 12. Designing a fMRI experiment  Test distinction/relationship between narrative and play  Problem: Controls, Isolating “Narrative”  Choice: Use First Person games (shooters, exploration, etc.)  Avoid character entanglements  Mirror/Mimic Player POV/Consciousness  Question of interface  Alexander Galloway–what assumptions are built into the interface?  What are the narrative and cognitive implications of the interface?
  • 13. Screening Questionnaire  Control for experience, predisposition toward or against narrative fMRI Play  MRI compatible controller  Eye-tracking, video recording  Play segments of three games: Halo, Half-Life 2, Bioshock. Similar play, different narrative configurations. Post Scanner Questionnaire and Oral Interview  Modified Game Experience Questionnaire, Eindhoven University of Technology Steps to Experiment
  • 14. Final Suggestions/Questions Bringing together Semiotics, Narrative, and Cognition (inc. Cognitive Neuroscience) can help us understand video game characters and narrative meaning-making in games The reverse is also true: games can change our concepts and theories Challenge us to rethink narrative and our reliance on structure To what extent is this possible? What are the benefits and limitations of neuroscience? What does the study of game narrative look like when it moves past model-making?