Reflections on XR & AI in Education - iLRN Opening Keynote Kent Bye

Reflections on
XR & AI
in Education
@KentBye
Bye, K. (2023, May 18). "Reflections on XR & AI in Education." [Keynote Presentation] iLRN 2023: 9th International Conference of the Immersive
Learning Research Network. iLRNVirtual Campus Powered byVirbella; iLRN Main Stage.

● Overview of Some Learning Models
● Bye’s Elemental Theory of Presence
● iLRN Papers Through the Presence Lens
● Assessment
● Theories of Change
● AI, Ethics, & Privacy

Learning domains. CBL. (n.d.). https://casebasedlearning.weebly.com/learning-domains.html
4 Learning Domains

Cognitive Domain: Bloom’s Taxonomy (1956)
● Bloom, B.S. (1956) Taxonomy of Educational Objectives, Handbook: The Cognitive Domain. David McKay, New York.
● Image via Shabatura, J. (2018, March 19). “Using Bloom's Taxonomy to Write Effective Learning Objectives.” Teaching Innovation and Pedagogical Support, Retrieved
on Feb 1, 2020 from tips.uark.edu/using-blooms-taxonomy/

Affective Domain (Krathwohl et al., 1964)
● Krathwohl, D.R., Bloom, B.S., & Masia, B.B. (1964). Taxonomy of educational objectives: The classification of educational goals. Handbook II: Affective domain. New
York: David McKay Co.
● Image via
https://www.researchgate.net/profile/Md-Hoque-44/publication/330811334_Three_Domains_of_Learning_Cognitive_Affective_and_Psychomotor/links/5c54a5e9458515
a4c7502bd5/Three-Domains-of-Learning-Cognitive-Affective-and-Psychomotor.pdf

Psychomotor Domain (Harrow, 1972)
● Harrow, A.J. (1972). A taxonomy of the psychomotor domain. New York: David McKay Co.
● Image via https://mason.gmu.edu/~ndabbagh/cehdclass/Resources/IDKB/harrowstax.htm

Embodied Cognition Includes Body & World
Hummels, C., & van Dijk, J. (2015). Seven Principles to Design for Embodied Sensemaking. Proceedings of the Ninth International Conference on Tangible, Embedded, and
Embodied Interaction - TEI ’14. https://doi.org/10.1145/2677199.2680577

Klein, T. J., & Lewis, M. A. (2012). A physical model of sensorimotor interactions during locomotion. Journal of Neural Engineering, 9(4), 046011.
doi:10.1088/1741-2560/9/4/046011
Embodied Cognition as Nested Contexts (2012)

Some Models of Perception & Cognition
Contributing to Subjective Experiences of Presence
Mental
Models of
Reality
Sensory
Experience
of Reality

● Stefanics, G., Kremlácek, J., & Czigler, I. (2014). Visual mismatch negativity: a predictive coding view. Frontiers in Human Neuroscience, 8.
doi:10.3389/fnhum.2014.00666 Retrieved Feb 20, 2020 from:
https://www.researchgate.net/figure/Simplified-scheme-of-the-hierarchical-predictive-coding-framework-Friston-2005-2008_fig1_266401430.
● Millidge, B., Seth, A., & Buckley, C. L. (2022, January 22). Predictive coding: a theoretical and experimental review. arXiv preprint arXiv:2107.12979. Retrieved on April 23,
2022 from https://arxiv.org/abs/2107.12979
● Mendonça, D., Curado, M., & Gouveia, S. S. (Eds.). (2021). Philosophy and Science of Predictive Processing. Bloomsbury Academic.
Predictive Coding Theory of Neuroscience
(aka Predictive Processing)

Steinicke, F. (2021, March 31). B(l)ending Realities. Keynote lecture presented at The IEEE Conference on Virtual Reality and 3D User Interfaces in Spain (virtual), Libson.
Retrieved from https://www.youtube.com/watch?v=Ds-h1J4MFMI&t=13496s
Steinicke on Perceptual Loops with VR (2021)

Annetta, L. A. (2010). The “I’s” have it: A framework for serious educational game design. Review of General Psychology, 14(2), 105–112. https://doi.org/10.1037/a0018985
Annetta’s Framework for Serious Educational Game Design (2010)
● Instructional
● Informed Teaching
● Increasing Complexity
● Interactivity
● Immersion
● Identity

Dalgarno, B., & Lee, M. J. W. (2010). What are the learning affordances of 3-D virtual environments? British Journal of Educational Technology, 41(1), 10–32.
https://doi.org/10.1111/j.1467-8535.2009.01038.x
Dalgarno & Lee’s Model of Learning in
3D Virtual Learning Environments (2010)

Carlon, M. (2023, May 10). iLRN2023: Trial Assessment of Online Learners' Engagement with 360-degree Architecture Videos [Presentation]. The 9th International Conference of
the Immersive Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=rfTCp3QzZFQ
iLRN Sampling of Presentations
Immersion, Presence, Interaction (Carlon 2023)

Learning Design Domains (Karlseder 2023)
Karlseder, M. (2023, May 17). iLRN2023: Work-in-Progress—Gamified Experiential Learning of Human Anatomical Structures [Presentation]. The 9th International Conference of
the Immersive Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=7QCNfLG34Us

Lamoureaux, N., Moskalyk, K. & MacDowell, P.(2023, May 9). iLRN2023: Truth with Hope: Teaching the SDGs through Immersive Learning. [Presentation]. The 9th International
Conference of the Immersive Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=aYenWZLbdeY
Immersive Design Principles (Lamoureaux et al 2023)

Becoming Problem Solvers (Lamoureaux et al. 2023)

Jiang, J. (2023, May 15). iLRN2023: Exponenself: Discover your identity from virtual reality to reality [Presentation]. The 9th International Conference of the Immersive Learning
Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=FXHEBP6IGeA
Learning Differentiators (Jiang 2023)

Fernes, D. (2023, May 12). iLRN2023: Work-in-Progress Preservice Teachers’ Perceptions of Advantages of Virtual and Augmented [Presentation]. The 9th International
Conference of the Immersive Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=ZTrXKzFzr90
XR Learning Affordances (Fernes 2023)

Bye, K. (2022, May 5). A Primer on Presence, Immersive Storytelling, & Experiential Design. [Presentation] Storycon: A collision of (he)art and technology. Brussels, Belgium;
BOZAR - Centre for Fine Arts. Video available at https://www.youtube.com/watch?v=n_2_qvIymt4. Photo by Amir Khidojatov
A Primer on Presence,
Immersive Storytelling,
& Experiential Design

Meta Quest. (2014, October 1). Oculus Connect Keynote: Brendan Iribe and Nate Mitchell. [Presented on September 20, 2014 at Oculus Connect, Loews Hollywood Hotel, Los
Angeles, CA]. YouTube. Retrieved April 21, 2022, from https://www.youtube.com/watch?v=1xeK8zUXAvQ

Slater’s Place Illusion & Plausibility Illusion (2009)
Slater, M. (2009, Dec 14). Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philosophical Transactions of the Royal Society B:
Biological Sciences, 364(1535), 3549–3557. doi:10.1098/rstb.2009.0138.
Images via Toast (2019, July 21). Richie's Plank Experience Oculus Quest Trailer. YouTube Retrieved on April 25, 2022 from https://www.youtube.com/watch?v=faNsP7ExSt0.
Plausibility Illusion
“the illusion that what is apparently
happening is really happening (even
though you know for sure that it is
not).”
Place Illusion
“It is the strong illusion of being in a
place in spite of the sure knowledge
that you are not there.”

Mental & Social
Presence
Active
Presence
Emotional
Presence
Embodied &
Environmental
Presence

Making
Choices
Taking
Action
Emotional
Immersion
Sensory
Experience

VR, AR,
& Immersive Theatre
Books
Film
Radio
Video Games
Internet
TV
Theatre
Mobile Phone
Oral
Storytelling

Cognitive
Domain
Psychomotor
Domain
Aﬀective
Domain
[Embodied
Cognition]

Active Presence
Agency, Interactions, Dynamics,
Action, Locomotion, Exploration,
Spontaneity, Creativity, Will,
Engagement, Gameplay,
Intention, & Live Performance.
Emotional Presence
Emotional Immersion, Feelings,
Mood, Vibe, Color, Lighting,
Consonance & Dissonance
Cycles, Music, Story, Time,
Flow, Narrative Presence,
Empathy, & Compassion
Mental & Social Presence
Thoughts, Language, Choices,
Expectations & Novelty, Mental
Models, Plausibility, Coherence,
Attention, Suspension of Disbelief,
Puzzles, Mental Friction, Rules,
Social Presence, & Virtual Beings
Bye, K. (2022, May 5) "A Primer on Presence, Immersive Storytelling, & Experiential Design." [Presentation]
Storycon:A collision of (he)art and technology. BOZAR. Brussels, Belgium.
Embodied &
Environmental Presence
Self-Presence, Body, Embodiment,
Sensory Experience, Biometric &
Physiological Data, BCIs & Neural Inputs,
Haptics, Immersive Sound, Spatial
Presence, Environmental Immersion, &
Architecture

Plausibility
Illusion
Place
Illusion

Slater Has Emphasized the Perceptual,
Sensorimotor Contingencies (2009)
“Immersive systems can be
characterized by the
sensorimotor contingencies
(SCs) that they support…” as
they “...define a set of valid
actions that are meaningful in
terms of perception within the
virtual environment depicted.”
● Slater, M. (2009, Dec 14). Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philosophical Transactions of the Royal Society
B: Biological Sciences, 364(1535), 3549–3557. https://doi.org/10.1098/rstb.2009.0138.
● Bye, K. & Slater, M.. (2017, July 14). #556: Mel Slater’s Theory of VR Presence vs an Elemental Theory of Presence. Voices of VR Podcast. Retrieved on March 23, 2023
from https://voicesofvr.com/556-mel-slaters-theory-of-vr-presence-vs-an-elemental-theory-of-presence/.

Slater et al (2022) Update to Presence Illusions adds
Body Ownership Illusion (Embodiment) & Copresence
Slater, M., Banakou, D., Beacco, A., Gallego, J., Macia-Varela, F., & Oliva, R. (2022). A separate reality: An update on place illusion and plausibility in virtual reality. Frontiers in
Virtual Reality, 3. https://doi.org/10.3389/frvir.2022.914392

Plausibility Illusion
& Copresence Illusion
Place Illusion &
Body Ownership Illusion
(aka Embodiment)

Skarbez, R., Brooks, Jr., F. P., & Whitton, M. C. (2017). A Survey of Presence and Related Concepts. ACM Computing Surveys, 50(6), 1–39. https://doi.org/10.1145/3134301
Overview & Categorize other Presence Theory
Approaches Surveyed in Skarbez et al, 2017

Survey of Presence Concepts (Skarbez et al, 2017)

Survey of Presence Concepts (Skarbez et al, 2017):
Social Presence Illusion & Copresence Illusion

Plausibility Illusion,
Social Presence Illusion,
& Copresence Illusion
Place Illusion

● Skarbez, R. (2016, December 4). Thank you! From a Voices of VR alum. Personal Communication to Bye, K.
● Skarbez, R., Brooks, Jr., F. P., & Whitton, M. C. (2017). A Survey of Presence and Related Concepts. ACM Computing Surveys, 50(6), 1–39. doi:10.1145/3134301
I got a brief mention in Skarbez et al’s 2017 survey
Skarbez tips me off to Chertoff’s Presence Work (2016, Dec 4)

Chertoff’s Experiential Design & Presence Work (2008-2010) via Skarbez
Chertoff, D. B., Schatz, S. L., McDaniel, R., & Bowers, C. A. (2008). Improving Presence Theory Through Experiential Design. Presence: Teleoperators and Virtual Environments,
17(4), 405–413. doi:10.1162/pres.17.4.405

Chertoff’s Review of Presence Theory Components (2009)
Chertoff, Dustin, "Exploring Additional Factors Of Presence" (2009). Electronic Theses and Dissertations. 3910.
https://stars.library.ucf.edu/etd/3910

“The process of using these dimensions to create such an
experience is known as experiential design” - Chertoff (2010)
● Chertoff, Dustin, "Exploring Additional Factors Of Presence" (2009). Electronic Theses and Dissertations. 3910. https://stars.library.ucf.edu/etd/3910
● Chertoff, D. B., Goldiez, B., & LaViola, J. J. (2010). Virtual Experience Test: A virtual environment evaluation questionnaire. 2010 IEEE Virtual Reality Conference (VR).
doi:10.1109/vr.2010.5444804
Experiential Design "originated from the marketing field
where it was used to encourage people to create meaningful
emotional and social connections to a product."

Cognitive &
Relational
Active
Aﬀective
Sensory

Schmitt, B. (1999). Experiential marketing. Journal of marketing management, 15(1-3), 53-67.
Experiential Marketing: “Strategic Experiential Modules” (1999)
● Sense
● Feel
● Think
● Act
● Relate

Think,
Relate
Act
Feel
Sense
[Text via] Schmitt, B. (1999). Experiential marketing. Journal of marketing management, 15(1-3), 53-67.

Brakus, J. J., Schmitt, B. H., & Zarantonello, L. (2009). Brand experience: what is it? How is it measured? Does it affect loyalty?. Journal of marketing, 73(3), 52-68.
https://doi.org/10.1509/jmkg.73.3.052
Measuring Brand Experience (2009)
● Sensory
● Affective
● Behavioral
● Intellectual

Intellectual
Behavioral
Aﬀective
Sensory

Jung’s Psychological Types (1921)
Jung, C. G. (1976). Psychological types. In R. F. C. Hull (Trans.), The collected works of C. G Jung | Complete Digital Edition (Vol. 6). (paragraph [7]) Princeton, NJ: Princeton
University Press. (Original work published 1921).
“I have found from experience that
the basic psychological functions,
that is, functions which are
genuinely as well as essentially
different from other functions,
prove to be thinking, feeling,
sensation, and intuition...” [7]

Thinking
Intuition
Feeling
Sensing
Jung, C. G. (1976). Psychological types. In R. F. C. Hull (Trans.), The collected works of C. G Jung | Complete Digital Edition (Vol. 6). (paragraphs [7] ) Princeton, NJ: Princeton
University Press. (Original work published 1921).

Active Presence
● Agency
● Modify Environment
● Engagement
● Participation
● Control
● Plausibility Illusion [Interactivity]
● Action Fidelity
Emotional Presence
● Involvement & Engagement
● Flow
● Absorption
● Engrossment
● Transportation & Transportability
● Total Immersion
● Narration & Dramatic Presence
● Meaningfulness
Embodied & Environmental Presence
● Sensory Presence & Sensory Modality
● Embodiment, Body Ownership, Avatar,
Self-Presence, & Subjective Personal Presence
● Perceptual Immersion
● Spatial Presence, Place Illusion
● Realism, Fidelity, Scene Realism,
Experiential Fidelity
● Multimodal Presentation, Telepresence
● Separation Anxiety
● Telepresence Mental Model
● Co-Presence with Others
● Anticipation of Events
● Consistency of
Information
● Interface Awareness
● Communicative
Immersion
● Plausibility Illusion
● Coherence
● Reality Judgment
● Cognitive Absorption
● Social Presence
● Selective Attention
● Psychological
Immersion

Active
Presence
Embodied &
Environmental
Presence

Bailenson, J. (2018). Experience on Demand: What virtual reality is, how it works, and what it can do. W.W. Norton and Company.
“The bottom line is, if an experience
is not impossible, dangerous,
expensive, or counterproductive,
then you should seriously consider
using a different medium—or even
doing it in the real world. Save VR
for the special moments.”
Bailenson (2018) VR’s Sweet Spot is D.I.C.E. =
“Dangerous, Impossible, Counterproductive, Expensive”

Tahiri, Y. (2023, May 10). iLRN2023: Work-In-Progress – A Virtual Reality Application for Learning Geometry. [Presentation]. The 9th International Conference of the Immersive
Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=UBWQMltnWxw
Continuous Feedback with Haptics (Tahiri 2023)

Cardoso, D. C. (2023, May 12). iLRN2023: Work-in-Progress—The Impact World: the design process of an Immersive Web Environment [Presentation]. The 9th International
Conference of the Immersive Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=r1OVcSzDFS0
Scale of virtual objects - Cardoso (2023)

Andrei, M. (2023, May 17). iLRN2023: Work-in-Progress-Visualising the Impacts of Climate Change with Immersive Technology [Presentation]. The 9th International Conference
of the Immersive Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=rI6OG2MdvkM
Relational Dynamics of the Environment (Andrei 2023)

Relational Dynamics of the Environment (Andrei 2023)
Andrei, M. (2023, May 17). iLRN2023: Work-in-Progress-Visualising the Impacts of Climate Change with Immersive Technology [Presentation]. The 9th International Conference
of the Immersive Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=rI6OG2MdvkM

Xu, Y., Huang, M., Sun, W., Yang, R. Imparto, M. & Liang, H-N. (2023, May 10). iLRN2023: Designing an AR-based Materials Library for Higher Education Offering A Four-know
Learning [Presentation]. The 9th International Conference of the Immersive Learning Research Network. Retrieved May 17, 2023 from
https://www.youtube.com/watch?v=-oq5tx6-0Uo
Mixed Reality Spectrum (Huang et al 2023)

Aebersold, Michelle. (2023, April 18). ANA Foundation Grant: The Big Ten Practice-Ready Nursing Initiative [Presentation]. Extended Reality (XR) at Michigan Summit 2023.
Ann Arbor, Michigan; Center for Academic Innovation, Pendleton Room. https://www.youtube.com/watch?v=VgJvkBN_Y3Q
Teaching Procedural Knowledge to Nurses (Aebersold 2023)

Yatluk, L. (2023, May 11). iLRN2023: Work-in-Progress—Studying the Impact of the Virtual Course Magnetic Field. Electromagnetic [Presentation]. The 9th International
Conference of the Immersive Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=Ix6pQHWhB3M
Spatial visualization (Yatluk 2023)

Xu, Z. et al. (2023, May 14). iLRN2023: Development of a 3D Modelling Gallery based on Virtual Reality [Presentation]. The 9th International Conference of the Immersive
Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=nCV-2kfcIeY
Gallery to explore 3D models (Xu 2023)

Kim. K, et al (2023, May 10). iLRN2023: Multimodal Data as Users Performance Recording in XR-based Training Simulation Environment [Presentation]. The 9th International
Conference of the Immersive Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=64xgIRskwJI
Including Multi-Modal Embodied Data (Kim et al., 2023)

Embodied Journey (Jiang 2023)

Avatar Creation & Identity (Jiang 2023)

Identity (Jiang 2023)

Bye, K. (2016, April 28). The Human Experience of Virtual Reality: A Model of the VR Landscape [Presentation],
Silicon Valley Virtual Reality Conference, April 28, 2016 (San Jose, CA). Published on YouTube, May 3, 2016. Retrieved on November 10, 2021 from
https://www.youtube.com/watch?v=acp0Ul0QlmI. Also Published on Voices of VR Podcast on May 4, 2016. Retrieved on November 10, 2021 from
https://voicesofvr.com/355-the-human-experience-of-virtual-reality-a-model-of-the-vr-landscape/.

Embodiment and Self-Dialogue (Jiang 2023)

Onboarding & Offboarding (Mishra 2023)
Mishra, A. (2023, May 16). iLRN2023: Work-in-Progress—Visitor Onboarding for On-Site Mixed Reality Experiences in Museums [Presentation]. The 9th International Conference
of the Immersive Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=mgGZt6bJMTg

Mishra, A. (2023, May 16). iLRN2023: Work-in-Progress—Visitor Onboarding for On-Site Mixed Reality Experiences in Museums [Presentation]. The 9th International Conference
of the Immersive Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=mgGZt6bJMTg
Onboarding & Offboarding (Mishra 2023)

Immersive Adventures (Han 2023)
Han, U. (2023, May 16). ILRN2023: Applying Virtual Reality (VR) for Immersive Experiential Learning in Underserved Rural [Presentation]. The 9th International Conference of
the Immersive Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=EvMQPVFKitg

Fernes, D. (2023, May 12). iLRN2023: Work-in-Progress Preservice Teachers’ Perceptions of Advantages of Virtual and Augmented [Presentation]. The 9th International
Conference of the Immersive Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=ZTrXKzFzr90
Motivation and Engagement (Fernes 2023)

Berry, Justin (2023, April 18). XR Design: Empowering the Next Generation of Creators [Presentation]. Extended Reality (XR) at Michigan Summit 2023. Ann Arbor, Michigan;
Center for Academic Innovation, Pendleton Room. https://www.youtube.com/watch?v=VgJvkBN_Y3Q

Active
Presence
Emotional
Presence

Georgieva, Maya. (2023, April 18). XR Design: Empowering the Next Generation of Creators [Presentation]. Extended Reality (XR) at Michigan Summit 2023. Ann Arbor,
Michigan; Center for Academic Innovation, Pendleton Room. https://www.youtube.com/watch?v=VgJvkBN_Y3Q

Lotero. A. D. C. & Reis. A. B. (2023, May 12). iLRN2023: Work-in-Progress—Immersive Media and War Reporting in Colombia: Uses, Potentialities [Presentation]. The 9th
International Conference of the Immersive Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=PwVC4OOqMBo
360 Video survey (Lotero & Reis 2023)

Bakare, T. (2023, May 15). iLRN2023: Using Virtual Reality to Drive Social Inclusion for Children on the Autism Spectrum [Presentation]. The 9th International Conference of the
Immersive Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=J7kVTgrfrkM
Empathizing with Autism (Bakare 2023)

National Autistic Society. (2016, June 9). Autism TMI virtual reality experience. YouTube. https://www.youtube.com/watch?v=DgDR_gYk_a8
Empathizing with Autism (2016) (Bakare 2023)

Active
Presence
Mental & Social
Presence

x

Bailenson, Jeremy (2022, February 23). Your Mind on the Metaverse [Presentation] Stanford Human-Centered Artificial Intelligence Lab Weekly Seminary. Stanford
University; Zoom

Dmitriy, V. (2023, May 11). iLRN2023: Role of adaptation phase in educational results of Virtual Reality communication training [Presentation]. The 9th International Conference
of the Immersive Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=n4sTI1DiKOU
Theory of Cognitive Load (Dmitriy 2023)

Cicero, T. et al. (2023, May 14). iLRN2023: Mystery of the Lehigh Gap: Summary of the Visual Aspects Designed and Developed [Presentation]. The 9th International
Conference of the Immersive Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=xbakl8md6Ls
Dialogue-Based Story Interactions (Cicero et al., 2023)

Theriault, Rob. (2023, April 18). Exploring & Deploying XR in Higher Education [Presentation]. Extended Reality (XR) at Michigan Summit 2023. Ann Arbor, Michigan; Center
for Academic Innovation, Pendleton Room. https://www.youtube.com/watch?v=VgJvkBN_Y3Q

TeachLivE pioneered Wizard of Oz Techniques (2005)
Bye, K., Hughes, C. (2016, July 31) Voices of VR Podcast. #409: Wizard of Oz Narratives: Puppeting Virtual Characters with Improv Acting. Retrieved November 13, 2021, from
https://voicesofvr.com/409-wizard-of-oz-narratives-puppeting-virtual-characters-with-improv-acting/.

Teaching Teachers with Wizard of Oz Techniques (Bondie 2023)
● Bondie, R. (2023, May 17). iLRN2023: Exploring Data Visualization in Mixed Reality Simulations to Measure Teacher Responsiveness [Presentation]. The 9th
International Conference of the Immersive Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=e5kUH5f-8O4
● Agile Teacher Lab. (2023, May 8). Providing feedback to teachers. YouTube. https://www.youtube.com/watch?v=Xsda44nD-70

Vallance, M. (2023, May 11). iLRN2023: Independently Supporting Learners in VR with an AI-enabled Non-Player Character (NPC) [Presentation]. The 9th International
Conference of the Immersive Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=UTqq7LMhOmQ
AI NPC Assisting with Building a Virtual PC (Vallance 2023)

Dmitriy, V. (2023, May 11) .iLRN2023: Role of adaptation phase in educational results of Virtual Reality communication training [Presentation]. The 9th International Conference
of the Immersive Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=n4sTI1DiKOU
AI-controlled avatar

Yano, K. (2023, May 14). iLRN2023: A framework for analyzing students' behavior in virtual spaces on Mozilla Hubs [Presentation]. The 9th International Conference of the
Immersive Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=WhvFj22A6B4
Using Heatmaps to analyze user behavior

Ferrer, C. D. R. et al. (2023, May 12). iLRN2023: Work-in-Progress—Exploring the Effectiveness of Multi-User Basic Workflow Assessment [Presentation]. The 9th International
Conference of the Immersive Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=0yUmEVRrCDU
Participants & Observers in Virtual World (Ferrer et al. 2023)

Salcedo, D. (2023, April 18). Building and Maintaining Successful XR Programs [Presentation]. Extended Reality (XR) at Michigan Summit 2023. Ann Arbor, Michigan; Center
for Academic Innovation, Pendleton Room. https://www.youtube.com/watch?v=VgJvkBN_Y3Q
Substitution (Salcedo 2023)

Salcedo, Daniel. (2023, April 18). Building and Maintaining Successful XR Programs [Presentation]. Extended Reality (XR) at Michigan Summit 2023. Ann Arbor, Michigan;
Augmentation (Salcedo 2023)

Modification (Salcedo 2023)

Redefinition (Salcedo 2023)

Bailenson, Jeremy (2022, February 23). Your Mind on the Metaverse [Presentation] Stanford Human-Centered Artificial Intelligence Lab Weekly Seminary. Stanford
University; Zoom
STRIVR Scaling Mentorship Training with VR (Bailenson 2022)

Simon Wardley’s Model of Technology Evolution
Wardley, S. (2015, March 8). Evolution, diffusion, hype cycle and early failures. Retrieved December 17, 2021, from
https://blog.gardeviance.org/2015/03/evolution-diffusion-hype-cycle-and.html

Prototype &
Genesis
Custom-Built
Enterprise App
Ubiquitous
Commodity
Consumer
Product
Wardley, S. (2015, March 8). Evolution, diffusion, hype cycle and early failures. Retrieved December 17, 2021, from

Sword of Damocles
Initial Prototype: Sword of Damocles (1968)
Sutherland, I. E. (1968, December). A head-mounted three dimensional display. In Proceedings of the December 9-11, 1968, fall joint computer conference, part I (pp. 757-764).

Sword of Damocles
Custom Bespoke Apps: VPL Research (1985-1992)
Photo by Kevin Kelly via Cox, D. (n.d.). Mise-en-Experience. Other Cinema. Retrieved March 9, 2023, from http://www.othercinema.com/otherzine/mise-en-experience/

Sword of Damocles
Consumer VR (2013-Present)
Watts, S. (2019, October 29). #VR headsets:top shelf: Oculus DK1 > DK2 > CV1 > Quest. Vive VK1 > Pre > Pro > Focus. 2nd row: Gear VRS > Oculus go. Pico Neo. Acer WMR
> Samsung WMR. 3rd row: Dead mobile VR hmds. OSVR. Fove. Pico G2. Twitter. Retrieved December 17, 2021, from https://twitter.com/vr_sam/status/1189169806198693892

Sword of Damocles
AR/VR as Ubiquitous Commodity? ETA?
Amazon. (2022). The Peripheral. whole.

Ubiquitous
Commodity
Consumer
Product
Adaptation of Wardley, S. (2015, March 8). Evolution, diffusion, hype cycle and early failures. Retrieved December 17, 2021, from
Custom-Built
Enterprise App
Prototype &
Genesis

SAMR Model of Educational Technology Diffusion
● Puentedura, R. (2006, August 18). Transformation, technology, and education [Presentation]. Strengthening Your District Through Technology workshops, Maine Department of Education.
Retrieved on May 18, 2023 from http://hippasus.com/resources/tte/
● Image via Schrock, K. (2013, November 9). Resources to support the SAMR Model. Kathy Schrock’s Guide to Everything. http://www.schrockguide.net/samr.html

Vanhulsel, A. (2023, May 10). iLRN2023: Towards a University-Wide Implementation of Extended Reality [Presentation]. The 9th International Conference of the Immersive
Learning Research Network. Retrieved May 17, 2023 from https://www.youtube.com/watch?v=7t2jTRI01wA
Applying Anderson’s Theory of Change (Vanhulsel 2023)

Anderson, A.A. (2006). The Community Builder's Approach to Theory of Change. A practical guide to theory development. New York: The Aspen Institute Roundtable on
Community Change. Retrieved on May 18, 2023 from https://www.theoryofchange.org/pdf/TOC_fac_guide.pdf.
Anderson’s Theory of Change (2006)

Some Preliminary Thoughts
on Artificial Intelligence
@KentBye
Bye, K. (2023, April 20). Some Preliminary Thoughts on Artificial Intelligence. [Presentation] The King Library Experiential Virtual
Reality Lab (KLEVR) Tech Talks: AI Tools, Tips, & Traps; San Jose State University, San Jose, California via Zoom.

Dartmouth Summer Research Project
on Artificial Intelligence (Jun-Aug 1956)
● Wikimedia Foundation. (2023, April 14). Dartmouth Workshop. Wikipedia. Retrieved April 20, 2023, from https://en.wikipedia.org/wiki/Dartmouth_workshop
● Image via Veisdal, J. (2023, February 19). The Birthplace of AI. Medium. Retrieved April 25, 2023, from https://www.cantorsparadise.com/the-birthplace-of-ai-9ab7d4e5fb00

NVIDIA Corporation: History. NVIDIA. (2019, January 11). Retrieved April 20, 2023, from https://www.nvidia.com/en-us/about-nvidia/corporate-timeline/
NVIDIA GPU (1999)

Rise of AI as Computation Increases
Photo via Gianttino, C., Mathieu, E., & Roser, M. (2022, December 6). The brief history of artificial intelligence: The world has changed fast – what might be next? Our World in
Data. Retrieved April 20, 2023, from https://ourworldindata.org/brief-history-of-ai
10 billion petaFLOP
10 FLOP

Deng, J., Dong, W., Socher, R., Li, L.-J., Kai Li, & Li Fei-Fei. (2009). ImageNet: A large-scale hierarchical image database. 2009 IEEE Conference on Computer Vision and Pattern
Recognition. https://doi.org/10.1109/cvpr.2009.5206848
ImageNet Paper & Database (2009)

Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). ImageNet classification with deep convolutional neural networks. Proceedings of the 25th International Conference on Neural
Information Processing Systems (Lake Tahoe, NV, Dec. 2012), 1097–1105. Retrieved on April 20, 2023 from
https://proceedings.neurips.cc/paper_files/paper/2012/file/c399862d3b9d6b76c8436e924a68c45b-Paper.pdf
Deep Learning Revolution Starts (2012)

AlphaGo Beats Sedol (2016)
The challenge match. DeepMind. (2021, May 18). Retrieved April 20, 2023, from https://www.deepmind.com/research/highlighted-research/alphago/the-challenge-match

● Wikimedia Foundation. (2023, April 18). Large language model. Wikipedia. Retrieved April 20, 2023, from https://en.wikipedia.org/wiki/Large_language_model
● Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G.,
Henighan, T., Child, R., Ramesh, A., Ziegler, D. M., Wu, J., Winter, C., Amodei, D. (2020, July 22). Language models are few-shot learners. Advances in neural information
processing systems, 33, 1877-1901. Retrieved April 20, 2023, from https://arxiv.org/abs/2005.14165
● OpenAI. (2020, December 7). 🎉 Congratulations to the GPT-3 team for earning a best paper award this morning at #neurips2020! https://t.co/gvc5brkz5z. Twitter.
Retrieved April 25, 2023, from https://twitter.com/OpenAI/status/1336000843368210432
Large Language Models Emerge (2018-2020)

Lecun - LLMs are Doomed
● NYU Center for Mind, Brain, and Consciousness. (2023, March 24). The Philosophy of Deep Learning. Retrieved April 20, 2023, from https://phildeeplearning.github.io/
● LeCun, Y. (2023, April 5). Debate: Do language models need sensory grounding for meaning and understanding? YouTube. Retrieved April 20, 2023, from
https://www.youtube.com/watch?v=x10964w00zk&list=PLY_s7b9LrR8W-AGC95PU43oYlERY2IQAk&index=1

Famous Stochastic Parrots Paper by AI Ethicists (2021)
● Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021). On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?. Proceedings of the 2021
ACM Conference on Fairness, Accountability, and Transparency. https://doi.org/10.1145/3442188.3445922

Vincent, J. (2021, April 13). Google is poisoning its reputation with AI researchers. The Verge. Retrieved April 20, 2023, from
https://www.theverge.com/2021/4/13/22370158/google-ai-ethics-timnit-gebru-margaret-mitchell-firing-reputation
Controversy Over Google Firing AI Ethicists (2021)

Ferguson, K. (2023, March 7). AI and Image Generation (Everything is a Remix Part 4). YouTube. Retrieved April 27, 2023, from
https://www.youtube.com/watch?v=rswxcDyotXA
Kirby Ferguson’s “Everything is a Remix” Series & Fair Use

● Butterick, M. (2023, January 13). Stable Diffusion Litigation. Joseph Saveri Law Firm & Matthew Butterick. Retrieved April 28, 2023, from https://stablediffusionlitigation.com/
● Andersen v. Stability Ai Ltd., 3:23-cv-00201. CourtListener. (2023, January 13). Retrieved April 28, 2023, from https://www.courtlistener.com/docket/66732129/andersen-v-stability-ai-ltd/
● Ho, J., Jain, A., & Abbeel, P. (2020, December 16). Denoising Diffusion Probabilistic Models. arXiv.org. Retrieved April 28, 2023, from https://arxiv.org/abs/2006.11239
Artists Sue Generative AI Companies Claiming:
“Diffusion is a way for an AI program to figure out how to
reconstruct a copy of the training data through denoising.”

Todasco, M. (2022, November 7). What AI thinks CEOS look like. LinkedIn. Retrieved April 20, 2023, from
https://www.linkedin.com/pulse/what-ai-thinks-ceos-look-like-michael-todasco/
Bias in AI: Most Generative AI Systems Depict CEOs as Male

Algorithmic Bias
Kantayya, S (2021, March 22). Coded Bias. PBS. Retrieved April 20, 2023 from https://www.pbs.org/independentlens/documentaries/coded-bias/

Self-Regulation
Bye, K. & Leufer, D. (2023, March 7) #1177: How the EU’s AI Act Could Impact Biometric Data Definitions & XR Privacy. Voices of VR Podcast. Retrieved April 20, 2023 from
https://voicesofvr.com/1177-how-the-eus-ai-act-could-impact-biometric-data-definitions-xr-privacy/
AI Act Takes a Human Rights Approach & Not a Utilitarian One

● Comonline. (2022, December 16). A fit for purpose and borderless European Artificial Intelligence Regulation. Telefónica. Retrieved April 20, 2023, from
https://www.telefonica.com/en/communication-room/blog/a-fit-for-purpose-and-borderless-european-artificial-intelligence-regulation/
● Bye, K. & Leufer, D. (2023, March 7) #1177: How the EU’s AI Act Could Impact Biometric Data Definitions & XR Privacy. Voices of VR Podcast. Retrieved April 20, 2023
from https://voicesofvr.com/1177-how-the-eus-ai-act-could-impact-biometric-data-definitions-xr-privacy/
AI Act Lays Out a Tiered Set of Risks

@KentBye
Bye, K. (2023, April 13). Landscape of XR Moral Dilemmas & Ethical Considerations.
[Keynote Presentation]. Laval Virtual, Laval, France; Espace Mayenne.
Landscape of
XR Moral Dilemmas &
Ethical Considerations

Bernal, G. (2021,April 15). Developing Galea:An open source tool at the intersection ofVR and neuroscience. MIT Media Lab. https://www.media.mit.edu/posts/galea/.
Presence Qualities of Biometric Sensors on OpenBCI’s Project GALEA

Eye Tracking and Pupil Response
Facial Scans
Movement Kinematics
Electrodermal Activity (EDA)
Galvanic Skin Response (GSR)
Skin Conductance Response (SCR)
Skin Conductance (SC)
Skin Temperature (SKT)
Body Temperature
Electromyography (EMG)
Mechanomyogram (MMG)
Strain-Based Sensor (SBS)
Electrocardiography (ECG / EKG)
Heart-RateVariability (HRV)
Respiratory (RSP)
Respiratory RateVariability (RRV)
Photoplethysmogram (PPG)
Impedance Plethysmography (IPG)
BloodVolume Pulse (BVP)
Electro-Oculogram (EOG)
Impedance Cardiography (ICG)
Gyrocardiography (GCG)
Ballistocardiography (BCG)
Magnetocardiography (MCG)
Seismocardiography (SCG)
Phonocardiogram (PCG)
Continuous Glucose Monitor (CGM)
Acoustic Respiratory Signals (ARS)
Blood Pressure (BP)
Pulse Arrival Time (PAT)
Pulse Transit Time (PTT)
Electroretinogram (ERG)
Electrogastrogram (EGG)
Magnetogastrography (MGG)
Electroencephalography (EEG)
Near-Infrared Spectroscopy-Based Cerebral
Oxiometry (NIRSCO)
Optically-Pumped Magnetoencephalography
(OP-MEG)
Optically-Pumped Magnetometers
Magnetoencephalography (OPM-MEG)
Time Domain Functional Near-Infrared
Spectroscopy (TD-fNIRS)
Functional Near-Infrared Spectroscopy (fNIRS)
High-Density Diffuse Optical Tomography
(HD-DOT)
Intracranial Pressure (ICP)
Electrocorticography (ECoG)
Intracranial electroencephalography (iEEG)
Deep Brain Stimulation (DBS)
Local Field Potential (LFP)
Transcranial Doppler (TCD)
Somatosensory Evoked Potential (SSEP)
Brainstem Auditory Evoked Potential (BAEP)
Functional Magnetic Resonance Imaging
(fMRI)
Magnetic Resonance Imaging (MRI)
Positron Emission Tomography (PET)
Magnetoencephalography (MEG)
Nuclear Magnetic Resonance Spectroscopy
(NMR or MRS)
Subdural EEG (sdEEG)
Intracranial EEG (icEEG)
Diffuse Correlation Spectroscopy (DCS)
Subdermal EEG Needle
Superconducting QUantum Interface Device
(SQUID)
Microneurography
List of Physiological & Biometric Inputs
Bye, K. (2021, May 30).Twitter. https://twitter.com/kentbye/status/1399143885427728384

Combining NeuroTech with VR
Bye, K., Russomanno, C., & Artuso, J. (2022, July 7). #1112: OpenBCI's project galea hands-on & fusion of biometric & physiological data inVR.Voices ofVR. Retrieved March 10, 2023, from
https://voicesofvr.com/1112-openbcis-project-galea-hands-on-fusion-of-biometric-physiological-data-in-vr/
Bernal, G. (2021,April 15). Developing Galea:An open source tool at the intersection ofVR and neuroscience. MIT Media Lab. https://www.media.mit.edu/posts/galea/.

VR’s Existential Threats to Privacy

Kröger, J.L., Lutz, O.HM., Müller, F. (2020). What Does Your Gaze Reveal About You? On the Privacy Implications of Eye Tracking. In: Friedewald, M., Önen, M., Lievens, E.,
Krenn, S., Fricker, S. (eds) Privacy and Identity Management. Data for Better Living: AI and Privacy. Privacy and Identity 2019. IFIP Advances in Information and Communication
Technology, vol 576. Springer, Cham. https://doi.org/10.1007/978-3-030-42504-3_15
Psychographic Inferences from Eye Gaze Data

Mental Thoughts
Cognitive Processes
Cognitive Load
Social Presence
Active Presence
Behaviors
Intention
Actions
Movement
Emotional Presence
Aﬀective State
Emotional Sentiment
Facial Expression
Microexpressions
Embodied Presence
Stress / Arousal
Physiological Reactions
Eye Gaze /Attention
Body Language
Muscle Fatigue Bye, K. (2021, June 2) "State of Privacy in XR & Neuro-Tech: Conceptual Frames" Presentation at the
VRARA Global Summit (Online). Recording available at https://www.youtube.com/watch?v=pIpD4-gYImU

Freedom of Thought
Self-Determination
Aﬀective Reactions
Physiological Reactions
Mental Privacy

● Farahany, N. A. (2023). The battle for your brain: Defending the right to think freely in the age of Neurotechnology. St. Martin's Press.
● Bye, K., & Farahany, N. (2023, March 9). #1184: "Battle for Your Brain" author Nita Farahany on Establishing Cognitive Liberty as a Human Right for Limits on Neurotechnologies & XR. Voices of
VR. Retrieved March 10, 2023, from https://voicesofvr.com/1184-battle-for-the-brain-author-nita-farahany-on-establishing-cognitive-liberty-as-a-human-right-for-limits-on-neurotechnologies-xr/

Farahany’s Proposed
“Cognitive Liberty”
As A Novel Human Right

(1) The right to mental privacy
(2) The right to identity
(3) The right to agency
(4) The right to fair access to
mental augmentation
(5) The right to protection from
algorithmic bias
Proposed Neuro-Rights
Yuste, R.,Genser, J. & Herrmann, S. "It's Time for Neuro-Rights." Horizons: Journal of International Relations and Sustainable Development, no. 18, 2021. pp 154-164. JSTOR,
https://www.cirsd.org/en/horizons/horizons-winter-2021-issue-no-18/its-time-for-neuro--rights. Accessed 31 Mar. 2021.

Reflections on XR & AI in Education - iLRN Opening Keynote Kent Bye

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Semelhante a Reflections on XR & AI in Education - iLRN Opening Keynote Kent Bye

Semelhante a Reflections on XR & AI in Education - iLRN Opening Keynote Kent Bye (20)

Mais de Kent Bye

Mais de Kent Bye (15)

Último

Último (20)

Reflections on XR & AI in Education - iLRN Opening Keynote Kent Bye