'The Learning Brain: is there a role for neuroimaging?'

1. The Learning Brain: Is there a role for Neuroimaging ?

2. Question posed by Faculty fromCollege of Media Arts and Design Psychology, College of Arts and Sciences College of Nursing and Health Professions Computer Science, College of Engineering Neurology, Psychiatry, College of Medicine School of Biomedical Engineering, Science and Health Systems Cognitive Neuroengineering & Quantitative Experimental Research Collaborative

5. Learning Partners, Mentors, Coaches,

6. Virtual Environments, Networked Communities

8. Portable, Wireless, Wearable

10. CONQUER CollabOrative(Cont’s)Cognitive Neuroengineering & Quantitative Experimental Research Collaborative Laboratory emphasis on collaborative interdisciplinary international research Brain in Learning Learning in virtual reality Problem solving Acquisition and learning of motor skills Human Performance and Training Cognitive workload assessment Transition from novice to expert… Brain Computer Interface (BCI) Neurorehabilitation in Traumatic Brain injury… cognitive development… aging Depth of Anesthesia Pediatric monitoring…

11. PEOPLE Adrian Curtin

12. … enables the study of cortical activation-related to hemodynamic changes in natural environments and diverse field conditions Functional Near-Infrared [fNIR] Spectroscopy

14. Physiological Principles of fNIR Neural Activity & Hemodynamic Response Neurons consume energy (glucose) when activated Oxygen is required to metabolize the glucose As clusters of neurons are activated, there is an increased need for oxygen in that area Oxygen is transported to neural tissue via oxy-hemoglobin in the blood The oxygen exchange occurs in the capillary beds As oxy-hemoglobin gives up oxygen to the neural tissue, it is transformed into deoxygenated hemoglobin Oxy-Hb and deoxy-Hb are correlates of brain activity through oxygen consumption by neurons David J. Heeger & David Ress. (2002)What does fMRI tell us about neuronal activity? Nature Reviews Neuroscience 3, 142-151

15. Near IR Stimuli Presentation Peak Oxygenation Initial Dip Post stimulus undershoot Principles of fNIR III Optical Window in Tissue .G Io I .G Modified Beer-Lambert Law

16. Drexel fNIR Instrumentation fNIR Technology Evolution Wireless system Fiber-Based Full Head Research System Continuous Wave Portable system 2001-08 2008-

17. Assessment of Cognitive Function Target Categorization Target fMRI Results Infrequent Events Transiently Activate Human Prefrontal and Parietal Cortex as Measured by Functional MRI Gregory Mccarthy, Marie Luby, John Gore, And Patricia Goldman-Rakic. J. Neurophysiol. 77: 1630–1634, 1997. Courtesy of Dr. Scott Bunce

18. Assessment of Cognitive Function Target Categorization (Cont’d) fNIR Results fNIR Data Right Left Izzetoglu M, Izzetoglu K, Bunce S, Ayaz, H, Devaraj A, Onaral B, Pourrezaei K “Functional Near Infrared Neuroimaging”, Accepted to IEEE Transaction on Neural Systems and Rehabilitation Engineering – Special Issue on Neural Engineering

19. Assessment of Cognitive Function Working Memory (n-back Task)

20. Assessment of Cognitive Function Working Memory (n-back Task) n-back results performance>90% Results agree with fMRI results from Smith & Jonides, 1997. Izzetoglu M, Bunce S, Onaral B, “Single Trial Hemodynamic Response Estimation in Event Related fNIR Spectroscopy”, Proc. of Optical Society of America Conference, 2003

21. Application Areas fNIR Applications Trainingand LearningApplications Training and Workload Assessment of Soldiers and Unmanned Aerial Vehicle Ground Controllers Assessment of Cognitive Workload of Air Traffic Controllers Problem Solving by Learners Simulation and Multimedia Applications Brain Computer Interface(BCI) Computer Gaming Clinical Applications Depth of Anesthesia Monitoring Traumatic Brain Injury and Neurorehabilitation… Cognitive Aging Pediatric Applications…. Mental Health… BCI in Neurodegenerative Diseases (i.e., ALS)

22. Optimized Learning via Closed-Loop System(Brain in the Loop of Learning)

23. A Real-Time Application to TrainingNovice to Expert Transitioning UAV Ground Controllers

24. Assessment of Cognitive Workload of Air Traffic Controllers © FAA.gov http://www.faa.gov/air_traffic/publications/controller_staffing/video_plan/ Controller Workforce – A Plan for the Future Workload manipulated by number of planes: n= 6,12,18 fNIR measures analyzed to perform comparison study between data & voice communications

25. Human Performance Assessment Solution for natural environments Cognitive Baselining & Performance Indices

26. BIS Monitoring fNIR Monitoring Depth of Anesthesia Monitoring Goal:To translate the existing laboratory fNIR system, into a first generation clinical prototype for a depth of anesthesia monitor to prevent awareness during surgery.

27. Problem Solving & Math Learning Tangrams Arithmetic operations

28. Multimedia Application Brain Activity Monitoring in VR Environment

29. PEOPLE Adrian Curtin