1. BUILDING
AN EMOTION RECOGNITION
FRAMEWORK
Javier Gonzalez-Sanchez, Maria-Elena Chavez-Echeagaray
CUbiC Seminar Series presentation | April 2011

2. FRONT-END | | BACK-END
Software
Affective
Architecture
Computing
proof-of-concept
emotion recognition VS
reusable platform

3. EMOTION RECOGNITION
Affective
Perception Computing Sensing
Devices
emotion recognition

4. Gonzalez-Sanchez, J.; Chavez-Echeagaray, M.E.; Atkinson, R.; and Burleson, W. (2011), "ABE: An Agent-Based Software Architecture for a Multimodal Emotion Recognition Framework," in
Proceedings of Working IEEE/IFIP Conference on Software Architecture (June 2011), in press.

5. BUILDING | FRAMEWORK
It is NOT about
Tools programming
Software
Architecture
Framework Building
proof-of-concept
VS
reusable platform
API

6. FRAMEWORK

7. Sensing Devices
Sensed Values
Data Logger
Beliefs
Data Visualizer
Emotional State
Tutoring Systems
Confidence
Third-party
Agent Agent Systems
Agent
Multimodal President
Third-party
Systems
Agent-Based
Component-oriented
Third-party
Architecture Systems
Emotion Recognition
Framework Agent Federation

8. Gonzalez-Sanchez, J.; Chavez-Echeagaray, M.E.; Atkinson, R.; and Burleson, W. (2011), "ABE: An Agent-Based Software Architecture for a Multimodal Emotion Recognition Framework," in
Proceedings of Working IEEE/IFIP Conference on Software Architecture (June 2011), in press.

9. Gonzalez-Sanchez, J.; Chavez-Echeagaray, M.E.; Atkinson, R.; and Burleson, W. (2011), "ABE: An Agent-Based Software Architecture for a Multimodal Emotion Recognition Framework," in
Proceedings of Working IEEE/IFIP Conference on Software Architecture (June 2011), in press.

10. Gonzalez-Sanchez, J.; Chavez-Echeagaray, M.E.; Atkinson, R.; and Burleson, W. (2011), "ABE: An Agent-Based Software Architecture for a Multimodal Emotion Recognition Framework," in
Proceedings of Working IEEE/IFIP Conference on Software Architecture (June 2011), in press.

11. EXAMPLE 1

12. EXAMPLE 1
Third-party
Systems
VISUALIZER
gaze-x, gaze-y, time
frustration
threshold = 0.75

13. EXAMPLE 1

14. EXAMPLE 2

15. EXAMPLE 2
t1/4 t2/4 t3/4 t4/4

16. Gonzalez-Sanchez, J.; Chavez-Echeagaray, M.E.; Atkinson, R.; and Burleson, W. (2011), "ABE: An Agent-Based Software Architecture for a Multimodal Emotion Recognition Framework," in
Proceedings of Working IEEE/IFIP Conference on Software Architecture (June 2011), in press.

17. ONGOING WORK
• Affective Meta Tutor
Kurt VanLehn, Winslow Burleson, et al.
• Seductive Details (Instructional Design)
Robert Atkinson, et al.
• Emotions and Working Memory Capacity
Robert Atkinson, et al.
• 3D scenarios for training (US Navy)
Robert Atkinson, Brian Nelson, et al.
• BCI
Robert Atkinson, David Gibson, et al.