Authors : Pauna, Léger, Sénécal, Fredette, Courtemanche, Chen, Labonté-LeMoyne, Ménard Watching a film in a movie theater can be an immersive experience, but to what extent does the experience differ when the moviegoer is using a vibro-kinetic seat, i.e., a seat providing motion and vibration feedback synchronized with the movie scenes? This paper seeks to measure the effect of a multi-sensory cinema experience from a psychophysiological standpoint. Using electroenceph-alography, galvanic skin response, heart rate, and facial micro-expression measures, this study compares the difference between two movie viewing experi-ences, i.e. one without movement and one with artistically enhanced vibro-kinetic feedback. Results of a within-subject experiment suggest that there are significant differences in psychophysiological states of users. Users exhibit more positive emotions, greater arousal, and more cognitive immersion in the vibro-kinetic con-dition. Therefore, multi-sensory stimulation, in the context of cinema, appears to produce an enhanced experience for spectators.

1. The Psychophysiological
Effect of a Vibro-Kinetic
Movie Experience:
The Case of the D-BOX Movie Seat
Horea Pauna, Pierre-Majorique Léger,
Sylvain Sénécal, Marc Fredette,
François Courtemanche, Shang-Lin
Chen, Élise Labonté-Lemoyne and
Jean-François Ménard (D-Box)
June 13th 2017, Gmunden, Austria Gmunden Retreat on NeuroIS 2017

2. Research objective:
Measuring the
psychophysiological
effect of a multi-sensory
cinema experience
© copyright Tech3Lab (2017)

3. Methodology
▪▪ 43 participants (22 males, 21 females)
▪▪ 3x2 within-subject experimental design
▪▪ 3 movies
▪▪ No movement vs Vibro-kinetic
experience
© copyright Tech3Lab (2017)

4. © copyright Léger et Fredette (2017)
Experimental stimuli
▪▪ First 8 minutes and 26 seconds
of The Martian (2015)
▪▪ First 11 minutes and 43 seconds
of Skyfall (2012)
▪▪ 5 minutes and 41 seconds of a Formula 1
racing scene from the movie Rush (2013)

5. © copyright Léger et Fredette (2017)
Vibro-kinetic experience
D-BOX motion-enabled recliner

6. © Copyright Tech3Lab 2017
Instruments
Electroencephalography
(EEG)
Brainvision 32 Electrodes
© copyright Tech3Lab (2017)

7. © Copyright Tech3Lab 2017
Instruments
Electrocardiogram
(EKG)
© copyright Tech3Lab (2017)

8. © Copyright Tech3Lab 2017
Instruments
Electrodermal
activity (EDA)
© copyright Tech3Lab (2017)

9. © Copyright Tech3Lab 2017
1.26: Cars start and rev
engines
1.83: Race begins, lots
of movement
5.45: Violent car crash
RushResults

10. © Copyright Tech3Lab 2017
4.11: Sand storm begins
4.8: Antenna detaches and
hits astronaut
7.75: Spaceship takes off
The MartianResults

11. © Copyright Tech3Lab 2017
3.11: First gunshots
6.3: Intense chasing
10.06: Fighting on top of train
11.43: Fatal gunshot
Sky FallResults

12. © Copyright Tech3Lab 2017
Results
Emotions by Condition Activation by Condition
© copyright Tech3Lab (2017)

13. © Copyright Tech3Lab 2017
Results
* = p-value ≤ 0.1
** = p-value ≤ 0.05
*** = p-value ≤ 0.01
*
Cognitive Activity by Condition
© copyright Tech3Lab (2017)