This document discusses privacy and data considerations for designing X reality experiences. It provides examples of clients the author has worked with on VR and AR projects. It then discusses concepts like virtual, augmented, and mixed reality. The document outlines how SLAM and tracking technologies work and what types of personal data they can collect. It proposes taking a privacy by design approach, focusing on strategies like data minimization and demonstrating control over personal data processing. The author suggests interdisciplinary collaborations to research how to incorporate privacy by design principles into the user experience design process.

1. a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries
Designing X Reality Experiences:
Privacy & Data
Anne Marleen Olthof
Lecturer Immersive Design XR
a.m.olthof@hva.nl

2. a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries
Communication and Multimedia Design (CMD) Information and Communication Technology (ICT)

3. a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries

4. a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries
Atelier Virtual Reality Experience (2016 - now)
Clients:
● KLM (HTC Vive, Hololens, Manus VR)
flight safety trainings
● Bartiméus (Oculus, HTC Vive)
playful experiences visual impairment
● Spaarne Gasthuis (HTC Vive)
hospitality, security & infection prevention
training
● Vrije Universiteit (HTC Vive)
data-visualization for the book holder
market
● Fiscal Information and Investigation
Service (FIOD) (HTC Vive)
storytelling & overview tool for
FIOD-cases
● UNICEF (LEAP motion)
playful donation for youngsters
● Mesjokke (HTC Vive)
storytelling & experience journey for
chocolate production
● Loogman Carwash (Hololens)
Entertainment experience AR
● Museum Volkenkunde (Oculus GO)
Cultural experience Baile Funk Brazil
● Grossomoda (Leap Motion)
Tools for sample-communication
● ModeMuze (HTC Vive, Oculus, Android)
gameful experiences for exhibitions
● Ensemble de Solution (HTC Vive, Android,
Kinect)
experimental virtual identity & virtual fashion
● AMFI Hypercraft (HTC Vive)
collaboration with fashion design students
● G-STAR (HTC Vive)
virtual fitting tool
● Alchemist (AR android)
AR-magazine
● Vlisco (HTC Vive, Oculus)
tailor workspace & virtual catwalk
● iNDiViDUAlS (HTC Vive)
IFFTi virtual catwalk experience

5. a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries
#VR

6. a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries
#AR

7. a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries
Virtual Reality
● completely immerse a user in an artificial environment.
Augmented Reality
● an accessible way to display context-relevant information related to real places and
objects in the user’s immediate vicinity.
Mixed Reality
● understands where in a room the object can fit based on depth sensing data. Virtual
objects are then influenced by the user and aspects of the space they share.
(https://xinreality.com/wiki/Mixed_Reality)
X Reality
● a form of “mixed reality environment that comes from the fusion (union) of ...
ubiquitous sensor/actuator networks and shared online virtual worlds….”.
[https://en.wikipedia.org/wiki/X_Reality_(XR)] Joseph A Paradiso and James A Landay. 2009. Guest editors’ introduction: Cross-reality
environments. IEEE Pervasive Computing 8, 3 (2009).

8. a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries
Immersive Design XR
‘Understanding Comics: The Invisible Art.’, S. McCloud (1993)’

9. a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries
https://en.wikipedia.org/wiki/Cortical_homunculus
User Experience - Sensory Perception

10. a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries
Systems Thinking - infrastructure, process, I/O

11. X Reality
a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries
Although Magic Leap has been met with disappointment, it still is a step forward towards
eXtended Reality. Hololens 2 will come to the market, probably next year, so we will see
what happens.

12. a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries
X Reality Privacy: Mapping & Tracking
Simultaneous Location and Mapping (SLAM)
the computational problem of constructing or updating a map of an unknown
environment while simultaneously keeping track of an agent's location within it.
https://gfycat.com/gifs/detail/SecretInsidiousHawaiianmonkseal
https://www.indiegog
o.com/projects/q-bo-
one-your-open-sour
ce-personal-robot-as
sistant#/
Tracking
Outside-in
Inside-out
Degrees of Freedom 3-6-9-10-11
● Movement of a rigid body in
space - pitch roll jaw
● Velocity & Acceleration

13. a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries
What tracking?
● Detailed spatial mapping (3D) of the physical world. (intersect x-ray /
camera direct access)
● Biometric data: like height and gait, fingerprint, eye-tracking, perspiration
& pulse rate (via infrared sensor)
● Facial recognition: find and recognize nearby faces in the numerous
cameras typically present on these devices.
● Voice-recording: Hololens, Alexa, Google Home etc.
X Reality Privacy: Data Mapping & Tracking

14. a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries
https://www.theguardian.com/world/2018/oct/23/toronto-smart-city
-surveillance-ann-cavoukian-resigns-privacy
“I imagined us creating a Smart City of Privacy, as opposed to a Smart City of Surveillance,” she wrote in her resignation letter.
https://www.abc.net.au/news/2018-09-18/china-social-credit-a-model-citizen-in-
a-digital-dictatorship/10200278
X Reality: Multiveillance (sur- & sousveillance)
Ann Cavoukian

15. a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries
X Reality: Multiveillance (sur- & sousveillance)
https://arxiv.org/pdf/1804.08386.pdf

16. a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries
Privacy is about protecting
personal data.
What can designers do?

17. a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries
X Reality: Privacy & Identification
- Personal data
According to the law, personal data means any information
relating to an identified or identifiable individual. An
identifiable person is one who can be identified, directly or
indirectly, in particular by reference to:
- an identification number (e.g. social security number)
- physical, physiological, mental, economic, cultural or social identity factors
(e.g. name and first name, date of birth, biometrics data, fingerprints,
DNA…)
- Privacy-relevant data, related to groups

18. a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries
Change the
paradigm of
Privacy to an
Innovative space
Protect privacy
when developing
new technology.
From concept to
realisation.
https://failfastmoveon.blogspot.com/2016/07/the-relationship-between-self.html
X Reality Privacy: Autonomy & Trust
Level of Trust
LevelofAutonomy

19. a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries
X Reality Privacy: Permission?
https://www.npostart.nl/aanmelden https://arxiv.org/pdf/1804.08386.pdf
https://trilliumsecure.com/trillium-at-connected-car-insurance-usa-2018/ https://www.engadget.com/2018/01/26/auto-industry-is-head-over-heels-for-vr/?guccounter=1

20. a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries
X Reality Privacy: Design & Development
Privacy by Design Strategies &
Tactics (Hoepman, 2018)
Data-oriented:
● Minimize
● Separate
● Abstract
● Hide
Process-oriented:
● Inform
● Control
● Demonstrate
● Enforce
https://www.cs.ru.nl/~jhh/publications/pds-booklet.pdf

21. a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries
X Reality Privacy: Design & Development

22. a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries
Privacy by Design Strategies &
Tactics (Hoepman, 2018)
Data oriented:
● Minimize (limit as much as possible)
● Separate (distribute / isolate)
● Abstract (limit detail as much as possible)
● Hide (prevent data to become public)
Process oriented:
● Inform (about processing of data)
● Control (provide control of processing)
● Demonstrate (show & document)
● Enforce (commit to privacy friendly products)
X Reality Privacy: Design & Development

23. a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries
Designing X Reality Experiences: Privacy & Data
● I propose to work on interdisciplinary playgrounds for
learning about Privacy by Design Engineering, specifically
UX-design, Development & Law.
● I propose for taking the Computational Interaction process
into consideration: what can standardization (Material Design)
& the computing of UX bulk tasks do for Privacy by Design?
● I propose to do a lot of exploratory research in UX Design on
the user’s attention, comprehension & behavior relating this to
control & stay informed about their personal data.

24. a.m.olthof@hva.nl Atelier Virtual Reality Experience Faculty of Digital Media and Creative Industries
Designing X Reality Experiences:
Privacy & Data
Anne Marleen Olthof
Lecturer Immersive Design XR
a.m.olthof@hva.nl