We’re entering a new world of virtual, mixed, and augmented reality — what some are even calling “the 4th design evolution.” This new medium comes with a fresh set of interaction challenges. Simple things, like organizing or retrieving files, placing screens, and activity switching need to be revisited. Just as the shift from desktop to mobile, and mobile to smart objects required us to rethink interaction patterns, this coming shift presents similar challenges.
We can react to these challenges or approach them in a thoughtful, structured way, considering how we live, build, and work in these immersive computing spaces. To this end, speakers Anderson and McCauley will share the framework they’re developing, a framework that critically examines emerging mixed design patterns in light of the timeless stuff we know about biology, cognition, and how our bodies use physical space. Attendees will see firsthand what’s happening in these new mediums — from games to business applications — while also walking away with a thoughtful way to approach interactions that will prepare you for this next design evolution.
2. Architecting Virtual
(and Physical) Spaces
Preston McCauley
@uidesignguide
Immersive Design & Development
Strategist
Stephen P. Anderson
@stephenanderson
Head of Design, Innovation Garage
at Capital One
t t
ALPHA VERSION!
11. 2D, flat rectangles Immersive 3D spaces
passive observer outside of the experience being immersed within a digital experience.
12. 2D, flat rectangles Immersive 3D spaces
passive observer outside of the experience being immersed within a digital experience.
“New questions arise as the world and the Web intertwingle…
How do we rise to the new challenges of creating paths and
places that bridge physical, digital, and cognitive spaces?”
–PETER MORVILLE
(from the foreward to Pervasive Information Architecture)
13. Cue up the Hype
Machine!
GETTING ON THE SAME PAGE
64. DEVICE HAS A
SMART
AWARENESS OF
ENVIRONMENT
DEVICE HAS A
DUMB
AWARENESS OF
ENVIRONMENT
DEVICE HAS
NO
AWARENESS OF
ENVIRONMENT
AUGMENTED
REALITY
VIRTUAL
REALITY
“Space” is composed
entirely of BITS
MIXED
REALITY
WHAT WE SEEWHATDEVICE(S)SEE
REAL
REALITY
“Space” is composed
entirely of ATOMS
66. Augmented Reality Mixed Reality
Don’t focus on the hardware
(And don’t get too attached to
either of these terms!)
67. Augmented Reality Mixed Reality
Digital information
overlayed onto physical
the world
Device awareness of…
•Location
•Position
Digital information mixed into
Physical world with deep
spatial understanding.
Device awareness of…
•Location
•Position
•Object Recognition
•(Virtual) Object Permanence
•Context, in general (faces, etc.)
•Really, anything! (thanks to ML)
71. DEVICE HAS
ARTIFICIAL
INTELLIGENCE
DEVICE HAS A
SMART
AWARENESS OF
ENVIRONMENT
DEVICE HAS A
DUMB
AWARENESS OF
ENVIRONMENT
DEVICE HAS
NO
AWARENESS OF
ENVIRONMENT
AUGMENTED
REALITY
VIRTUAL
REALITY
“Space” is composed
entirely of BITS
MIXED
REALITY
WHAT WE SEEWHATDEVICE(S)SEE
REAL
REALITY
“Space” is composed
entirely of ATOMS
72. DEVICE HAS
ARTIFICIAL
INTELLIGENCE
DEVICE HAS A
SMART
AWARENESS OF
ENVIRONMENT
DEVICE HAS A
DUMB
AWARENESS OF
ENVIRONMENT
DEVICE HAS
NO
AWARENESS OF
ENVIRONMENT
AUGMENTED
REALITY
IMMERSIVE SPACES
VIRTUAL
REALITY
“Space” is composed
entirely of BITS
MIXED
REALITY
DIGITAL INFORMATION IN THE REAL WORLD
EXTERNAL REPRESENTATIONS ARE
CONSTRAINED BY PHYSICAL WORLD
EXTERNAL REPRESENTATIONS HAVE
NO PHYSICAL CONSTRAINTS
WHAT WE SEEWHATDEVICE(S)SEE
INTERNET OF
THINGS
REAL
REALITY
“Space” is composed
entirely of ATOMS
73. DEVICE HAS
ARTIFICIAL
INTELLIGENCE
DEVICE HAS A
SMART
AWARENESS OF
ENVIRONMENT
DEVICE HAS A
DUMB
AWARENESS OF
ENVIRONMENT
DEVICE HAS
NO
AWARENESS OF
ENVIRONMENT
AUGMENTED
REALITY
IMMERSIVE SPACES
VIRTUAL
REALITY
“Space” is composed
entirely of BITS
MIXED
REALITY
DIGITAL INFORMATION IN THE REAL WORLD
EXTERNAL REPRESENTATIONS ARE
CONSTRAINED BY PHYSICAL WORLD
EXTERNAL REPRESENTATIONS HAVE
NO PHYSICAL CONSTRAINTS
WHAT WE SEEWHATDEVICE(S)SEE
INTERNET OF
THINGS
REAL
REALITY
“Space” is composed
entirely of ATOMS
74. Architecting Virtual
(and Physical!) Spaces
With new mediums of VR/AR/MR, we need to rethink
basic patterns. We can:
• react to these challenges, or
✓approach them in a thoughtful, structured way
GOAL: Share a framework that critically examines
emerging mixed design patterns in light of the
timeless stuff we know about biology, cognition, and
how our bodies use physical space.
81. How we use space to hold and convey meaning
•on/off
•around
•top/bottom
•totheleft/totheright
•over/under
•above/below
•between
•inside/outside
•near/far
•nextto…beside
•through
•up/down
82. How we use space to hold and convey meaning
spatialpositioningand…
•linguistics
•effectsonmemory
•proximity
•dance
•architecture
•leveldesigningames
•etc.
85. Yes, to be continued…!
Thank You!
Preston McCauley
@uidesignguide
Immersive Design & Development
Strategist
uxmodes.com
Stephen P. Anderson
@stephenanderson
Head of Design, Innovation Garage
at Capital One
www.poetpainter.com
t t