SlideShare uma empresa Scribd logo
1 de 132
Baixar para ler offline
LECTURE 5:
INTERACTION DESIGN FOR
VIRTUAL REALITY
COMP 4010 – Virtual Reality
Semester 5 – 2017
Bruce Thomas, Mark Billinghurst
University of South Australia
August 23rd 2017
Lecture 4: Recap
• 3D User Interfaces
• User interfaces for VR systems
• Need good 3D UI guidelines
• But 3D interaction is difficult
• Needs spatial input
• Interface Layout more complex
• Lack of constraints, precision
• Lack of standards, tools
• User Fatigue, perception needs
Universal 3D Interaction Tasks in VR
• Object Interaction
• Selection: Picking object(s) from a set
• Manipulation: Modifying object properties
• Navigation
• Travel: motor component of viewpoint motion
• Wayfinding: cognitive component; decision-making
• System control
• Issuing a command to change system state or mode
Object Interaction
• Selection:
• specifying one or more objects from a set
• Manipulation:
• modifying object properties
• position, orientation, scale, shape, color, texture, behavior, etc.
Selection and Manipulation Techniques
Manipulation
Selection
Navigation
• How we move from place to place within an environment
• The combination of travel with wayfinding
• Wayfinding: cognitive component of navigation
• Travel: motor component of navigation
• Travel without wayfinding: "exploring", "wandering”
Taxonomy of Travel Techniques
System Control
• Issuing a command to change system state or mode
• Examples
• Launching application
• Changing system settings
• Opening a file
• Etc.
• Key points
• Make commands visible to user
• Support easy selection
System Control Options
INTERACTION DESIGN
FOR VIRTUAL REALITY
How Can we Design Useful VR?
• Designing VR experiences that meet real needs
What is Interaction Design ?
Designing interactive products to
support people in their everyday
and working lives”
Preece, J., (2002). Interaction Design
• Interaction Design is the design of
user experience with technology
Bill Verplank on Interaction Design
• https://www.youtube.com/watch?v=Gk6XAmALOWI
• Interaction Design involves answering three questions:
• What do you do? - How do you affect the world?
• What do you feel? – What do you sense of the world?
• What do you know? – What do you learn?
Bill Verplank
The Interaction Design Process
Evaluate
(Re)Design
Identify needs/
establish
requirements
Build an
interactive
version
Final Product
Develop alternative prototypes/concepts and compare them
And iterate, iterate, iterate....
NEEDS ANALYSIS
Interaction Design Process
Evaluate
(Re)Design
Identify needs/
establish
requirements
Build an
interactive
version
Final Product
Develop alternative prototypes/concepts and compare them
And iterate, iterate, iterate....
NeedsAnalysis Goals
1. Create a deep understanding of
the user and problem space
2. Understand howVR can help
address the user needs
Key Questions
1. Who is the user?
• Different types of users
2. What are the user needs?
• Understand the user, look for insights
3. Can VR address those needs?
• VR cannot solve all problems
Who are the Users?
• Different types of users, must consider them all
• Primary: people regularly using the VR system
• Secondary: people providing tech support/developing system
• Tertiary: people providing funding/space for VR system
Methods for Identifying User Needs
Learn from
people
Learn from
analogous
settings
Learn from
Experts
Immersive
yourself in
context
1. Learn from People
• Learn from target users by:
• Questionnaires and interviewing
• Running focus groups
• Observing people performing target tasks
2. Learn from Experts
• Experts have in-depth knowledge about topic
• Can give large amount of information in short time
• Look for existing process/problem documentation
• Choose participants with domain expertise
• Expertise, radical opinion, etc.
3. Immersive yourself in Context
• Put yourself in the position of the user
• Role playing, a day in the life of a user, cultural probes
• Observing the problem space around you – how do you feel?
• Take notes and capture your observations
A day in the Life of.. Cultural Probes.. Role Playing..
4. Seek Inspiration in Analogous Setting
• Inspiration in different context than problem space
• E.g. redesign library by going to Apple store
• Think of Analogies that connect with challenge
• Similar scenarios in different places
What can public libraries learn from Apple stores?
Identifying User Needs
• From understanding the user, look for needs
• Human emotional or physical necessities.
• Needs help define your design
• Needs are Verbs not Nouns
• Verbs - (activities and desires)
• Nouns (solutions)
• Identify needs from the user traits you noted, or
from contradictions between information
• disconnect between what user says and what user does..
Example: VR for Arachnophobia
• True story:
• Mark’s father, Alan, didn’t seem afraid of anything
• He went to the HIT Lab to try VR for the first time
• In a virtual kitchen he saw a VR spider and screamed
• Contradiction:
• Afraid of nothing, but screams at virtual spider
Example: VR for Arachnophobia
State the Problem
- [User] needs [verb phrase] in a way that [way]
- How might we [verb phrase] ?
Example
- Alan needs to overcome his fear of spiders in a way that
that is easy and painless
- How might we help him overcome his fear of spiders ?
User Need
Is VR the Best Solution?
• Not every problem can be solved by VR..
• Problems Ideal for Virtual Reality, have:
• visual elements
• 3D spatial interaction
• physical manipulation
• procedural learning
• Problems Not ideal for Virtual Reality, have:
• heavy reading, text editing
• many non visual elements
• need for connection with real world
• need for tactile, haptic, olfaction feedback
Suitable for VR or not?
DESIGN
The Interaction Design Process
Evaluate
(Re)Design
Identify needs/
establish
requirements
Build an
interactive
version
Final Product
Idea Generation
• Once user need is found, solutions can be proposed
• Idea generation through:
• Brainstorming
• Lateral thinking
• Ideal storming
• Formal problem solving
• Etc..
Example:
• Ideas for overcoming fear of spiders
• Watching spider videos
• Exposure to real spiders
• Using toy spiders
• Virtual Reality therapy
• Augmented Reality spider viewing
Elaboration and Reduction
• Elaborate on Ideas and Reduce to Final Design Direction
• Elaborate - generate solutions.These are the opportunities
• Reduce - decide on the ones worth pursuing
• Repeat - elaborate and reduce again on those solutions
VR Interface Design Sketches
• Sketch out Design concept(s)
Role of Sketching
• Use sketching as way to communicate and create new ideas
Sketching is about the
activity not the result
– Bill Buxton
Why is Sketching Useful?
• Early ideation
• Think through ideas
• Force you to visualize how things come together
• Communicate ideas to inspire new designs
• Ideal for active brainstorming
• Beginning of prototyping process
VR Design Considerations
• Use UI Best Practices
• Adapt know UI guidelines to VR
• Use of Interface Metaphors/Affordances
• Decide best metaphor for VR application
• Design for Humans
• Use Human Information Processing model
• Design for Different User Groups
• Different users may have unique needs
• Design for the Whole User
• Social, cultural, emotional, physical cognitive
Use UI Best Practices
• General UI design principles can be applied to VR
• E.g. Shneiderman’s UI guidelines from 1998
• Providing interface feedback
• Mixture of reactive, instrumental and operational feedback
• Maintain spatial and temporal correspondence
• Use constraints
• Specify relations between variables that must be satisfied
• E.g. physical constraints reduce freedom of movement
• Support Two-Handed control
• Use Guiard’s framework of bimanual manipulation
• Dominant vs. non-dominant hands
Use Interface Metaphors
• Design interface object to be similar to familiar
physical object that the user knows how to use
• E.g. Desktop metaphor, spreadsheet, calculator
• Benefits
• Makes learning interface easier and more accessible
• Users understand underlying conceptual model
Typical VR Interface Metaphors
• Direct Manipulation
• Reach out and directly grab objects
• Ray Casting
• Select objects through ray from head/hand
• Vehicle Movement
• Move through VR environment through vehicle movement
Example: Handle Bar Metaphor
• https://www.youtube.com/watch?v=VBCP63jD3OI
How are These Used?
Affordances
”… the perceived and actual properties of
the thing, primarily those fundamental
properties that determine just how the thing
could possibly be used. [...]
Affordances provide strong clues to the
operations of things.”
(Norman, The Psychology of Everyday Things 1988, p.9)
Perceived vs. Actual Affordances
• Perceived affordance should match actual affordance
Physical vs. Virtual Affordances
• Physical Affordance
• Look and feel of real objects
• Shape, texture, colour, weight, etc.
• Industrial Design
• Virtual Affordance
• Look of virtual objects
• Copy real objects
• Interface Design
Affordances in VR
• Design interface objects to show how they are used
• Use visual cues to show possible affordances
• Perceived affordances should match actual affordances
• Good cognitive model - map object behavior to expected
Familiar objects in Job Simulator Object shape shows how to pick up
Examples of Affordances in VR
Virtual buttons can be pushed Virtual doors can be walked through
Virtual objects can be picked upFlying like a bird in Birdly
Human Information Processing
• High level staged model from Wickens and Carswell (1997)
• Relates perception, cognition, and physical ergonomics
Perception Cognition Ergonomics
Design for Perception (see Lecture 2)
• Need to understand perception to design VR
• Visual perception
• Many types of visual cues (stereo, oculomotor, etc.)
• Auditory system
• Binaural cues, vestibular cues
• Somatosensory
• Haptic, tactile, kinesthetic, proprioceptive cues
• Chemical Sensing System
• Taste and smell
Design for Cognition
• Design for Working and Long term memory
• Working memory
• Short term storage, Limited storage (~5-9 items)
• Long term memory
• Memory recall trigger by associative cues
• Situational Awareness
• Model of current state of user’s environment
• Used for wayfinding, object interaction, spatial awareness, etc..
• Provide cognitive cues to help with situational awareness
• Landmarks, procedural cues, map knowledge
• Support both ego-centric and exo-centric views
Deisgn for Physical Ergonomics
• Design for the human motion range
• Consider human comfort and natural posture
• Design for hand input
• Coarse and fine scale motions, gripping and grasping
• Avoid “Gorilla arm syndrome” from holding arm pose
Designing for Different User Groups
• Design for Difference Ages
• Children require different interface design than adults
• Older uses have different needs than younger
• Prior Experience with VR systems
• Familiar with HMDs, VR input devices
• People with Different Physical Characteristics
• Height and arm reach, handedness
• Perceptual, Cognitive and Motor Abilities
• Colour perception varies between people
• Spatial ability, cognitive or motor disabilities
Consider the Whole User Needs
Whole User Needs
• Social
• Don’t make your user look stupid
• Cultural
• Follow local cultural norms
• Physical
• Can the user physically use the interface?
• Cognitive
• Can the user understand how the interface works?
• Emotional
• Make the user feel good and in control
Would you wear this HMD?
UX Guidelines for VR
• The Four Cores of UX Design for VR
• Make interface Interactive and Reactive
• Design for Comfort and Ease
• Use usable Text and Image Scale
• Include position audio and 3D sound
https://www.dtelepathy.com/blog/philosophy/ux-guide-designing-virtual-reality-experiences
UX Challenges
• Problems to be Addressed
• Keep the user safe
• Make it look and feel real
• Make sure users don’t get simulation sickness
• Develop easy-to-use controls and menus
Cardboard Design Lab
• Mobile VR App providing examples of best practice VR
designs and user interaction (iOS, Play app stores)
Demo: Cardboard Design Lab
• https://www.youtube.com/watch?v=2Uf-ru2Ndvc
VR Human Interface Guidelines
• Interface design website - http://vrhig.com/
• Set of VR interface design best practices
Design Guidelines (from 3D UI book)
• Design for comfortable poses
• Design for relatively short sessions and encourage breaks
• Use constraints, use and invent magical techniques
• Consider real world tools and practices as a source of
inspiration for 3D user interface design
• Consider designing 3D techniques using principles from
2D interaction
• Consider using physical props and passive feedback,
particularly in highly specialized tasks
• Ensure temporal and spatial compliance between
feedback dimensions
More VR Design Guidelines
• Use real-world cues when appropriate.
• If there is a horizon line, keep it steady
• Be careful about mixing 2D GUI and 3D
• Avoid rapid movement, it makes people sick
• Avoid rapid or abrupt transitions to the world space
• Keep the density of information and objects on screen low
• Do not require the user to move their head or body too much
From https://www.wired.com/2015/04/how-to-design-for-virtual-reality/
UX of VR Website - www.uxofvr.com
• Many examples of great design ideas
• Videos, books, articles, slides, code, etc..
PROTOTYPING
Interaction Design Process
Evaluate
(Re)Design
Identify needs/
establish
requirements
Build an
interactive
version
Final Product
How can we quickly
prototype Virtual Reality
experiences with little or
no coding?
Why Prototype?
▪ Quick visual design
▪ Capture key interactions
▪ Focus on user experience
▪ Communicate design ideas
▪ “Learn by doing/experiencing”
From Sketches to Prototypes
• Sketches: early ideation stages of design
• Prototypes: capturing /detailing the actual design
Sketch vs. Prototype
Sketch Prototype
Invite Attend
Suggest Describe
Explore Refine
Question Answer
Propose Test
Provoke Resolve
Tentative,	non	committal Specific	Depiction
The primary differences are in the intent
From Sketches to Prototypes
Early design
Late design
Brainstorm different ideas and
representations
Choose a representation
Rough out interface style
Multitude of sketches
Sketch variations and details
Sketch or low fidelity prototypesTask centered walkthrough and redesign
Fine tune interface, screen design
Heuristic evaluation and redesign
Usability testing and redesign
Low to medium fidelity prototypes
Limited field testing
Alpha/Beta tests
High fidelity prototypes
Working systems
Typical Development Steps
▪ Sketching
▪ Storyboards
▪ UI Mockups
▪ Interaction Flows
▪ Video Prototypes
▪ Interactive Prototypes
▪ Final Native Application
Increased
Fidelity &
Interactivity
Typical Prototyping Tools
▪Static/Low fidelity
▪ Sketching
▪ User interface templates
▪ Storyboards/Application flows
▪Interactive/High fidelity
▪ Wireframing tools
▪ Mobile prototyping
▪ Native Coding
Design/Prototyping Tools
Advantages/Disadvantages
Prototype Advantages Disadvantages
Low-fidelity
prototype
- low developmental cost
- evaluate multiple
design concepts
- limited error checking
- navigational and flow
limitations
High-fidelity
prototype
- fully interactive
- look and feel of final
product
- clearly defines
navigational scheme
- more expensive to develop
- time consuming to build
- developers are reluctant to
change something they have
crafted for hours
VR Prototyping Tools
• Low Fidelity
• Sketched Paper Interfaces – pen/paper, non-interactive
• Onride Photoshop tool – digital, non-interactive
• InstaVR - 360 web based tool, simple interactivity
• SketchBox – create VR interface inside VR
• High Fidelity
• Entiti – template based VR with visual programming
• A-Frame – web based VR tool using HTML
• EditorVR – Unity wrapper inside VR
• Unity/Unreal Game Engine – programming needed
Sketching VR Interfaces
• Download 360 panorama template grid
• Draw interface ideas into grid
• Scan into 360 photo viewer for VR HMD
See https://virtualrealitypop.com/vr-sketches-56599f99b357
Example Sketched VR Interface
• https://www.youtube.com/watch?v=BmMh6-jPWOc
ONIRIDE - 360° Art Plugin for Photoshop
• Draw 360 panorama’s directly in Photoshop
• Preview in Photoshop, export to VR
• See http://www.oniride.com/360art
OnRide Demo
• https://www.youtube.com/watch?v=1P1EfGizal0
InstaVR
•http://www.instavr.co/
•Free, fast panorama VR, deploy to multi platforms
Demo - Using InstaVR
• https://www.youtube.com/watch?v=M2C8vDL0YeA
Sketchbox
• VR design tool - create VR interface inside VR
• Support for HTC Vive, Oculus Rift
• Easy to use VR sketching tool
• Available from SteamVR
• See https://www.sketchboxvr.com/
Sketchbox Demo
• https://www.youtube.com/watch?v=gWfgewGzaEI
Entiti
• https://www.wakingapp.com/
• Stand alone application for VR/AR authoring (Windows, Mac)
• Works with Entiti mobile application (Android, iOS)
• Delivers multiple VR experiences – 360 and 3D scenes
• Template based VR, Visual programming for behaviours
Entiti Overview
https://www.youtube.com/watch?v=SRuYQoT45Tg
A-Frame
• See https://aframe.io/
• Web based VR framework
• Make WebVR with HTML and Entity-Component
• Works on Vive, Rift, Daydream, GearVR, desktop
A-Frame Demo
• https://www.youtube.com/watch?v=1MskH9uqOyQ
Unity EditorVR
• Edit Unity VR scenes inside VR
• 3D user interface on top of Unity
• 2 handed interface using HTC Vive
• Support for multi-user input
• Available from https://github.com/Unity-Technologies/EditorVR
Demo: Unity EditorVR
• https://www.youtube.com/watch?v=ILe2atyofqM
More Prototyping Tools
• List of 24 prototyping tools
• Tools for prototyping 3D VR experiences
• Tools for prototyping 360 degree experiences
• Web based Tools for 3D prototyping
• 3D modeling tools in VR
See http://bit.ly/2wx3i6H
EXAMPLE:
CONCEPT TO DEMO
NASA Hololens AR/VR Concept Demo
• Vision: Work on Mars from your office
• Story and sketches based on vision
• Led to working Demo
Chesley Bonestell (1940s)
Hololens Story
HoloLens Concept Sketches
Final NASA HoloLens OnSight Demo
https://www.youtube.com/watch?v=o-GP3Kx6-CE
EVALUATION
Interaction Design Process
Evaluate
(Re)Design
Identify needs/
establish
requirements
Build an
interactive
version
Final Product
What is evaluation?
•Evaluation is concerned with
gathering data about the usability
of a design or product by a
specified group of users for a
particular activity within a specified
environment or work context
When to evaluate?
• Once the product has been developed
• pros : rapid development, small evaluation cost
• cons : rectifying problems
• During design and development
• pros : find and rectify problems early
• cons : higher evaluation cost, longer development
design implementation evaluation
redesign &
reimplementation
design implementation
Four Evaluation Paradigms
•‘quick and dirty’
•usability testing (lab studies)
•field studies
•predictive evaluation
Quick and Dirty
• ‘quick & dirty’ evaluation: informal feedback from
users or consultants to confirm that their ideas are
in-line with users’ needs and are liked.
• Quick & dirty evaluations are done any time.
• Emphasis is on fast input to the design process
rather than carefully documented findings.
Usability Testing
• Recording typical users’ performance on typical
tasks in controlled settings.
• As the users perform tasks they are watched &
recorded on video & their inputs are logged.
• User data is used to calculate performance times,
errors & help determine system usability
• User satisfaction questionnaires & interviews are
used to elicit users’ opinions.
Laboratory-based studies
• Laboratory-based studies
• can be used for evaluating the design, or system
• are carried out in an interruption-free usability lab
• can accurately record some work situations
• some studies are only possible in a lab environment
• some tasks can be adequately performed in a lab
• useful for comparing different designs in a controlled context
Laboratory-based studies
Controlled, instrumented environment
Field/Ethnographic Studies
• Field studies are done in natural settings
• The aim is to understand what users do naturally
and how technology impacts them.
• In product design field studies can be used to:
- identify opportunities for new technology
- determine design requirements
- decide how to introduce new technology
- evaluate technology in use.
Predictive Evaluation
• Experts apply their knowledge of typical
users, often guided by heuristics, to
predict usability problems.
• Can involve theoretically based models.
• A key feature of predictive evaluation is
that users need not be present
• Relatively quick and inexpensive
Characteristics of Approaches
Usability
testing
Field
studies
Predictive
Users do task natural not involved
Location controlled natural anywhere
When prototype early prototype
Data quantitative qualitative problems
Feed back measures &
errors
descriptions problems
Type applied naturalistic expert
Evaluation Approaches and Methods
Method Usability
testing
Field
studies
Predictive
Observing x x
Asking
users
x x
Asking
experts
x x
Testing x
Modeling x
DECIDE:
A framework to guide evaluation
• Determine the goals the evaluation addresses.
• Explore the specific questions to be answered.
• Choose the evaluation paradigm and techniques to
answer the questions.
• Identify the practical issues.
• Decide how to deal with the ethical issues.
• Evaluate, interpret and present the data.
USABILITY TESTING
Pilot Studies
• A small trial run of the main study.
• Can identify majority of issues with interface design
• Pilot studies check:
- that the evaluation plan is viable
- you can conduct the procedure
- that interview scripts, questionnaires,
experiments, etc. work appropriately
• Iron out problems before doing the main study.
Controlled Experiments
• Designer of a controlled experiment should
carefully consider:
• proposed hypothesis
• selected subjects
• measured variables
• experimental methods
• data collection
• data analysis
Subjects
• The choice of subjects is critical to the validity of the
results of an experiment
• subjects group should represent expected user population
expected user population
• Consider subject factors such as:
• age group, education, skills, culture, technology background
• The sample size should be large enough (10+) to be
statistically representative of the user population
Hypothesis and Variables
• Hypothesis: prediction of the experiment outcome
• Experiments manipulate and measure variables
under controlled conditions
• There are two types of variables
• independent: variables that are manipulated to create
different experimental conditions
• e.g. number of items in menus, colour of the icons
• dependent: variables that are measured to find out the
effects of changing the independent variables
• e.g. speed of menu selection, speed of locating icons
Experimental Methods
• It is important to select the right experimental method so
that the results of the experiment can be generalized
• There are mainly two experimental methods
• between-groups: each subject is assigned to one
experimental condition
• within-groups: each subject performs under all
the different conditions
Experimental Methods
Randomly
assigned
Statistical data analysis
Experimentaltask
Condition
2
Condition
3
Condition
1
Subjects
data data data
Between-
groups
Randomly
assigned
Statistical data analysis
Subjects
data data data
Within-
groups
Experimentaltasks
Condition
2
Condition
3
Condition
1
Experimentaltasks
Condition
1
Condition
3
Condition
2
Experimentaltasks
Condition
1
Condition
2
Condition
3
Data Collection and Analysis
• The choice of a method is dependent on the type
of data that needs to be collected
• In order to test a hypothesis the data has to be
analysed using a statistical method
• The choice of a statistical method depends on the
type of collected data
• All the decisions about an experiment should be
made before the experiment is carried out
Data Types
• Subjective (Qualitative)
• Subjective survey
• Likert Scale, condition rankings
• Observations
• Think Aloud
• Interview responses
• Objective (Quantitative)
• Performance measures
• Time, accuracy, errors
• Process measures
• Video/audio analysis
How easy was the task
1 2 3 4 5
Not very easy Very easy
Example: VR Navigation using Head Tilt
• CHI 2017 paper from Tregillus, Al Zayer, and Folmer
• Problem
• Navigation in mobile VR difficult due to limited input options
• Solution
• Use head tilt to provide simulated joystick input
Tregillus, S., Al Zayer, M., & Folmer, E. (2017, May). Handsfree Omnidirectional VR
Navigation using Head Tilt. In Proceedings of the 2017 CHI Conference on Human
Factors in Computing Systems (pp. 4063-4068). ACM.
Implementation
• Calculate head tilt angle
• Difference between vertical head vector and gravity vector
• Once head tilt is greater than threshold, move forward
• However using head tilt alone prevents looking around
• Head tilt navigation triggered when walking detected (from IMU)
• Implemented in Unity and Google Cardboard SDK/Viewer
Demo Video
• https://www.youtube.com/watch?v=e6fyfnVTAYs
User Study
• Goal: To compare head tilt input to joystick input
for navigation in mobile VR
• Conditions
• TILT: Head tilt input only
• WIP-TILT: Head tilt + using walking to trigger tilt input
• Joystick: Joystick input
• Measures
• Quantitative: Performance time, Number of obstacles hit
• Qualitative: Simulator sickness (SSQ), user preferences
Experiment Design
• 25 Subjects (6 female, 19 male)
• Within subjects design
• All subjects do all conditions
• Experience conditions in counterbalanced order
• For each condition
• Training then navigate through 5 virtual corridors
• At end of condition take SSQ survey
• Rate condition on Likert scale for efficiency, accuracy, etc.
• After all conditions
• Interview subjects for more feedback
Results: Performance, Sickness
• Performance time, Obstacles hit, SSQ sickness scores
• Use one way ANOVA test for significance between conditions
• TILT significantly faster and more accurate than WIP-TILT, joystick
• No significant difference between sickness scores
• Using p < 0.05 significance
Results: User Preference
• One way ANOVA comparing Likert scores (1 – 7)
• significant diff. between TILT and WIP-TILT for efficiency, learnability,
errors, likeability and immersion
• significant diff. between TILT and joystick for learnability and immersion
Discussion
• TILT
• Performed fastest because user didn’t need to walk in place
• Liked condition best, except for immersion
• TILT not ideal for VR applications where user needs to look around
• WIP-TILT
• Slower than TILT, more difficult to learn due to walking
• User felt most immersive due to proprioceptive input
• Shows that head tilt could be viable input for mobile VR
Lessons Learned About Expt. Design
• Decide on type of experiment
• Within subject vs. between subject
• Have well designed task with measurable outcomes
• Use both qualitative and quantitative measures
• Performance + user preference
• Have enough subjects for significant results
• Use the appropriate statistics
• Compare conditions + perform post hoc analysis
• Provide subject training on task
• Observe user behavior and interview subjects
CONCLUSION
Conclusion
• Interaction Design methods can be used to develop
effective Virtual Realty interfaces
• Needs Analysis
• Several methods available for determining user needs
• Design
• Use metaphors and affordances, good UI guidelines
• Prototyping
• Many rapid prototyping tools available
• Evaluation
• Use multiple methods for best evaluation
www.empathiccomputing.org
@marknb00
mark.billinghurst@unisa.edu.au

Mais conteúdo relacionado

Mais procurados

2022 COMP4010 Lecture1: Introduction to XR
2022 COMP4010 Lecture1: Introduction to XR2022 COMP4010 Lecture1: Introduction to XR
2022 COMP4010 Lecture1: Introduction to XRMark Billinghurst
 
COMP 4010 - Lecture4 VR Technology - Visual and Haptic Displays
COMP 4010 - Lecture4 VR Technology - Visual and Haptic DisplaysCOMP 4010 - Lecture4 VR Technology - Visual and Haptic Displays
COMP 4010 - Lecture4 VR Technology - Visual and Haptic DisplaysMark Billinghurst
 
COMP 4010 Lecture7 3D User Interfaces for Virtual Reality
COMP 4010 Lecture7 3D User Interfaces for Virtual RealityCOMP 4010 Lecture7 3D User Interfaces for Virtual Reality
COMP 4010 Lecture7 3D User Interfaces for Virtual RealityMark Billinghurst
 
Comp4010 Lecture9 VR Input and Systems
Comp4010 Lecture9 VR Input and SystemsComp4010 Lecture9 VR Input and Systems
Comp4010 Lecture9 VR Input and SystemsMark Billinghurst
 
Comp 4010 2021 Lecture1-Introduction to XR
Comp 4010 2021 Lecture1-Introduction to XRComp 4010 2021 Lecture1-Introduction to XR
Comp 4010 2021 Lecture1-Introduction to XRMark Billinghurst
 
2022 COMP4010 Lecture5: AR Prototyping
2022 COMP4010 Lecture5: AR Prototyping2022 COMP4010 Lecture5: AR Prototyping
2022 COMP4010 Lecture5: AR PrototypingMark Billinghurst
 
Developing VR Experiences with Unity
Developing VR Experiences with UnityDeveloping VR Experiences with Unity
Developing VR Experiences with UnityMark Billinghurst
 
COMP 4010 Lecture12 - Research Directions in AR and VR
COMP 4010 Lecture12 - Research Directions in AR and VRCOMP 4010 Lecture12 - Research Directions in AR and VR
COMP 4010 Lecture12 - Research Directions in AR and VRMark Billinghurst
 
Comp4010 lecture11 VR Applications
Comp4010 lecture11 VR ApplicationsComp4010 lecture11 VR Applications
Comp4010 lecture11 VR ApplicationsMark Billinghurst
 
Developing AR and VR Experiences with Unity
Developing AR and VR Experiences with UnityDeveloping AR and VR Experiences with Unity
Developing AR and VR Experiences with UnityMark Billinghurst
 
Multimodal Multi-sensory Interaction for Mixed Reality
Multimodal Multi-sensory Interaction for Mixed RealityMultimodal Multi-sensory Interaction for Mixed Reality
Multimodal Multi-sensory Interaction for Mixed RealityMark Billinghurst
 
Research Directions in Transitional Interfaces
Research Directions in Transitional InterfacesResearch Directions in Transitional Interfaces
Research Directions in Transitional InterfacesMark Billinghurst
 
Comp4010 Lecture10 VR Interface Design
Comp4010 Lecture10 VR Interface DesignComp4010 Lecture10 VR Interface Design
Comp4010 Lecture10 VR Interface DesignMark Billinghurst
 
Augmented Reality
Augmented Reality Augmented Reality
Augmented Reality slire
 
Comp4010 Lecture13 More Research Directions
Comp4010 Lecture13 More Research DirectionsComp4010 Lecture13 More Research Directions
Comp4010 Lecture13 More Research DirectionsMark Billinghurst
 
Comp4010 lecture6 Prototyping
Comp4010 lecture6 PrototypingComp4010 lecture6 Prototyping
Comp4010 lecture6 PrototypingMark Billinghurst
 
Comp4010 Lecture7 Designing AR Systems
Comp4010 Lecture7 Designing AR SystemsComp4010 Lecture7 Designing AR Systems
Comp4010 Lecture7 Designing AR SystemsMark Billinghurst
 
Using Interaction Design Methods for Creating AR and VR Interfaces
Using Interaction Design Methods for Creating AR and VR InterfacesUsing Interaction Design Methods for Creating AR and VR Interfaces
Using Interaction Design Methods for Creating AR and VR InterfacesMark Billinghurst
 
The future resume 寫未來的履歷表
The future resume 寫未來的履歷表The future resume 寫未來的履歷表
The future resume 寫未來的履歷表kuoyichen
 

Mais procurados (20)

2022 COMP4010 Lecture1: Introduction to XR
2022 COMP4010 Lecture1: Introduction to XR2022 COMP4010 Lecture1: Introduction to XR
2022 COMP4010 Lecture1: Introduction to XR
 
COMP 4010 - Lecture4 VR Technology - Visual and Haptic Displays
COMP 4010 - Lecture4 VR Technology - Visual and Haptic DisplaysCOMP 4010 - Lecture4 VR Technology - Visual and Haptic Displays
COMP 4010 - Lecture4 VR Technology - Visual and Haptic Displays
 
COMP 4010 Lecture7 3D User Interfaces for Virtual Reality
COMP 4010 Lecture7 3D User Interfaces for Virtual RealityCOMP 4010 Lecture7 3D User Interfaces for Virtual Reality
COMP 4010 Lecture7 3D User Interfaces for Virtual Reality
 
Comp4010 Lecture9 VR Input and Systems
Comp4010 Lecture9 VR Input and SystemsComp4010 Lecture9 VR Input and Systems
Comp4010 Lecture9 VR Input and Systems
 
AUGMENTED REALITY
AUGMENTED REALITYAUGMENTED REALITY
AUGMENTED REALITY
 
Comp 4010 2021 Lecture1-Introduction to XR
Comp 4010 2021 Lecture1-Introduction to XRComp 4010 2021 Lecture1-Introduction to XR
Comp 4010 2021 Lecture1-Introduction to XR
 
2022 COMP4010 Lecture5: AR Prototyping
2022 COMP4010 Lecture5: AR Prototyping2022 COMP4010 Lecture5: AR Prototyping
2022 COMP4010 Lecture5: AR Prototyping
 
Developing VR Experiences with Unity
Developing VR Experiences with UnityDeveloping VR Experiences with Unity
Developing VR Experiences with Unity
 
COMP 4010 Lecture12 - Research Directions in AR and VR
COMP 4010 Lecture12 - Research Directions in AR and VRCOMP 4010 Lecture12 - Research Directions in AR and VR
COMP 4010 Lecture12 - Research Directions in AR and VR
 
Comp4010 lecture11 VR Applications
Comp4010 lecture11 VR ApplicationsComp4010 lecture11 VR Applications
Comp4010 lecture11 VR Applications
 
Developing AR and VR Experiences with Unity
Developing AR and VR Experiences with UnityDeveloping AR and VR Experiences with Unity
Developing AR and VR Experiences with Unity
 
Multimodal Multi-sensory Interaction for Mixed Reality
Multimodal Multi-sensory Interaction for Mixed RealityMultimodal Multi-sensory Interaction for Mixed Reality
Multimodal Multi-sensory Interaction for Mixed Reality
 
Research Directions in Transitional Interfaces
Research Directions in Transitional InterfacesResearch Directions in Transitional Interfaces
Research Directions in Transitional Interfaces
 
Comp4010 Lecture10 VR Interface Design
Comp4010 Lecture10 VR Interface DesignComp4010 Lecture10 VR Interface Design
Comp4010 Lecture10 VR Interface Design
 
Augmented Reality
Augmented Reality Augmented Reality
Augmented Reality
 
Comp4010 Lecture13 More Research Directions
Comp4010 Lecture13 More Research DirectionsComp4010 Lecture13 More Research Directions
Comp4010 Lecture13 More Research Directions
 
Comp4010 lecture6 Prototyping
Comp4010 lecture6 PrototypingComp4010 lecture6 Prototyping
Comp4010 lecture6 Prototyping
 
Comp4010 Lecture7 Designing AR Systems
Comp4010 Lecture7 Designing AR SystemsComp4010 Lecture7 Designing AR Systems
Comp4010 Lecture7 Designing AR Systems
 
Using Interaction Design Methods for Creating AR and VR Interfaces
Using Interaction Design Methods for Creating AR and VR InterfacesUsing Interaction Design Methods for Creating AR and VR Interfaces
Using Interaction Design Methods for Creating AR and VR Interfaces
 
The future resume 寫未來的履歷表
The future resume 寫未來的履歷表The future resume 寫未來的履歷表
The future resume 寫未來的履歷表
 

Destaque

COMP 4010: Lecture 6 Example VR Applications
COMP 4010: Lecture 6 Example VR ApplicationsCOMP 4010: Lecture 6 Example VR Applications
COMP 4010: Lecture 6 Example VR ApplicationsMark Billinghurst
 
Create Your Own VR Experience
Create Your Own VR ExperienceCreate Your Own VR Experience
Create Your Own VR ExperienceMark Billinghurst
 
COMP 4010 - Lecture11 - AR Applications
COMP 4010 - Lecture11 - AR ApplicationsCOMP 4010 - Lecture11 - AR Applications
COMP 4010 - Lecture11 - AR ApplicationsMark Billinghurst
 
COMP 4010 Lecture 3 VR Input and Systems
COMP 4010 Lecture 3 VR Input and SystemsCOMP 4010 Lecture 3 VR Input and Systems
COMP 4010 Lecture 3 VR Input and SystemsMark Billinghurst
 
COMP 4010: Lecture8 - AR Technology
COMP 4010: Lecture8 - AR TechnologyCOMP 4010: Lecture8 - AR Technology
COMP 4010: Lecture8 - AR TechnologyMark Billinghurst
 
COMP 4010 Lecture 9 AR Interaction
COMP 4010 Lecture 9 AR InteractionCOMP 4010 Lecture 9 AR Interaction
COMP 4010 Lecture 9 AR InteractionMark Billinghurst
 
Collaborative Immersive Analytics
Collaborative Immersive AnalyticsCollaborative Immersive Analytics
Collaborative Immersive AnalyticsMark Billinghurst
 
Fifty Shades of Augmented Reality: Creating Connection Using AR
Fifty Shades of Augmented Reality: Creating Connection Using ARFifty Shades of Augmented Reality: Creating Connection Using AR
Fifty Shades of Augmented Reality: Creating Connection Using ARMark Billinghurst
 
COMP 4010 - Lecture10: Mobile AR
COMP 4010 - Lecture10: Mobile ARCOMP 4010 - Lecture10: Mobile AR
COMP 4010 - Lecture10: Mobile ARMark Billinghurst
 
COMP 4010 - Lecture 7: Introduction to Augmented Reality
COMP 4010 - Lecture 7: Introduction to Augmented RealityCOMP 4010 - Lecture 7: Introduction to Augmented Reality
COMP 4010 - Lecture 7: Introduction to Augmented RealityMark Billinghurst
 
Beyond Reality (2027): The Future of Virtual and Augmented Reality
Beyond Reality (2027): The Future of Virtual and Augmented RealityBeyond Reality (2027): The Future of Virtual and Augmented Reality
Beyond Reality (2027): The Future of Virtual and Augmented RealityMark Billinghurst
 
Building VR Applications For Google Cardboard
Building VR Applications For Google CardboardBuilding VR Applications For Google Cardboard
Building VR Applications For Google CardboardMark Billinghurst
 
COMP 4010 - Lecture1 Introduction to Virtual Reality
COMP 4010 - Lecture1 Introduction to Virtual RealityCOMP 4010 - Lecture1 Introduction to Virtual Reality
COMP 4010 - Lecture1 Introduction to Virtual RealityMark Billinghurst
 
COMP 4010: Lecture 4 - 3D User Interfaces for VR
COMP 4010: Lecture 4 - 3D User Interfaces for VRCOMP 4010: Lecture 4 - 3D User Interfaces for VR
COMP 4010: Lecture 4 - 3D User Interfaces for VRMark Billinghurst
 

Destaque (15)

COMP 4010: Lecture 6 Example VR Applications
COMP 4010: Lecture 6 Example VR ApplicationsCOMP 4010: Lecture 6 Example VR Applications
COMP 4010: Lecture 6 Example VR Applications
 
Create Your Own VR Experience
Create Your Own VR ExperienceCreate Your Own VR Experience
Create Your Own VR Experience
 
COMP 4010 - Lecture11 - AR Applications
COMP 4010 - Lecture11 - AR ApplicationsCOMP 4010 - Lecture11 - AR Applications
COMP 4010 - Lecture11 - AR Applications
 
COMP 4010 Lecture 3 VR Input and Systems
COMP 4010 Lecture 3 VR Input and SystemsCOMP 4010 Lecture 3 VR Input and Systems
COMP 4010 Lecture 3 VR Input and Systems
 
Easy Virtual Reality
Easy Virtual RealityEasy Virtual Reality
Easy Virtual Reality
 
COMP 4010: Lecture8 - AR Technology
COMP 4010: Lecture8 - AR TechnologyCOMP 4010: Lecture8 - AR Technology
COMP 4010: Lecture8 - AR Technology
 
COMP 4010 Lecture 9 AR Interaction
COMP 4010 Lecture 9 AR InteractionCOMP 4010 Lecture 9 AR Interaction
COMP 4010 Lecture 9 AR Interaction
 
Collaborative Immersive Analytics
Collaborative Immersive AnalyticsCollaborative Immersive Analytics
Collaborative Immersive Analytics
 
Fifty Shades of Augmented Reality: Creating Connection Using AR
Fifty Shades of Augmented Reality: Creating Connection Using ARFifty Shades of Augmented Reality: Creating Connection Using AR
Fifty Shades of Augmented Reality: Creating Connection Using AR
 
COMP 4010 - Lecture10: Mobile AR
COMP 4010 - Lecture10: Mobile ARCOMP 4010 - Lecture10: Mobile AR
COMP 4010 - Lecture10: Mobile AR
 
COMP 4010 - Lecture 7: Introduction to Augmented Reality
COMP 4010 - Lecture 7: Introduction to Augmented RealityCOMP 4010 - Lecture 7: Introduction to Augmented Reality
COMP 4010 - Lecture 7: Introduction to Augmented Reality
 
Beyond Reality (2027): The Future of Virtual and Augmented Reality
Beyond Reality (2027): The Future of Virtual and Augmented RealityBeyond Reality (2027): The Future of Virtual and Augmented Reality
Beyond Reality (2027): The Future of Virtual and Augmented Reality
 
Building VR Applications For Google Cardboard
Building VR Applications For Google CardboardBuilding VR Applications For Google Cardboard
Building VR Applications For Google Cardboard
 
COMP 4010 - Lecture1 Introduction to Virtual Reality
COMP 4010 - Lecture1 Introduction to Virtual RealityCOMP 4010 - Lecture1 Introduction to Virtual Reality
COMP 4010 - Lecture1 Introduction to Virtual Reality
 
COMP 4010: Lecture 4 - 3D User Interfaces for VR
COMP 4010: Lecture 4 - 3D User Interfaces for VRCOMP 4010: Lecture 4 - 3D User Interfaces for VR
COMP 4010: Lecture 4 - 3D User Interfaces for VR
 

Semelhante a COMP 4010: Lecture 5 - Interaction Design for Virtual Reality

COMP 4010 - Lecture 5: Interaction Design for Virtual Reality
COMP 4010 - Lecture 5: Interaction Design for Virtual RealityCOMP 4010 - Lecture 5: Interaction Design for Virtual Reality
COMP 4010 - Lecture 5: Interaction Design for Virtual RealityMark Billinghurst
 
Usability and User Experience Training Seminar
Usability and User Experience Training SeminarUsability and User Experience Training Seminar
Usability and User Experience Training Seminarlabecvar
 
UX Workshop at Startit@KBC
UX Workshop at Startit@KBCUX Workshop at Startit@KBC
UX Workshop at Startit@KBCUXprobe
 
IxD Works Miniworkshop: Introduction
IxD Works Miniworkshop: IntroductionIxD Works Miniworkshop: Introduction
IxD Works Miniworkshop: IntroductionInteractionDesign
 
CIS375 Interaction Designs Chapter2
CIS375 Interaction Designs Chapter2CIS375 Interaction Designs Chapter2
CIS375 Interaction Designs Chapter2Dr. Ahmed Al Zaidy
 
Comp4010 lecture11 VR Applications
Comp4010 lecture11 VR ApplicationsComp4010 lecture11 VR Applications
Comp4010 lecture11 VR ApplicationsMark Billinghurst
 
Mobile AR lecture 9 - Mobile AR Interface Design
Mobile AR lecture 9 - Mobile AR Interface DesignMobile AR lecture 9 - Mobile AR Interface Design
Mobile AR lecture 9 - Mobile AR Interface DesignMark Billinghurst
 
UXPA 2023: UX Fracking: Using Mixed Methods to Extract Hidden Insights
UXPA 2023: UX Fracking: Using Mixed Methods to Extract Hidden InsightsUXPA 2023: UX Fracking: Using Mixed Methods to Extract Hidden Insights
UXPA 2023: UX Fracking: Using Mixed Methods to Extract Hidden InsightsUXPA International
 
Requirements Engineering for the Humanities
Requirements Engineering for the HumanitiesRequirements Engineering for the Humanities
Requirements Engineering for the HumanitiesShawn Day
 
What I learned at Cooper U about Design Research
What I learned at Cooper U about Design ResearchWhat I learned at Cooper U about Design Research
What I learned at Cooper U about Design ResearchSolutionStream
 
Lecture7 Example VR Applications
Lecture7 Example VR ApplicationsLecture7 Example VR Applications
Lecture7 Example VR ApplicationsMark Billinghurst
 
Designing Useful and Usable Augmented Reality Experiences
Designing Useful and Usable Augmented Reality Experiences Designing Useful and Usable Augmented Reality Experiences
Designing Useful and Usable Augmented Reality Experiences Yan Xu
 
Design process interaction design basics
Design process interaction design basicsDesign process interaction design basics
Design process interaction design basicsPreeti Mishra
 
Design principles
Design principlesDesign principles
Design principlessawsan slii
 

Semelhante a COMP 4010: Lecture 5 - Interaction Design for Virtual Reality (20)

COMP 4010 - Lecture 5: Interaction Design for Virtual Reality
COMP 4010 - Lecture 5: Interaction Design for Virtual RealityCOMP 4010 - Lecture 5: Interaction Design for Virtual Reality
COMP 4010 - Lecture 5: Interaction Design for Virtual Reality
 
Designing Usable Interface
Designing Usable InterfaceDesigning Usable Interface
Designing Usable Interface
 
COMP 4026 - Lecture 1
COMP 4026 - Lecture 1COMP 4026 - Lecture 1
COMP 4026 - Lecture 1
 
Usability and User Experience Training Seminar
Usability and User Experience Training SeminarUsability and User Experience Training Seminar
Usability and User Experience Training Seminar
 
UX Workshop at Startit@KBC
UX Workshop at Startit@KBCUX Workshop at Startit@KBC
UX Workshop at Startit@KBC
 
IxD Works Miniworkshop: Introduction
IxD Works Miniworkshop: IntroductionIxD Works Miniworkshop: Introduction
IxD Works Miniworkshop: Introduction
 
CIS375 Interaction Designs Chapter2
CIS375 Interaction Designs Chapter2CIS375 Interaction Designs Chapter2
CIS375 Interaction Designs Chapter2
 
UX workshop
UX workshopUX workshop
UX workshop
 
chapter_03_5e.pdf
chapter_03_5e.pdfchapter_03_5e.pdf
chapter_03_5e.pdf
 
Comp4010 lecture11 VR Applications
Comp4010 lecture11 VR ApplicationsComp4010 lecture11 VR Applications
Comp4010 lecture11 VR Applications
 
Designing the user experience
Designing the user experienceDesigning the user experience
Designing the user experience
 
Mobile AR lecture 9 - Mobile AR Interface Design
Mobile AR lecture 9 - Mobile AR Interface DesignMobile AR lecture 9 - Mobile AR Interface Design
Mobile AR lecture 9 - Mobile AR Interface Design
 
UXPA 2023: UX Fracking: Using Mixed Methods to Extract Hidden Insights
UXPA 2023: UX Fracking: Using Mixed Methods to Extract Hidden InsightsUXPA 2023: UX Fracking: Using Mixed Methods to Extract Hidden Insights
UXPA 2023: UX Fracking: Using Mixed Methods to Extract Hidden Insights
 
Requirements Engineering for the Humanities
Requirements Engineering for the HumanitiesRequirements Engineering for the Humanities
Requirements Engineering for the Humanities
 
What I learned at Cooper U about Design Research
What I learned at Cooper U about Design ResearchWhat I learned at Cooper U about Design Research
What I learned at Cooper U about Design Research
 
Lecture7 Example VR Applications
Lecture7 Example VR ApplicationsLecture7 Example VR Applications
Lecture7 Example VR Applications
 
Designing Useful and Usable Augmented Reality Experiences
Designing Useful and Usable Augmented Reality Experiences Designing Useful and Usable Augmented Reality Experiences
Designing Useful and Usable Augmented Reality Experiences
 
Ux gsg
Ux gsgUx gsg
Ux gsg
 
Design process interaction design basics
Design process interaction design basicsDesign process interaction design basics
Design process interaction design basics
 
Design principles
Design principlesDesign principles
Design principles
 

Mais de Mark Billinghurst

Future Research Directions for Augmented Reality
Future Research Directions for Augmented RealityFuture Research Directions for Augmented Reality
Future Research Directions for Augmented RealityMark Billinghurst
 
Evaluation Methods for Social XR Experiences
Evaluation Methods for Social XR ExperiencesEvaluation Methods for Social XR Experiences
Evaluation Methods for Social XR ExperiencesMark Billinghurst
 
Empathic Computing: Delivering the Potential of the Metaverse
Empathic Computing: Delivering  the Potential of the MetaverseEmpathic Computing: Delivering  the Potential of the Metaverse
Empathic Computing: Delivering the Potential of the MetaverseMark Billinghurst
 
Empathic Computing: Capturing the Potential of the Metaverse
Empathic Computing: Capturing the Potential of the MetaverseEmpathic Computing: Capturing the Potential of the Metaverse
Empathic Computing: Capturing the Potential of the MetaverseMark Billinghurst
 
Talk to Me: Using Virtual Avatars to Improve Remote Collaboration
Talk to Me: Using Virtual Avatars to Improve Remote CollaborationTalk to Me: Using Virtual Avatars to Improve Remote Collaboration
Talk to Me: Using Virtual Avatars to Improve Remote CollaborationMark Billinghurst
 
Empathic Computing: Designing for the Broader Metaverse
Empathic Computing: Designing for the Broader MetaverseEmpathic Computing: Designing for the Broader Metaverse
Empathic Computing: Designing for the Broader MetaverseMark Billinghurst
 
Novel Interfaces for AR Systems
Novel Interfaces for AR SystemsNovel Interfaces for AR Systems
Novel Interfaces for AR SystemsMark Billinghurst
 
2022 COMP4010 Lecture4: AR Interaction
2022 COMP4010 Lecture4: AR Interaction2022 COMP4010 Lecture4: AR Interaction
2022 COMP4010 Lecture4: AR InteractionMark Billinghurst
 
2022 COMP4010 Lecture3: AR Technology
2022 COMP4010 Lecture3: AR Technology2022 COMP4010 Lecture3: AR Technology
2022 COMP4010 Lecture3: AR TechnologyMark Billinghurst
 
2022 COMP4010 Lecture2: Perception
2022 COMP4010 Lecture2: Perception2022 COMP4010 Lecture2: Perception
2022 COMP4010 Lecture2: PerceptionMark Billinghurst
 
Empathic Computing and Collaborative Immersive Analytics
Empathic Computing and Collaborative Immersive AnalyticsEmpathic Computing and Collaborative Immersive Analytics
Empathic Computing and Collaborative Immersive AnalyticsMark Billinghurst
 
Empathic Computing: Developing for the Whole Metaverse
Empathic Computing: Developing for the Whole MetaverseEmpathic Computing: Developing for the Whole Metaverse
Empathic Computing: Developing for the Whole MetaverseMark Billinghurst
 
Comp4010 Lecture12 Research Directions
Comp4010 Lecture12 Research DirectionsComp4010 Lecture12 Research Directions
Comp4010 Lecture12 Research DirectionsMark Billinghurst
 
Advanced Methods for User Evaluation in Enterprise AR
Advanced Methods for User Evaluation in Enterprise ARAdvanced Methods for User Evaluation in Enterprise AR
Advanced Methods for User Evaluation in Enterprise ARMark Billinghurst
 
Comp4010 Lecture8 Introduction to VR
Comp4010 Lecture8 Introduction to VRComp4010 Lecture8 Introduction to VR
Comp4010 Lecture8 Introduction to VRMark Billinghurst
 

Mais de Mark Billinghurst (17)

Future Research Directions for Augmented Reality
Future Research Directions for Augmented RealityFuture Research Directions for Augmented Reality
Future Research Directions for Augmented Reality
 
Evaluation Methods for Social XR Experiences
Evaluation Methods for Social XR ExperiencesEvaluation Methods for Social XR Experiences
Evaluation Methods for Social XR Experiences
 
Empathic Computing: Delivering the Potential of the Metaverse
Empathic Computing: Delivering  the Potential of the MetaverseEmpathic Computing: Delivering  the Potential of the Metaverse
Empathic Computing: Delivering the Potential of the Metaverse
 
Empathic Computing: Capturing the Potential of the Metaverse
Empathic Computing: Capturing the Potential of the MetaverseEmpathic Computing: Capturing the Potential of the Metaverse
Empathic Computing: Capturing the Potential of the Metaverse
 
Talk to Me: Using Virtual Avatars to Improve Remote Collaboration
Talk to Me: Using Virtual Avatars to Improve Remote CollaborationTalk to Me: Using Virtual Avatars to Improve Remote Collaboration
Talk to Me: Using Virtual Avatars to Improve Remote Collaboration
 
Empathic Computing: Designing for the Broader Metaverse
Empathic Computing: Designing for the Broader MetaverseEmpathic Computing: Designing for the Broader Metaverse
Empathic Computing: Designing for the Broader Metaverse
 
ISS2022 Keynote
ISS2022 KeynoteISS2022 Keynote
ISS2022 Keynote
 
Novel Interfaces for AR Systems
Novel Interfaces for AR SystemsNovel Interfaces for AR Systems
Novel Interfaces for AR Systems
 
2022 COMP4010 Lecture4: AR Interaction
2022 COMP4010 Lecture4: AR Interaction2022 COMP4010 Lecture4: AR Interaction
2022 COMP4010 Lecture4: AR Interaction
 
2022 COMP4010 Lecture3: AR Technology
2022 COMP4010 Lecture3: AR Technology2022 COMP4010 Lecture3: AR Technology
2022 COMP4010 Lecture3: AR Technology
 
2022 COMP4010 Lecture2: Perception
2022 COMP4010 Lecture2: Perception2022 COMP4010 Lecture2: Perception
2022 COMP4010 Lecture2: Perception
 
Empathic Computing and Collaborative Immersive Analytics
Empathic Computing and Collaborative Immersive AnalyticsEmpathic Computing and Collaborative Immersive Analytics
Empathic Computing and Collaborative Immersive Analytics
 
Metaverse Learning
Metaverse LearningMetaverse Learning
Metaverse Learning
 
Empathic Computing: Developing for the Whole Metaverse
Empathic Computing: Developing for the Whole MetaverseEmpathic Computing: Developing for the Whole Metaverse
Empathic Computing: Developing for the Whole Metaverse
 
Comp4010 Lecture12 Research Directions
Comp4010 Lecture12 Research DirectionsComp4010 Lecture12 Research Directions
Comp4010 Lecture12 Research Directions
 
Advanced Methods for User Evaluation in Enterprise AR
Advanced Methods for User Evaluation in Enterprise ARAdvanced Methods for User Evaluation in Enterprise AR
Advanced Methods for User Evaluation in Enterprise AR
 
Comp4010 Lecture8 Introduction to VR
Comp4010 Lecture8 Introduction to VRComp4010 Lecture8 Introduction to VR
Comp4010 Lecture8 Introduction to VR
 

Último

Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)Mark Simos
 
Français Patch Tuesday - Avril
Français Patch Tuesday - AvrilFrançais Patch Tuesday - Avril
Français Patch Tuesday - AvrilIvanti
 
WomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyoneWomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyoneUiPathCommunity
 
All These Sophisticated Attacks, Can We Really Detect Them - PDF
All These Sophisticated Attacks, Can We Really Detect Them - PDFAll These Sophisticated Attacks, Can We Really Detect Them - PDF
All These Sophisticated Attacks, Can We Really Detect Them - PDFMichael Gough
 
A Glance At The Java Performance Toolbox
A Glance At The Java Performance ToolboxA Glance At The Java Performance Toolbox
A Glance At The Java Performance ToolboxAna-Maria Mihalceanu
 
Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Kaya Weers
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Mark Goldstein
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfIngrid Airi González
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPathCommunity
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integrationmarketing932765
 
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesManik S Magar
 
Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024TopCSSGallery
 
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...Karmanjay Verma
 
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...Jeffrey Haguewood
 
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...itnewsafrica
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Nikki Chapple
 
Landscape Catalogue 2024 Australia-1.pdf
Landscape Catalogue 2024 Australia-1.pdfLandscape Catalogue 2024 Australia-1.pdf
Landscape Catalogue 2024 Australia-1.pdfAarwolf Industries LLC
 
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...BookNet Canada
 
Microservices, Docker deploy and Microservices source code in C#
Microservices, Docker deploy and Microservices source code in C#Microservices, Docker deploy and Microservices source code in C#
Microservices, Docker deploy and Microservices source code in C#Karmanjay Verma
 

Último (20)

Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
 
Français Patch Tuesday - Avril
Français Patch Tuesday - AvrilFrançais Patch Tuesday - Avril
Français Patch Tuesday - Avril
 
WomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyoneWomenInAutomation2024: AI and Automation for eveyone
WomenInAutomation2024: AI and Automation for eveyone
 
All These Sophisticated Attacks, Can We Really Detect Them - PDF
All These Sophisticated Attacks, Can We Really Detect Them - PDFAll These Sophisticated Attacks, Can We Really Detect Them - PDF
All These Sophisticated Attacks, Can We Really Detect Them - PDF
 
A Glance At The Java Performance Toolbox
A Glance At The Java Performance ToolboxA Glance At The Java Performance Toolbox
A Glance At The Java Performance Toolbox
 
Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdf
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to Hero
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
 
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
 
Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024
 
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
 
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...
Email Marketing Automation for Bonterra Impact Management (fka Social Solutio...
 
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
 
Landscape Catalogue 2024 Australia-1.pdf
Landscape Catalogue 2024 Australia-1.pdfLandscape Catalogue 2024 Australia-1.pdf
Landscape Catalogue 2024 Australia-1.pdf
 
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
 
Microservices, Docker deploy and Microservices source code in C#
Microservices, Docker deploy and Microservices source code in C#Microservices, Docker deploy and Microservices source code in C#
Microservices, Docker deploy and Microservices source code in C#
 

COMP 4010: Lecture 5 - Interaction Design for Virtual Reality

  • 1. LECTURE 5: INTERACTION DESIGN FOR VIRTUAL REALITY COMP 4010 – Virtual Reality Semester 5 – 2017 Bruce Thomas, Mark Billinghurst University of South Australia August 23rd 2017
  • 2. Lecture 4: Recap • 3D User Interfaces • User interfaces for VR systems • Need good 3D UI guidelines • But 3D interaction is difficult • Needs spatial input • Interface Layout more complex • Lack of constraints, precision • Lack of standards, tools • User Fatigue, perception needs
  • 3. Universal 3D Interaction Tasks in VR • Object Interaction • Selection: Picking object(s) from a set • Manipulation: Modifying object properties • Navigation • Travel: motor component of viewpoint motion • Wayfinding: cognitive component; decision-making • System control • Issuing a command to change system state or mode
  • 4. Object Interaction • Selection: • specifying one or more objects from a set • Manipulation: • modifying object properties • position, orientation, scale, shape, color, texture, behavior, etc.
  • 5. Selection and Manipulation Techniques Manipulation Selection
  • 6. Navigation • How we move from place to place within an environment • The combination of travel with wayfinding • Wayfinding: cognitive component of navigation • Travel: motor component of navigation • Travel without wayfinding: "exploring", "wandering”
  • 7. Taxonomy of Travel Techniques
  • 8. System Control • Issuing a command to change system state or mode • Examples • Launching application • Changing system settings • Opening a file • Etc. • Key points • Make commands visible to user • Support easy selection
  • 11. How Can we Design Useful VR? • Designing VR experiences that meet real needs
  • 12. What is Interaction Design ? Designing interactive products to support people in their everyday and working lives” Preece, J., (2002). Interaction Design • Interaction Design is the design of user experience with technology
  • 13. Bill Verplank on Interaction Design • https://www.youtube.com/watch?v=Gk6XAmALOWI
  • 14. • Interaction Design involves answering three questions: • What do you do? - How do you affect the world? • What do you feel? – What do you sense of the world? • What do you know? – What do you learn? Bill Verplank
  • 15. The Interaction Design Process Evaluate (Re)Design Identify needs/ establish requirements Build an interactive version Final Product Develop alternative prototypes/concepts and compare them And iterate, iterate, iterate....
  • 17. Interaction Design Process Evaluate (Re)Design Identify needs/ establish requirements Build an interactive version Final Product Develop alternative prototypes/concepts and compare them And iterate, iterate, iterate....
  • 18. NeedsAnalysis Goals 1. Create a deep understanding of the user and problem space 2. Understand howVR can help address the user needs
  • 19. Key Questions 1. Who is the user? • Different types of users 2. What are the user needs? • Understand the user, look for insights 3. Can VR address those needs? • VR cannot solve all problems
  • 20. Who are the Users? • Different types of users, must consider them all • Primary: people regularly using the VR system • Secondary: people providing tech support/developing system • Tertiary: people providing funding/space for VR system
  • 21. Methods for Identifying User Needs Learn from people Learn from analogous settings Learn from Experts Immersive yourself in context
  • 22. 1. Learn from People • Learn from target users by: • Questionnaires and interviewing • Running focus groups • Observing people performing target tasks
  • 23. 2. Learn from Experts • Experts have in-depth knowledge about topic • Can give large amount of information in short time • Look for existing process/problem documentation • Choose participants with domain expertise • Expertise, radical opinion, etc.
  • 24. 3. Immersive yourself in Context • Put yourself in the position of the user • Role playing, a day in the life of a user, cultural probes • Observing the problem space around you – how do you feel? • Take notes and capture your observations A day in the Life of.. Cultural Probes.. Role Playing..
  • 25. 4. Seek Inspiration in Analogous Setting • Inspiration in different context than problem space • E.g. redesign library by going to Apple store • Think of Analogies that connect with challenge • Similar scenarios in different places What can public libraries learn from Apple stores?
  • 26. Identifying User Needs • From understanding the user, look for needs • Human emotional or physical necessities. • Needs help define your design • Needs are Verbs not Nouns • Verbs - (activities and desires) • Nouns (solutions) • Identify needs from the user traits you noted, or from contradictions between information • disconnect between what user says and what user does..
  • 27. Example: VR for Arachnophobia • True story: • Mark’s father, Alan, didn’t seem afraid of anything • He went to the HIT Lab to try VR for the first time • In a virtual kitchen he saw a VR spider and screamed • Contradiction: • Afraid of nothing, but screams at virtual spider
  • 28. Example: VR for Arachnophobia State the Problem - [User] needs [verb phrase] in a way that [way] - How might we [verb phrase] ? Example - Alan needs to overcome his fear of spiders in a way that that is easy and painless - How might we help him overcome his fear of spiders ? User Need
  • 29. Is VR the Best Solution? • Not every problem can be solved by VR.. • Problems Ideal for Virtual Reality, have: • visual elements • 3D spatial interaction • physical manipulation • procedural learning • Problems Not ideal for Virtual Reality, have: • heavy reading, text editing • many non visual elements • need for connection with real world • need for tactile, haptic, olfaction feedback
  • 30. Suitable for VR or not?
  • 32. The Interaction Design Process Evaluate (Re)Design Identify needs/ establish requirements Build an interactive version Final Product
  • 33. Idea Generation • Once user need is found, solutions can be proposed • Idea generation through: • Brainstorming • Lateral thinking • Ideal storming • Formal problem solving • Etc..
  • 34. Example: • Ideas for overcoming fear of spiders • Watching spider videos • Exposure to real spiders • Using toy spiders • Virtual Reality therapy • Augmented Reality spider viewing
  • 35. Elaboration and Reduction • Elaborate on Ideas and Reduce to Final Design Direction • Elaborate - generate solutions.These are the opportunities • Reduce - decide on the ones worth pursuing • Repeat - elaborate and reduce again on those solutions
  • 36. VR Interface Design Sketches • Sketch out Design concept(s)
  • 37. Role of Sketching • Use sketching as way to communicate and create new ideas Sketching is about the activity not the result – Bill Buxton
  • 38. Why is Sketching Useful? • Early ideation • Think through ideas • Force you to visualize how things come together • Communicate ideas to inspire new designs • Ideal for active brainstorming • Beginning of prototyping process
  • 39. VR Design Considerations • Use UI Best Practices • Adapt know UI guidelines to VR • Use of Interface Metaphors/Affordances • Decide best metaphor for VR application • Design for Humans • Use Human Information Processing model • Design for Different User Groups • Different users may have unique needs • Design for the Whole User • Social, cultural, emotional, physical cognitive
  • 40. Use UI Best Practices • General UI design principles can be applied to VR • E.g. Shneiderman’s UI guidelines from 1998 • Providing interface feedback • Mixture of reactive, instrumental and operational feedback • Maintain spatial and temporal correspondence • Use constraints • Specify relations between variables that must be satisfied • E.g. physical constraints reduce freedom of movement • Support Two-Handed control • Use Guiard’s framework of bimanual manipulation • Dominant vs. non-dominant hands
  • 41. Use Interface Metaphors • Design interface object to be similar to familiar physical object that the user knows how to use • E.g. Desktop metaphor, spreadsheet, calculator • Benefits • Makes learning interface easier and more accessible • Users understand underlying conceptual model
  • 42. Typical VR Interface Metaphors • Direct Manipulation • Reach out and directly grab objects • Ray Casting • Select objects through ray from head/hand • Vehicle Movement • Move through VR environment through vehicle movement
  • 43. Example: Handle Bar Metaphor • https://www.youtube.com/watch?v=VBCP63jD3OI
  • 44. How are These Used?
  • 45. Affordances ”… the perceived and actual properties of the thing, primarily those fundamental properties that determine just how the thing could possibly be used. [...] Affordances provide strong clues to the operations of things.” (Norman, The Psychology of Everyday Things 1988, p.9)
  • 46. Perceived vs. Actual Affordances • Perceived affordance should match actual affordance
  • 47. Physical vs. Virtual Affordances • Physical Affordance • Look and feel of real objects • Shape, texture, colour, weight, etc. • Industrial Design • Virtual Affordance • Look of virtual objects • Copy real objects • Interface Design
  • 48. Affordances in VR • Design interface objects to show how they are used • Use visual cues to show possible affordances • Perceived affordances should match actual affordances • Good cognitive model - map object behavior to expected Familiar objects in Job Simulator Object shape shows how to pick up
  • 49. Examples of Affordances in VR Virtual buttons can be pushed Virtual doors can be walked through Virtual objects can be picked upFlying like a bird in Birdly
  • 50. Human Information Processing • High level staged model from Wickens and Carswell (1997) • Relates perception, cognition, and physical ergonomics Perception Cognition Ergonomics
  • 51. Design for Perception (see Lecture 2) • Need to understand perception to design VR • Visual perception • Many types of visual cues (stereo, oculomotor, etc.) • Auditory system • Binaural cues, vestibular cues • Somatosensory • Haptic, tactile, kinesthetic, proprioceptive cues • Chemical Sensing System • Taste and smell
  • 52. Design for Cognition • Design for Working and Long term memory • Working memory • Short term storage, Limited storage (~5-9 items) • Long term memory • Memory recall trigger by associative cues • Situational Awareness • Model of current state of user’s environment • Used for wayfinding, object interaction, spatial awareness, etc.. • Provide cognitive cues to help with situational awareness • Landmarks, procedural cues, map knowledge • Support both ego-centric and exo-centric views
  • 53. Deisgn for Physical Ergonomics • Design for the human motion range • Consider human comfort and natural posture • Design for hand input • Coarse and fine scale motions, gripping and grasping • Avoid “Gorilla arm syndrome” from holding arm pose
  • 54. Designing for Different User Groups • Design for Difference Ages • Children require different interface design than adults • Older uses have different needs than younger • Prior Experience with VR systems • Familiar with HMDs, VR input devices • People with Different Physical Characteristics • Height and arm reach, handedness • Perceptual, Cognitive and Motor Abilities • Colour perception varies between people • Spatial ability, cognitive or motor disabilities
  • 55. Consider the Whole User Needs
  • 56. Whole User Needs • Social • Don’t make your user look stupid • Cultural • Follow local cultural norms • Physical • Can the user physically use the interface? • Cognitive • Can the user understand how the interface works? • Emotional • Make the user feel good and in control Would you wear this HMD?
  • 57. UX Guidelines for VR • The Four Cores of UX Design for VR • Make interface Interactive and Reactive • Design for Comfort and Ease • Use usable Text and Image Scale • Include position audio and 3D sound https://www.dtelepathy.com/blog/philosophy/ux-guide-designing-virtual-reality-experiences
  • 58. UX Challenges • Problems to be Addressed • Keep the user safe • Make it look and feel real • Make sure users don’t get simulation sickness • Develop easy-to-use controls and menus
  • 59. Cardboard Design Lab • Mobile VR App providing examples of best practice VR designs and user interaction (iOS, Play app stores)
  • 60. Demo: Cardboard Design Lab • https://www.youtube.com/watch?v=2Uf-ru2Ndvc
  • 61. VR Human Interface Guidelines • Interface design website - http://vrhig.com/ • Set of VR interface design best practices
  • 62. Design Guidelines (from 3D UI book) • Design for comfortable poses • Design for relatively short sessions and encourage breaks • Use constraints, use and invent magical techniques • Consider real world tools and practices as a source of inspiration for 3D user interface design • Consider designing 3D techniques using principles from 2D interaction • Consider using physical props and passive feedback, particularly in highly specialized tasks • Ensure temporal and spatial compliance between feedback dimensions
  • 63. More VR Design Guidelines • Use real-world cues when appropriate. • If there is a horizon line, keep it steady • Be careful about mixing 2D GUI and 3D • Avoid rapid movement, it makes people sick • Avoid rapid or abrupt transitions to the world space • Keep the density of information and objects on screen low • Do not require the user to move their head or body too much From https://www.wired.com/2015/04/how-to-design-for-virtual-reality/
  • 64. UX of VR Website - www.uxofvr.com • Many examples of great design ideas • Videos, books, articles, slides, code, etc..
  • 66. Interaction Design Process Evaluate (Re)Design Identify needs/ establish requirements Build an interactive version Final Product
  • 67. How can we quickly prototype Virtual Reality experiences with little or no coding?
  • 68. Why Prototype? ▪ Quick visual design ▪ Capture key interactions ▪ Focus on user experience ▪ Communicate design ideas ▪ “Learn by doing/experiencing”
  • 69. From Sketches to Prototypes • Sketches: early ideation stages of design • Prototypes: capturing /detailing the actual design
  • 70. Sketch vs. Prototype Sketch Prototype Invite Attend Suggest Describe Explore Refine Question Answer Propose Test Provoke Resolve Tentative, non committal Specific Depiction The primary differences are in the intent
  • 71. From Sketches to Prototypes Early design Late design Brainstorm different ideas and representations Choose a representation Rough out interface style Multitude of sketches Sketch variations and details Sketch or low fidelity prototypesTask centered walkthrough and redesign Fine tune interface, screen design Heuristic evaluation and redesign Usability testing and redesign Low to medium fidelity prototypes Limited field testing Alpha/Beta tests High fidelity prototypes Working systems
  • 72. Typical Development Steps ▪ Sketching ▪ Storyboards ▪ UI Mockups ▪ Interaction Flows ▪ Video Prototypes ▪ Interactive Prototypes ▪ Final Native Application Increased Fidelity & Interactivity
  • 73. Typical Prototyping Tools ▪Static/Low fidelity ▪ Sketching ▪ User interface templates ▪ Storyboards/Application flows ▪Interactive/High fidelity ▪ Wireframing tools ▪ Mobile prototyping ▪ Native Coding
  • 75. Advantages/Disadvantages Prototype Advantages Disadvantages Low-fidelity prototype - low developmental cost - evaluate multiple design concepts - limited error checking - navigational and flow limitations High-fidelity prototype - fully interactive - look and feel of final product - clearly defines navigational scheme - more expensive to develop - time consuming to build - developers are reluctant to change something they have crafted for hours
  • 76. VR Prototyping Tools • Low Fidelity • Sketched Paper Interfaces – pen/paper, non-interactive • Onride Photoshop tool – digital, non-interactive • InstaVR - 360 web based tool, simple interactivity • SketchBox – create VR interface inside VR • High Fidelity • Entiti – template based VR with visual programming • A-Frame – web based VR tool using HTML • EditorVR – Unity wrapper inside VR • Unity/Unreal Game Engine – programming needed
  • 77. Sketching VR Interfaces • Download 360 panorama template grid • Draw interface ideas into grid • Scan into 360 photo viewer for VR HMD See https://virtualrealitypop.com/vr-sketches-56599f99b357
  • 78. Example Sketched VR Interface • https://www.youtube.com/watch?v=BmMh6-jPWOc
  • 79. ONIRIDE - 360° Art Plugin for Photoshop • Draw 360 panorama’s directly in Photoshop • Preview in Photoshop, export to VR • See http://www.oniride.com/360art
  • 82. Demo - Using InstaVR • https://www.youtube.com/watch?v=M2C8vDL0YeA
  • 83. Sketchbox • VR design tool - create VR interface inside VR • Support for HTC Vive, Oculus Rift • Easy to use VR sketching tool • Available from SteamVR • See https://www.sketchboxvr.com/
  • 85. Entiti • https://www.wakingapp.com/ • Stand alone application for VR/AR authoring (Windows, Mac) • Works with Entiti mobile application (Android, iOS) • Delivers multiple VR experiences – 360 and 3D scenes • Template based VR, Visual programming for behaviours
  • 87. A-Frame • See https://aframe.io/ • Web based VR framework • Make WebVR with HTML and Entity-Component • Works on Vive, Rift, Daydream, GearVR, desktop
  • 89. Unity EditorVR • Edit Unity VR scenes inside VR • 3D user interface on top of Unity • 2 handed interface using HTC Vive • Support for multi-user input • Available from https://github.com/Unity-Technologies/EditorVR
  • 90. Demo: Unity EditorVR • https://www.youtube.com/watch?v=ILe2atyofqM
  • 91. More Prototyping Tools • List of 24 prototyping tools • Tools for prototyping 3D VR experiences • Tools for prototyping 360 degree experiences • Web based Tools for 3D prototyping • 3D modeling tools in VR See http://bit.ly/2wx3i6H
  • 93. NASA Hololens AR/VR Concept Demo • Vision: Work on Mars from your office • Story and sketches based on vision • Led to working Demo
  • 97. Final NASA HoloLens OnSight Demo https://www.youtube.com/watch?v=o-GP3Kx6-CE
  • 99. Interaction Design Process Evaluate (Re)Design Identify needs/ establish requirements Build an interactive version Final Product
  • 100. What is evaluation? •Evaluation is concerned with gathering data about the usability of a design or product by a specified group of users for a particular activity within a specified environment or work context
  • 101. When to evaluate? • Once the product has been developed • pros : rapid development, small evaluation cost • cons : rectifying problems • During design and development • pros : find and rectify problems early • cons : higher evaluation cost, longer development design implementation evaluation redesign & reimplementation design implementation
  • 102. Four Evaluation Paradigms •‘quick and dirty’ •usability testing (lab studies) •field studies •predictive evaluation
  • 103. Quick and Dirty • ‘quick & dirty’ evaluation: informal feedback from users or consultants to confirm that their ideas are in-line with users’ needs and are liked. • Quick & dirty evaluations are done any time. • Emphasis is on fast input to the design process rather than carefully documented findings.
  • 104. Usability Testing • Recording typical users’ performance on typical tasks in controlled settings. • As the users perform tasks they are watched & recorded on video & their inputs are logged. • User data is used to calculate performance times, errors & help determine system usability • User satisfaction questionnaires & interviews are used to elicit users’ opinions.
  • 105. Laboratory-based studies • Laboratory-based studies • can be used for evaluating the design, or system • are carried out in an interruption-free usability lab • can accurately record some work situations • some studies are only possible in a lab environment • some tasks can be adequately performed in a lab • useful for comparing different designs in a controlled context
  • 107. Field/Ethnographic Studies • Field studies are done in natural settings • The aim is to understand what users do naturally and how technology impacts them. • In product design field studies can be used to: - identify opportunities for new technology - determine design requirements - decide how to introduce new technology - evaluate technology in use.
  • 108. Predictive Evaluation • Experts apply their knowledge of typical users, often guided by heuristics, to predict usability problems. • Can involve theoretically based models. • A key feature of predictive evaluation is that users need not be present • Relatively quick and inexpensive
  • 109. Characteristics of Approaches Usability testing Field studies Predictive Users do task natural not involved Location controlled natural anywhere When prototype early prototype Data quantitative qualitative problems Feed back measures & errors descriptions problems Type applied naturalistic expert
  • 110. Evaluation Approaches and Methods Method Usability testing Field studies Predictive Observing x x Asking users x x Asking experts x x Testing x Modeling x
  • 111. DECIDE: A framework to guide evaluation • Determine the goals the evaluation addresses. • Explore the specific questions to be answered. • Choose the evaluation paradigm and techniques to answer the questions. • Identify the practical issues. • Decide how to deal with the ethical issues. • Evaluate, interpret and present the data.
  • 113. Pilot Studies • A small trial run of the main study. • Can identify majority of issues with interface design • Pilot studies check: - that the evaluation plan is viable - you can conduct the procedure - that interview scripts, questionnaires, experiments, etc. work appropriately • Iron out problems before doing the main study.
  • 114. Controlled Experiments • Designer of a controlled experiment should carefully consider: • proposed hypothesis • selected subjects • measured variables • experimental methods • data collection • data analysis
  • 115. Subjects • The choice of subjects is critical to the validity of the results of an experiment • subjects group should represent expected user population expected user population • Consider subject factors such as: • age group, education, skills, culture, technology background • The sample size should be large enough (10+) to be statistically representative of the user population
  • 116. Hypothesis and Variables • Hypothesis: prediction of the experiment outcome • Experiments manipulate and measure variables under controlled conditions • There are two types of variables • independent: variables that are manipulated to create different experimental conditions • e.g. number of items in menus, colour of the icons • dependent: variables that are measured to find out the effects of changing the independent variables • e.g. speed of menu selection, speed of locating icons
  • 117. Experimental Methods • It is important to select the right experimental method so that the results of the experiment can be generalized • There are mainly two experimental methods • between-groups: each subject is assigned to one experimental condition • within-groups: each subject performs under all the different conditions
  • 118. Experimental Methods Randomly assigned Statistical data analysis Experimentaltask Condition 2 Condition 3 Condition 1 Subjects data data data Between- groups Randomly assigned Statistical data analysis Subjects data data data Within- groups Experimentaltasks Condition 2 Condition 3 Condition 1 Experimentaltasks Condition 1 Condition 3 Condition 2 Experimentaltasks Condition 1 Condition 2 Condition 3
  • 119. Data Collection and Analysis • The choice of a method is dependent on the type of data that needs to be collected • In order to test a hypothesis the data has to be analysed using a statistical method • The choice of a statistical method depends on the type of collected data • All the decisions about an experiment should be made before the experiment is carried out
  • 120. Data Types • Subjective (Qualitative) • Subjective survey • Likert Scale, condition rankings • Observations • Think Aloud • Interview responses • Objective (Quantitative) • Performance measures • Time, accuracy, errors • Process measures • Video/audio analysis How easy was the task 1 2 3 4 5 Not very easy Very easy
  • 121. Example: VR Navigation using Head Tilt • CHI 2017 paper from Tregillus, Al Zayer, and Folmer • Problem • Navigation in mobile VR difficult due to limited input options • Solution • Use head tilt to provide simulated joystick input Tregillus, S., Al Zayer, M., & Folmer, E. (2017, May). Handsfree Omnidirectional VR Navigation using Head Tilt. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (pp. 4063-4068). ACM.
  • 122. Implementation • Calculate head tilt angle • Difference between vertical head vector and gravity vector • Once head tilt is greater than threshold, move forward • However using head tilt alone prevents looking around • Head tilt navigation triggered when walking detected (from IMU) • Implemented in Unity and Google Cardboard SDK/Viewer
  • 124. User Study • Goal: To compare head tilt input to joystick input for navigation in mobile VR • Conditions • TILT: Head tilt input only • WIP-TILT: Head tilt + using walking to trigger tilt input • Joystick: Joystick input • Measures • Quantitative: Performance time, Number of obstacles hit • Qualitative: Simulator sickness (SSQ), user preferences
  • 125. Experiment Design • 25 Subjects (6 female, 19 male) • Within subjects design • All subjects do all conditions • Experience conditions in counterbalanced order • For each condition • Training then navigate through 5 virtual corridors • At end of condition take SSQ survey • Rate condition on Likert scale for efficiency, accuracy, etc. • After all conditions • Interview subjects for more feedback
  • 126. Results: Performance, Sickness • Performance time, Obstacles hit, SSQ sickness scores • Use one way ANOVA test for significance between conditions • TILT significantly faster and more accurate than WIP-TILT, joystick • No significant difference between sickness scores • Using p < 0.05 significance
  • 127. Results: User Preference • One way ANOVA comparing Likert scores (1 – 7) • significant diff. between TILT and WIP-TILT for efficiency, learnability, errors, likeability and immersion • significant diff. between TILT and joystick for learnability and immersion
  • 128. Discussion • TILT • Performed fastest because user didn’t need to walk in place • Liked condition best, except for immersion • TILT not ideal for VR applications where user needs to look around • WIP-TILT • Slower than TILT, more difficult to learn due to walking • User felt most immersive due to proprioceptive input • Shows that head tilt could be viable input for mobile VR
  • 129. Lessons Learned About Expt. Design • Decide on type of experiment • Within subject vs. between subject • Have well designed task with measurable outcomes • Use both qualitative and quantitative measures • Performance + user preference • Have enough subjects for significant results • Use the appropriate statistics • Compare conditions + perform post hoc analysis • Provide subject training on task • Observe user behavior and interview subjects
  • 131. Conclusion • Interaction Design methods can be used to develop effective Virtual Realty interfaces • Needs Analysis • Several methods available for determining user needs • Design • Use metaphors and affordances, good UI guidelines • Prototyping • Many rapid prototyping tools available • Evaluation • Use multiple methods for best evaluation