This document discusses UX design research for voice assistants. It provides examples of techniques used for testing voice assistants like Alexa and Google Home including Wizard of Oz testing, late stage usability testing, and contextual research. Wizard of Oz testing involves understanding what users will say and do without a functional prototype. Late stage usability testing identifies issues with misheard utterances, timing, and technical behavior. Contextual research explores the context of use and user behavior over time. The document advocates applying design principles for voice like asking clear questions and providing a limited number of responses.
14. 14
ID7
Start Alexa, open
CBeebies
BBC Kids sting
Game
Let's listen and find
out who's here to
play
Start
Alexa,
ask CBeebies to
play
BBC Kids sting
Character
introduction
Character
introduction
Who do you want
to play with?
[Character
we have]
Surprise
[Something we
can’t understand]
Intera
Exper
Sorry! I’m not
sure what you
said. Who do you
want to play with?
[Character
we have]
Surprise
[Something we
can’t understand]
Uh oh - I still don’t
understand.
Would you like to
meet more friends
or would you like
a surprise?
ID1
ID2 ID3
ID3
ID4
ID8
FX1
FX1
Would you
like a game
or a story?
Play menu sting
FX3
Story
Start
Alexa,
ask CBeebies for
a story
BBC Kids sting
FX1
Story menu sting
FX5
Choice sting
FX2
Random Experiences
Last time you
listened to a story
Story recall
My bookshelf is full
Random Stories
Story
played
before?
Yes
No
Alexa, help
Interruptive
utterance
Choice help
message
Help
Alexa, help
Interruptive
utterance
Help
Play navigation
help message
Stop
See you again
soon!
ID6
End
ID23
ID11 ID12 ID12
ID13ID20 FX6
ID18
ID19
FX7
Help sting
FX7
Help sting
FX7
Help sting
FX7
Help sting
FX7
[Something we
can’t understand]
ID1.2
Sorry, I didn’t
catch that.
Remember to
speak nice and
clearly. Would you
like a game
or a story?
[Something we
can’t understand]
Random
Silly me. I still
don’t understand.
Let’s play a game.
ID1.3
Silly me. I still
don’t understand.
Let’s hear a story.
ID1.4
30. Wizard of Oz Testing
☑ Understanding the design
☑ What users will say
☑ What users will do
Late stage Usability Testing
☑ Misheard utterances
☑ Timing issues
☑ Technical behaviour
34. Discover a piece of
content really like
Don’t explore the
skill as much
Discover limitation in
extent of content
Fully explore
the skill
Behaviour over time
35. 35
Contextual Research
☑ Context of use
☑ Behaviour over time
☑ Longitudinal opinions
Wizard of Oz Testing
☑ Understanding the design
☑ What users will say
☑ What users will do
Late stage Usability Testing
☑ Misheard utterances
☑ Timing issues
☑ Technical behaviour
36. 36
Wizard of Oz Testing
Late stage Usability Testing
Contextual Research
☑ Context of use
☑ Behaviour over time
☑ Longitudinal opinions
☑ Understanding the design
☑ What users will say
☑ What users will do
☑ Misheard utterances
☑ Timing issues
☑ Technical behaviour
56. How might we increase the
breadth of content discovered and
consumed by our audience?
57. There are 5 games to play
How about "Justin" or “Andy"
Choose one or ask for more
Let’s find out who’s here to play
“Justin” “Andy”
Who do you want to play with?