Presentación en Interaction South America 14 (ISA14), Buenos Aires, 19-11-2014. Resultados de la investigación realizada por UX Fellows (www.uxfellows.com) e Inter-Cultura (www.inter-cultura.com).

1. ¿Gestos
universales
para
controlar
equipos
electrónicos?
Un
estudio
en
18
países.

2. Diseñamos
servicios,
productos
y
estrategias
centrados
en
la
persona.
Design
Thinking
|
Human-­‐Centered
InnovaHon
User
Experience
(UX)
|
Customer
Experience
(CX)
§ Pioneros
en
UX
e
innovación
en
ArgenHna
y
LaHnoamérica.
§ +10
años
de
acHvidad.
§ Diseño
|
InvesHgación
|
Consultoría
|
Capacitación

3. ● Worldwide
user
experience
research
● 27
partner
companies
● Joint
quality
levels
and
processes
● UX
experHse
+
local
culture
experHse
● UX
Research
in
35+
countries

4. What
is
a
gesture?
What
kind
of
gestures
are
we
interesHng
in?

5. Let’s
play
a
game…

6. Please
say:
Hello…

7. Please
say:
Hello…
Goodbye…

8. Please
say:
Hello…
Goodbye…
That
door…

9. Please
say:
Hello…
Goodbye…
That
door…
This
chair

10. Please
say:
Hello…
Goodbye…
That
door…
This
chair…
Put
this
chair
near
the
door…

11. Please
say:
Hello…
Goodbye…
That
door…
This
chair…
Put
this
chair
near
the
door…
Email
me
later…

12. Please
say:
Hello…
Goodbye…
That
door…
This
chair…
Put
this
chair
near
the
door…
Email
me
later…
Take
a
picture
to
this
guy

13. Please
say:
Hello…
Goodbye…
That
door…
This
chair…
Put
this
chair
near
the
door…
Email
me
later…
Take
a
picture
to
this
guy
Share
this
image
in
Facebook…

14. Gesture
technology
is
entering
our
lives

15. Touch
gestures

16. PoinHng
gestures

17. SemanHc
gestures
● Gestures
with
an
associated
meaning
● No
need
for
an
addiHonal
GUI
● PotenHally
more
efficient
Challenges
● Presumably
influenced
by
local
cultures
● Some
cultures
might
be
more
predisposed
to
the
use
of
SemanHc
gesture
for
gestures
than
others
mission
control
on
a
Mac

18. The
UX
Fellows
Gesture
Study
Which
seman8c
gestures
would
people
from
various
cultures
spontaneously
use
to
control
consumer
electronic
devices?
● Country
differences?
● Country
clusters?
● Underlying
metaphors?
● Acceptance?

19. We
compared
spontaneous
gesture
behavior
in
18
countries.
RU
CN
IN
AU
AR
CA
US
MX
UK
FR
ES
IT
FI
DE
BE
NL
TR
KR

20. The
UX
Fellows
Gesture
Study
(video)

21. Seing
15
min
Warm-­‐up:
everyday
gestures

22. Examined
Commands
Switch
on
device
Volume
up
Channel
up
Context
info
for
current
program
Channel
down
Share
current
program
Volume
down
Mute
volume
Pause
current
program
Homepage
EPG
backward
navigaHon
in
menus
Confirm
on-­‐screen
dialog
(OK)
Deny
on-­‐screen
dialog
(cancel)
Pause
video-­‐on-­‐demand
(VOD)
Restart
VOD
Fast
forward
VOD
Rewind
VOD
Skip
chapter
VOD
Previous
chapter
VOD
Stop
VOD
Switch
off
device
P+
P-­‐

23. Sample
Persons
who
are
able
to
imagine
a
gesture-­‐control
scenario
for
a
TV.
● Regular
usage
of
a
recent
HD
flat
TV
(max.
5-­‐6
years
of
age)
and
other
CE
devices
and
services
● High
interest
in
consumer
electronics
● Regular
usage
of
a
touch
device
● No
Xbox
Kinect
and
gesture-­‐enabled
TV
users
● PotenHal
buyers
of
interna8onal
"premium"
CE
brands
(no
naHonal,
retailer
or
"no
name"
brands)

24. Sample
sample
socio-­‐economic
background
country

25. Sample
49%
51%
65
years
32
16
18
countries
x
20
subjects
=
360
par8cipants
max
mean
min

26. The
Results

27. ElaboraHon

28. Difficulty
of
TV-­‐related
gestures
3,5
3,0
2,5
2,0
1,5
1,0
difficulty
Self-­‐reported
difficulty,
5
=
very
difficult,
1
=
very
easy,
n
=
360
tech-­‐savvy
CE
consumers
in
18
countries

29. Commonality
of
gestures
18
16
14
12
10
8
6
4
2
0
no.
of
countries
high
medium
low
no.
of
countries
with
the
same
main
gesture

30. Commands
with
high
commonality
Volume
down
Volume
up
Pause
VOD
Pause
current
program
Rewind
VOD
Fast
forward
VOD
Confirm
on-­‐screen
dialog
(OK)

31. Commands
with
high
commonality
Volume
down
Volume
up
Pause
VOD
Pause
current
program
Rewind
VOD
Fast
forward
VOD
Confirm
on-­‐screen
dialog
(OK)
Commonality
18
of
18
Difficulty
(1-­‐5)
1.8
Q:
How
do
you
turn
down
the
volume?

32. Commands
with
high
commonality
Volume
down
Volume
up
Pause
VOD
Pause
current
program
Rewind
VOD
Fast
forward
VOD
Confirm
on-­‐screen
dialog
(OK)
Commonality
18
of
18
Difficulty
(1-­‐5)
1.5
Q:
How
do
you
turn
up
the
volume?

33. Commands
with
high
commonality
Volume
down
Volume
up
Pause
VOD
Pause
current
program
Rewind
VOD
Fast
forward
VOD
Confirm
on-­‐screen
dialog
(OK)
Commonality
17
of
18
Difficulty
(1-­‐5)
1.5
NL
Q:
How
do
you
pause
viewing
a
film?

34. Commands
with
high
commonality
Volume
down
Volume
up
Pause
VOD
Pause
current
program
Rewind
VOD
Fast
forward
VOD
Confirm
on-­‐screen
dialog
(OK)
Commonality
17
of
18
Difficulty
(1-­‐5)
2.0
NL
Q:
How
would
you
pause
the
current
TV
program?

35. Commands
with
high
commonality
Volume
down
Volume
up
Pause
VOD
Pause
current
program
Rewind
VOD
Fast
forward
VOD
Confirm
on-­‐screen
dialog
(OK)
Commonality
15
of
18
Difficulty
(1-­‐5)
1.7
AU,
UK
NL
Q:
How
do
you
rewind?
(with
an
image
being
shown)

36. Commands
with
high
commonality
Volume
down
Volume
up
Pause
VOD
Pause
current
program
Rewind
VOD
Fast
forward
VOD
Confirm
on-­‐screen
dialog
(OK)
AU,
UK
NL
Commonality
15
of
18
Difficulty
(1-­‐5)
1.9
Q:
You
are
watching
a
boring
scene,
how
do
you
fast-­‐forward
(with
an
image
being
shown)?

37. Commands
with
high
commonality
Volume
down
Volume
up
Pause
VOD
Pause
current
program
Rewind
VOD
Fast
forward
VOD
Confirm
on-­‐screen
dialog
(OK)
Commonality
15
of
18
Difficulty
(1-­‐5)
1.9
CN,
IT,
KR
Q:
You
have
chosen
a
film
from
an
online
video
library.
The
TV
asks
you
"do
you
really
want
to
buy
the
film?"
How
do
you
answer
"yes"?

38. Commands
with
medium
commonality
Channel
up
Channel
down
Stop
VOD
Mute
volume
backward
navigaHon
in
menus
Deny
on-­‐screen
dialog
(cancel)
Skip
chapter
VOD

39. Commands
with
medium
commonality
Channel
up
Channel
down
Stop
VOD
Mute
volume
backward
navigaHon
in
menus
Deny
on-­‐screen
dialog
(cancel)
Skip
chapter
VOD
P+
AU,
ES,
KR,
US
CA
Commonality
13
of
18
Difficulty
(1-­‐5)
1.8
Q:
You
are
zapping
through
the
TV
programs:
How
do
you
change
from
channel
15
to
channel
16
for
example?

40. Commands
with
medium
commonality
Channel
up
Channel
down
Stop
VOD
Mute
volume
backward
navigaHon
in
menus
Deny
on-­‐screen
dialog
(cancel)
Skip
chapter
VOD
AU,
ES,
KR,
UK,
US
CA
P-­‐
Commonality
12
of
18
Difficulty
(1-­‐5)
1.6
Q:
You
are
zapping
through
the
TV
programs:
How
do
you
change
from
channel
16
to
channel
15
for
example?

41. Commands
with
medium
commonality
Channel
up
Channel
down
Stop
VOD
Mute
volume
backward
navigaHon
in
menus
Deny
on-­‐screen
dialog
(cancel)
Skip
chapter
VOD
CN,
KR
FI,
RU
NL
Commonality
13
of
18
Difficulty
(1-­‐5)
2.1
Q:
How
would
you
stop
watching
the
film
altogether
(because
you
want
to
do
something
different)?

42. Commands
with
medium
commonality
Channel
up
Channel
down
Stop
VOD
Mute
volume
backward
navigaHon
in
menus
Deny
on-­‐screen
dialog
(cancel)
Skip
chapter
VOD
AU,
CN,
MX
BE
UK
FI,
RU
Commonality
11
of
18
Difficulty
(1-­‐5)
2.0
Q:
How
do
you
set
the
volume
to
"mute"?

43. Commands
with
medium
commonality
Channel
up
Channel
down
Stop
VOD
Mute
volume
Backward
navigaHon
in
menus
Deny
on-­‐screen
dialog
(cancel)
Skip
chapter
VOD
AU,
BE,
CA
AR,
RU
ES,
MX,
US
Commonality
10
of
18
Difficulty
(1-­‐5)
2.3
Q:
Imagine
that
you
were
looking
for
a
film
in
an
online
video
library.
You
have
gone
to
the
comedies
secHon
and
have
chosen
the
descripHon
of
a
single
movie.
Now
you
want
to
return
to
the
previous
set
of
opHons
(all
of
the
comedies).
Which
gesture
would
you
use
for
that?

44. Commands
with
medium
commonality
Channel
up
Channel
down
Stop
VOD
Mute
volume
backward
navigaHon
in
menus
Deny
on-­‐screen
dialog
(cancel)
Skip
chapter
VOD
AU,
CN,
RU,
TR
KR
AR,
BE,
IT,
MX
Commonality
9
of
18
Difficulty
(1-­‐5)
1.8
Q:
How
do
you
express
that
you
don’t
want
to
buy
it?

45. Commands
with
medium
commonality
Channel
up
Channel
down
Stop
VOD
Mute
volume
backward
navigaHon
in
menus
Deny
on-­‐screen
dialog
(cancel)
Skip
chapter
VOD
BE,
CN,
ES,
FI,
FR,
IN,
MX,
UK
NL
Commonality
9
of
18
Difficulty
(1-­‐5)
2.2
Q:
How
would
you
skip
to
the
next
chapter
of
the
film?

46. Commands
with
low
commonality
Switch
on
device
Switch
off
device
Previous
chapter
VOD
Restart
VOD
Share
current
program
EPG
Context
info
for
current
program
Homepage

47. Commands
with
low
commonality
Switch
on
device
Switch
off
device
Previous
chapter
VOD
Restart
VOD
Share
current
program
EPG
Context
info
for
current
program
Homepage
BE,
FR,
US
KR
DE,
IT
TR
CA
FI
CN
Commonality
8
of
18
Difficulty
(1-­‐5)
2.0
Q:
How
would
you
switch
on
the
TV?

48. Commands
with
low
commonality
Switch
on
device
Switch
off
device
Previous
chapter
VOD
Restart
VOD
Share
current
program
EPG
Context
info
for
current
program
Homepage
ES,
MX,
NL
CA
IN,
KR
RU
AR
TR
Commonality
7
of
18
Difficulty
(1-­‐5)
2.9
Q:
How
would
you
switch
off
the
TV?
Note:
No
common
gesture
in
Italy

49. Commands
with
low
commonality
Switch
on
device
Switch
off
device
Previous
chapter
VOD
Restart
VOD
Share
current
program
EPG
Context
info
for
current
program
Homepage
BE,
CN,
ES,
FI,
FR,
MX,
NL
UK
IN,
US
Commonality
8
of
18
Difficulty
(1-­‐5)
2.0
Q:
How
would
you
return
to
the
previous
chapter
of
the
film?

50. Commands
with
low
commonality
Switch
on
device
Switch
off
device
Previous
chapter
VOD
Restart
VOD
Share
current
program
EPG
Context
info
for
current
program
Homepage
AU,
ES,
KR,
MX
AR,
DE
BE
NL
RU
US
Commonality
7
of
18
Difficulty
(1-­‐5)
2.0
Q:
How
do
you
start
it
(film)
again?
Note:
No
common
gesture
in
UK

51. Commands
with
low
commonality
Switch
on
device
Switch
off
device
Previous
chapter
VOD
Restart
VOD
Share
current
program
EPG
Context
info
for
current
program
Homepage
CN,
FR,
IN
FI
AR,
TR
MX
NL
KR
RU
US
Commonality
6
of
18
Difficulty
(1-­‐5)
3.2
Q:
How
would
you
share
with
your
friends
what
you
are
currently
watching
or
listening
to?
Note:
No
common
gesture
in
UK

52. Commands
with
low
commonality
Switch
on
device
Switch
off
device
Previous
chapter
VOD
Restart
VOD
Share
current
program
EPG
Context
info
for
current
program
Homepage
AU,
US
CN,
FI,
IN,
KR,
RU
NL
BE,
UK
MX
TR
Commonality
5
of
18
Difficulty
(1-­‐5)
2.8
Q:
You'd
like
to
see
an
overview
of
tonight's
TV
programs
of
the
main
channels
(EPG).
How
do
you
acHvate
this
funcHon
with
a
hand
gesture?
Note:
No
common
gesture
in
Italy

53. Commands
with
low
commonality
Switch
on
device
Switch
off
device
Previous
chapter
VOD
Restart
VOD
Share
current
program
EPG
Context
info
for
current
program
Homepage
FR,
KR,
RU
AU,
FI
CN,
IN,
TR
AR
DE
BE
ES
US
UK
Commonality
4
of
18
Difficulty
(1-­‐5)
2.8
Q:
How
would
you
get
more
informaHon
for
the
running
TV
program?

54. Commands
with
low
commonality
Switch
on
device
Switch
off
device
Previous
chapter
VOD
Restart
VOD
Share
current
program
EPG
Context
info
for
current
program
Homepage
AR,
AU,
MX
NL,
UK
DE
FI
BE,
IN
CA,
ES,
TR
US
Commonality
4
of
18
Difficulty
(1-­‐5)
2.9
Q:
Now
you
want
to
go
to
the
iniHal
set
of
opHons
-­‐
that
means
the
first
opHons
you
see
when
you
switch
on
the
device.
Note:
No
common
gesture
in
Italy

55. Direct
vs.
abstract
gestures
We
observed
two
kinds
of
gestures.
● "Direct"
gestures
o strongly
influenced
by
touch
devices
● Abstract
gestures
o basis
in
language,
iconography
and
metaphors
o associated
with
more
complex
tasks
o lower
intercultural
commonality

56. Some
general
insights

57. Average
gesture
difficulty
by
country
max
5,0
3,0
2,5
2,0
1,5
1,0
Everyday
gestures
CE
gestures
TR
FR
MX
AR
IN
FI
CN
RU
NL
DE
AU
US
BE
ES
CA
IT
KR
UK
difficulty
min
…

58. Average
gesture
difficulty
by
country
max
5,0
3,0
2,5
2,0
1,5
1,0
CE
gestures
FR
CN
TR
IN
AR
RU
MX
US
IT
DE
AU
FI
CA
BE
ES
NL
UK
KR
difficulty
min
…

59. Gesture
difficulty
by
countries
FR
CN
TR
IN
AR
RU
MX
US
IT
DE
AU
FI
CA
BE
ES
NL
UK
KR
Volume
down
Pause
VOD
Channel
down
Rewind
VOD
Volume
up
Deny
on-­‐screen
dialog
(cancel)
Channel
up
Confirm
on-­‐screen
dialog
(OK)
Switch
off
device
Fast
forward
VOD
Switch
on
device
Restart
VOD
Mute
volume
Previous
chapter
VOD
Pause
current
program
Stop
VOD
Skip
chapter
VOD
backward
navigaHon
in
menus
Context
info
for
current
program
EPG
Homepage

60. Gesture
difficulty
by
countries
FR
CN
TR
IN
AR
RU
MX
US
IT
DE
AU
FI
CA
BE
ES
NL
UK
KR
Mean
Volume
down
1.2
1.2
1.3
1.6
1.3
1.1
1.3
1.6
1.3
1.4
1.6
1.5
1.5
1.6
1.0
1.5
2.2
2.2
1.5
Pause
VOD
1.3
1.5
1.1
1.3
1.1
1.3
1.6
1.2
1.5
1.4
1.4
1.7
1.5
1.4
1.7
1.5
2.2
2.9
1.5
Channel
down
1.1
1.4
1.5
1.4
1.4
1.1
1.5
1.7
1.7
2.0
1.8
1.8
1.6
1.8
1.0
1.6
2.3
2.1
1.6
Rewind
VOD
1.0
1.6
1.3
1.8
1.8
1.8
1.3
1.8
1.6
1.4
1.5
2.0
1.5
2.5
1.2
2.0
2.4
2.5
1.7
Volume
up
1.4
1.8
1.8
1.4
1.3
1.6
1.3
1.9
1.4
1.9
1.6
1.6
1.9
2.0
1.9
2.2
2.5
2.3
1.8
Deny
on-­‐screen
dialog
(cancel)
1.3
1.8
2.1
1.3
1.2
1.7
1.3
1.5
1.6
1.5
1.7
1.8
1.8
2.4
2.6
1.9
2.5
2.5
1.8
Channel
up
1.2
1.5
1.5
1.7
1.5
1.8
1.5
2.1
1.8
2.0
2.2
1.7
2.4
1.8
1.4
2.2
2.5
2.2
1.8
Confirm
on-­‐screen
dialog
(OK)
1.7
2.1
2.2
1.3
1.8
1.8
1.3
1.5
1.7
2.1
1.8
2.1
2.1
1.4
2.4
1.9
2.3
2.3
1.9
Switch
off
device
1.5
1.9
1.1
1.9
1.5
2.3
1.6
1.8
2.0
2.0
1.6
2.1
2.2
2.0
2.3
2.0
2.2
2.4
1.9
Fast
forward
VOD
1.9
1.6
1.5
2.1
1.8
2.0
1.4
1.7
1.6
1.6
1.8
2.1
1.7
2.1
2.3
2.2
2.6
2.5
1.9
Switch
on
device
2.1
1.3
1.4
1.7
1.4
1.6
2.2
1.4
1.9
2.0
2.1
1.9
2.4
2.7
2.5
1.9
2.3
2.6
2.0
Restart
VOD
1.8
1.5
1.7
1.9
1.5
1.9
1.6
1.6
2.1
1.4
2.5
1.7
1.9
2.4
2.7
2.1
2.5
3.0
2.0

61. General
acceptance
● Our
360
tech-­‐savvy
parHcipants
responded
very
posi8vely
to
the
idea
of
semanHc
gesture
input
for
TVs.
"fun
to
use",
"convenient",
"coolness
factor"
● ParHcipants
would
like
to
use
gestures
to
control
other
devices
as
well
(e.g.
audio).

62. OperaHon
Many
parHcipants
felt
that
voice
and
sound
could
be
a
good
support
for
gesture
input.
waking
up
the
device
with
a
sound
Can
the
TV
hear
me?

63. Gesture
type
preference
FR CN TR IN AR RU MX US IT DE AU FI CA BE ES NL UK KR
Seman8c
Poin8ng
Many
users
would
prefer
switching
between
gesture
types.
Σ
l l l l
l l l
l l l l l l
l l 15
l
l l l
l
l
l l l
9
associated
with
more
advanced
commands

64. Typical
concerns
of
users
● Learning
and
reten8on
of
gestures
(but:
would
be
easy
if
based
on
implicit
behavior
repertory)
● Sensi8vity
and
accuracy
of
devices
● Interference
by
other
gestures
in
the
room
● Compa8bility
with
lean-­‐back
disposi8on

65. Conclusions

66. Conclusions
1. For
basic
CE
commands
a
common
language
for
semanHc
gestures
already
exists
across
cultures.
2. More
complex
commands
could
be
realized
by
either
a. customizing
these
gestures
for
each
individual
market
b. customizing
individually
c. proposing
a
set
of
semanHc
gestures
that
need
to
be
learned
(the
study
provides
some
suggesHons)
d. switching
to
poin8ng
gestures
in
combinaHon
with
a
GUI
3. It
is
necessary
to
consider
cultural
differences
at
a
country
level
when
it
comes
to
designing
advanced
gesture
control
for
globally
marketed
devices.

67. Thumbs
up
to
the
audience!
Download
complete
reports:
www.uxfellows.com
Find
us
at:
gonzalo.auza@inter-­‐cultura.com
inter-­‐cultura.com

68. Thumbs
up
to
the
audience!