This document discusses 7 cognitive biases that researchers should be aware of in their work: selection bias, observer-expectancy effect, framing bias, confirmation bias, groupthink and bandwagon effect, anchoring bias, and clustering illusion. It provides examples of each bias and recommends ways to prepare for, conduct, and analyze research to mitigate the influence of these biases. This includes using multiple recruitment channels, keeping an open mindset, considering alternative hypotheses, and collaborating with other researchers.
Kurla Call Girls Pooja Nehwal📞 9892124323 ✅ Vashi Call Service Available Nea...
7 Cognitive Biases We Shouldn't Ignore in Research
1. The researcher’s blind spot:
7 cognitive biases we shouldn’t ignore
in research
UX Singapore 2016
Ruth Ellison, Principal User Researcher, PwC’s Experience Centre
@RuthEllison
15. @RuthEllison from PwC’s Digital Services
Multiple channels - mix of
recruitment companies, social
media, trusted networks
Avoid professional respondents
Careful screeners
Behavioural based recruitment
Dealing
with
it….
16. @RuthEllison from PwC’s Digital Services
Running research sessions
Photo available under a CC by 2.0 licence: https://www.flickr.com/photos/gdsteam/20649386153
20. @RuthEllison
Loftus, E. F., & Palmer, J. C. Reconstruction of automobile destruction: An example of the interaction between language and memory. Journal of Verbal Learning and
Verbal Behavior, 1974, 13, 585-589.
McLeod, S. A. (2014). Loftus and Palmer. Retrieved from www.simplypsychology.org/loftus-palmer.html
About how fast were the cars going
when they smashed into each
other?
21. @RuthEllison
About how fast were the cars going when they
collided into each other?
About how fast were the cars going when they
bumped into each other?
About how fast were the cars going when they
contacted into each other?
About how fast were the cars going when they
smashed into each other?
22. @RuthEllison from PwC’s Digital Services
Triangulate research
Use observational methods
Keeping positive-neutral body
language, watch the tone of your
voice
Avoid leading questions
Dealing
with
it….
29. 29
Don’t just confirm your hypothesis, see if you can prove it wrong
Analysis of Competing Hypotheses (ACH)
30. 30
Use open ended questions
Some people think that soft drinks are bad for you.
What do you think?
What’s your opinion about soft drinks?
31. @RuthEllison from PwC’s Digital Services
List assumptions
Be skeptical, especially if everyone
agrees with you
Remain open
Consider all evidence equally
Multiple user researchers
Leave your ego by the door.
Dealing
with
it….
@RuthEllison from PwC’s Digital Services
34. @RuthEllison from PwC’s Digital Services
Triangulate with other research
methods (e.g. observational)
Use a mixture of individual and
group exercises
Avoid stating preferences and
expectations at start
Give someone the devil’s advocate
role to question assumptions
Dealing
with
it….
38. @RuthEllison from PwC’s Digital Services
Consider the order of questions and
designs carefully
Open ended questions
Alternate order in which participants
are shown concept or design versions
Show version A first
1 3 5
2 4 6 Show version B first
Dealing
with
it….
43. @RuthEllison from PwC’s Digital Services
Sample sizes – it’s about the WHY
Consider evidence equally – not just
the ones that confirm your belief/
assumption
Collaborative analysis sessions
Strive for objectivity
Dealing
with
it….
48. @RuthEllison from PwC’s Digital Services
Listen with an open
mind
Become more rational, but less
rationalising
Continuous learning
48
Always assess your method,
your analysis and yourself for
bias