Mais conteĂșdo relacionado Semelhante a Why Big Data Needs Ethnography (20) Why Big Data Needs Ethnography2. www.azimuthlabs.io
Copyright © 2018
AZIMUTH LABS
Matt Artz
M.B.A., M.S.
Matt Artz is the founder and principal researcher at Azimuth Labs, an ethnographic research company
offering product development, organizational culture, and corporate strategy consulting. Using
ethnography, he helps organizations unlock hidden insights with users, employees, data, markets, and
products.
Matt has led research, design, and agile product management efforts to ship and scale web and mobile
products in the enterprise and consumer space. He has experience working in energy, biotechnology,
healthcare, financial services, telecommunications, entertainment, fashion, broadcasting, and nonprofit.
3. www.azimuthlabs.io
Copyright © 2018
MARYWOOD UNIV
Dr. Uldarico Rex Dumdum
M.E., M.S., M.B.A., Ph.D
Dr. Uldarico REX Dumdum is an Associate Professor of Information Systems and Leadership in the
School of Business and Global Innovation at Marywood University.
His research interests include problem formulation in ill-structured complex situations, sensemaking,
requirements engineering, contextual intelligence, innovation, convergence of technology, strategy and
leadership, leadership development, and leadership in face-to-face and virtual settings.
6. www.azimuthlabs.io
Copyright © 2018
I B M
Big data is a term
applied to data sets
whose size or type
is beyond the
ability of traditional
relational
databases to
capture, manage,
and process the
data with low-
latency.
12. www.azimuthlabs.io
Copyright © 2018
UNDERSTANDING INNOVATIONOPTIMIZATION
Identify new markets and
products through richer
understanding.
Enhance decision-making by
leveraging data to create
insights.
Optimize business process
by better understanding the
operations.
Big Data PromisesWhat the Proponents Believe
16. www.azimuthlabs.io
Copyright © 2018
âThe often implicit assumption that big data is a substitute for, rather
than a supplement to, traditional data collection and analysis.â
The Parable of Google Flu: Traps in Big Data Analysis
David Lazer, Ryan Kennedy, Gary King, and Alessandro Vespignani. 2014
DATA HUBRIS
17. www.azimuthlabs.io
Copyright © 2018
- GFT overestimated the prevalence of flu in the 2012â2013 season
and overshot the actual level in 2011â2012 by more than 50%.
- From 21 August 2011 to 1 September 2013, GFT reported overly
high flu prevalence 100 out of 108 weeks.
- The explanation was increased media coverage, however in 2009
Google tried to correct for this problem.
The Parable of Google Flu: Traps in Big Data Analysis
Lazer, D., R. Kennedy, G. King, and A. Vespignani. 2014
Google Flu TrendsA Case Study in Data Hubris
GOOGLE FLU TRENDS OVERESTIMATION
19. www.azimuthlabs.io
Copyright © 2018
- In 2009 Tricia Wang recommended to Nokia that low-income
consumers were ready to pay for more expensive smartphones.
- Nokia claimed her ethnographic data was to small in sample
size, and the power of their big data analytics informed them
otherwise.
- Reduced Nokiaâs market share to 4% in 2014, from 35% a
decade ago.
Why Big Data Needs Thick Data
Tricia Wang, 2013
Nokia & SmartphonesA Case Study in Thick Data
NOKIA'S QUANTIFICATION BIAS
26. www.azimuthlabs.io
Copyright © 2018
âTechnologyâs interaction with the social ecology is such that technical
developments frequently have environmental, social, and human
consequences that go far beyond the immediate purposes of the
technical devices and practices themselvesâ
- Kranzberg, M. âTechnology and History: Kranzbergâs Lawsâ. 1986.
TECHNOLOGY IS NOT NETURAL
27. www.azimuthlabs.io
Copyright © 2018
Meta ProblemsThe Culture of Big Data
MYTHOLOGY COMPLETENESS REFLEXIVITYINTERPRETATION
The culture of dig
data is closed and
lacks reflection.
All researchers are
biased, even if it is
quantitative.
The sampling & data
collection does not
represent the whole
There is a prevailing
belief that big data
alone is sufficient.
28. www.azimuthlabs.io
Copyright © 2018
B O Y D & C R A W F O R D , 2 0 1 2
Big data is a
cultural,
technological, and
scholarly
phenomenon that
rests on the
interplay of
technology, analysis,
and mythology.â
29. www.azimuthlabs.io
Copyright © 2018
S A R A H P I N K , 2 0 1 7
Data is always
incomplete.. It does
not tell us enough
contextual
information about
the people involved,
the environments
and contingent
circumstances that
they are in.
30. www.azimuthlabs.io
Copyright © 2018
D A N A H B O Y D , 2 0 1 0
Interpretation is the
hardest part of doing
data analysis. And
no matter how big
your data is, if you
don't understand the
limits of it, if you
don't understand
your own biases,
you will misinterpret
it.
31. www.azimuthlabs.io
Copyright © 2018
L U C Y S U C H M A N , 2 0 1 1
As Levi Strauss
said, âwe are our
toolsâ and thus we
should consider how
the tools participate
in shaping the world
with us as we use
them.
32. www.azimuthlabs.io
Copyright © 2018
âIt is still necessary to ask critical questions
about what all this data means, who gets
access to what data, how data analysis is
deployed, and to what ends.â
âBoyd & Crawford 2012
40. www.azimuthlabs.io
Copyright © 2018
Deeply HumanThe Strengths of Ethnography
A deep exploration of the
human experience to
contextualize data.
THICK DATA
02
The process of openly
exploring our beliefs,
practices and concepts of
knowledge.
REFLEXIVITY
03
Intentionally acknowledges
researcher bias in collection,
analysis, and interpretation.
ACKNOWLEDGED BIAS
01
41. www.azimuthlabs.io
Copyright © 2018
R A T T E N B U R Y & N A F U S 2 0 1 8
The ethnographic
approach to this
issue is to treat
bias as data about
the phenomenon to
be explainedânot
as a corrupting
factor to be
eliminated.
42. www.azimuthlabs.io
Copyright © 2018
T R I C I A W A N G 2 0 1 6
Thick data grounds
are business
questions in human
questions... and
rescues the context
loss that comes
from making big
data usable and
leverage the best of
human intelligence.
43. www.azimuthlabs.io
Copyright © 2018
M A R G A R E T M E A D
Scientists have to
learn how to relate
self-knowledge as a
multisensory being
with a unique
personal history as
a member of a
culture at a specific
period to ongoing
experience.
45. www.azimuthlabs.io
Copyright © 2018
Mixed MethodsCombine Big Data & Ethnography
Continue to reflect on our
process, and use
research and design to
iterate on it.
Iterate the Process
Data scientists and social scientists practicing ethnography should be
paired with each other in the process of asking question, listening,
defining, reframing, collecting, analyzing, and presenting the data.
The Goal
Acknowledge our
assumptions & limitations
when interpreting data.
Account for Bias
Combine offline with
online data to add depth
and understand context.
Seek the Context
From participants to
researchers, focus on the
people behind the
project.
Focus on People
46. www.azimuthlabs.io
Copyright © 2018
F O R I N N O VAT I O N
Use qualitative studies to first define the problem
space, and define and prototype some possible
solutions. Then use quantitative studies to
validate.
EXPLORATORY SEQUENTIAL DESIGN
F O R O P T I M I Z AT I O N
Use quantitative studies to understand the current
performance and to identify anomalies. Then use
qualitative studies to explain the findings.
EXPLANATORY SEQUENTIAL DESIGN
47. www.azimuthlabs.io
Copyright © 2018
- In 2013 Netflix knew from their quantitative data that people were
watching, but they couldnât explain what, why, and how.
- They hired Grant McCracken to conduct an ethnography of
consumers to understand these offline decisions.
- He found people are watching good TV with a kind of passionate
and critical engagement, where they second-guess casting
decisions and camera angles and take almost a practitionerâs
pleasure in observing how the thing is crafted, even as they are
caught up by the craft.
- Now Netflix offers the same content continuously instead of
related content, which has proved quantitatively effective.
Netflix & BingingA Case Study in Mixed Methods
NETFLIX SEEKS A MIX METHODS APPROACH
48. www.azimuthlabs.io
Copyright © 2018
Leverage SensemakingUsing Research in the Service of People
2
3
4
5
1
6 YOUR
GREAT
TITLE
LISTEN
REFRAME
STRATEGY
INSIGHTS
RESEARCH
MINING
Strategy
Use the insights to inform a
business strategy.
Insights
Synthesize the patterns to
generate actionable insights.
Reframe
Reframe the business problem
from the customer perspective.
Listen
Listen with empathy to the
business problem.
Mining
Mine the data for patterns that tell
a story.
Research
Conduct the research and collect
the data.
49. www.azimuthlabs.io
Copyright © 2018
âBy outsourcing our thinking to Big Data,
our ability to make sense of the world by
careful observation begins to wither, just as
you miss the feel and texture of a new city
by navigating it only with the help of a
GPS.â
âChristian Madsbjerg, Red Associates 2014