5. Data reduction techniques
• Participant data cards
• Post-it note affinity exercise
• Summarize in field notes
• Paraphrase quotes
• Pick out key quotes only
• Tag only relevant photos; discard others
• Answer your research questions after each session
• CODE YOUR DATA
6. Ways to code social interaction
Strauss (1987)
1. Interactions among actors
2. Conditions
3. Strategies and tactics
4. Consequences
Lofland (1971)
1. Acts
2. Activities
3. Meanings
4. Participation
5. Relationships
6. Settings
7. A UX centric way to code
Usable Desirable
Findable
Useful
Valuable
Credible
Accessible
The elements of UX by Peter Morville
9. Step 2: Data display
Display Name Type Description Good for
Partially ordered Context chart Network style Shows inter-relationships among roles and groups Organizational research
Checklist matrix Table style List of effects around a single variable Deep understanding of one variable
Time ordered
Event listing Table style List of events or process Understanding a process
Critical Incident
Chart Table style List of only key events over time Understanding inflection points
Event state
network Network style Completed after event listing; shows context
Understanding causes and contexts of
chronology
Activity record Network style
A narrative of each event in a detailed process, in node
display Showing details of multi-step process
Decision
modeling Network style Flow chart of events
Interactive flows and/or wireframes for
Web sites
Time ordered
matrix Table style A table, with time events as columns Tracking key drivers of change
Role ordered
Role ordered
matrix Table style
Table summarizing roles in rows and variables in
columns
In-depth understanding of single sites
and roles within them
Role-by-time
matrix Table style A role-order matrix, with time as an additional column Showing who does what when
Conceptually
ordered
Conceptually
clustered matrix Table style
Table with participants in rows and research questions in
columns
Answering original research questions,
discerning patterns
Thematic
Conceptual matrix Table style Table with themes in rows and variables in columns
Answering original research questions,
setting up for quant
Folk Taxonomy Network style
Unstructured network diagram similar to a mental model,
includes hierarchical ordering Brainstorming causality
Cognitive map Network style
Unstructured diagram summarizing an individual's
understanding of a phenomenon Starting an aggregate mental model
Effects matrix Table style A table for describing outcomes of particular events
Revealing what might be a dependent
variable in future quant study
11. Time ordered display
Stage 0:
Inventory
Stage 1:
Christmas
Thinking
Stage 2:
Purchase and
Prep
Stage 3:
Decorate
Stage 4:
Top-up Trip
Stage 5:
Experience
Stage 6:
Cancelling
Christmas
Stage 6A:
January Sales
Participants "check" their
lights and ensure that they
have all the basic supplies
to complete the
job. Participants are re-
familiarizing themselves
with the items they need to
put up the lights. This
requires actually
LOOKING at the items.
There is a pulling out and
opening of boxes. This is a
half-hearted poke around.
In fact, many of our
participants were doing
this inventory for this
project. There is little
urgency about the
process.
Participants are picking up
general signals about the
coming Christmas season.
The signals are in stores,
magazines, on television,
on the radio, and in their
workplaces. It is also
sometimes through their
children's experiences at
school. This phase
happens only after
Halloween is over.
Participants at this stage
are "dreaming" of
Christmas, musing about
Christmas in general.
There is little concrete
planning. It involves
creating a "mental mood
board" of the look and feel
of this year's decorations.
Changes to last year's
design is often spurred by
other design changes to
the house.
Participants in this stage
are getting into project
management mode. The
goal here is to gather all
the materials necessary
for the outdoor lighting
and the indoor
decorations. This is a
concerted process with
specific goals and some
urgency. It involves
verifying the mental list of
requirements generated in
Stage 0. It also involves
The Drive To The Store,
which may actually be
several drives to several
stores. Specificity is now
required.
Participants are
now in execution
mode. This day
or days is
usually the "first
nice day" that
occurs after
Christmas
Thinking. It may
be the same day
as Stage 2
(which makes for
a very long day).
Participants on
this day have
very specific
goals that must
be completed by
the end of that
day. The end of
this day is quite
satisfying and
often involves a
self-
congratulatory
drink.
Participants in this
optional stage have
been forced to get
more supplies.
Driving to the store
after decoration
has begun is
particularly vexing.
They will return to
finish Stage 3. This
stage is thankless,
frustrating and
must be done
quickly.
Participants are
managing the new
lighting during this
stage. This
involves the turning
off and on of lights
(or outsourcing this
responsibility to a
timer if they have
one). It also
involves the
enjoyment of the
lights as they
themselves pull
into the driveway.
Participants in this stage are
switching into archiving
mode. Putting away
decorations is often
exhausting and even
bittersweet. As a result, they
may not employ good
archiving practices (e.g.,
they may throw lights into
piles with no labels or
careful coiling). Everything,
including the lights, goes
away at this time.
Participants may arbitrarily
define some items as
"winter-y" in order to keep
them out on display. They
may also make justifications
for keeping "Christmas"
lights up, including: they're
"all year round lights" or "we
just won't turn them on."
Participants in this stage
need help archiving items,
and reasons to keep lights
up.
Few participants
engage in this stage.
This is the "Martha"
character who seeks
out sales in order to
save money. She is
already organized, so
she needs little project
management
assistance.
Participants in this
stage are price
motivated, but will not
buy just anything.
15. Step 3: Drawing conclusions
The company of the future will be
smaller, filled with older workers, and
will take up less physical space.
1. Hunt for patterns
2. Write out explicit
conclusions
3. Check raw data again
4. Triangulate
5. Find exemplars
6. Ask, “so what”?
Notas do Editor
This is how Miles and Huberman conceive of qualitative data analysis. They believe that these three steps are what constitutes the analysis. Note that they overlap and continue throughout the research project.
Miles and Huberman note that data reduction does NOT NECESSARILY MEAN quantification. Data can be reduced in volume in many ways. For example: selecting emblematic quotes, summarizing field notes, writing analytic memos, paraphrasing long quotes. Reduction is the process whereby you decide what is important. In quant research it’s very easy…measures of central tendency, measures of dispersion, tests of significance.
But as Van Maanen calls qualitative research as “procedures for counting to 1.” That means that data reduction is a key component to every stage of the qual research project. Miles and Huberman argue that it happens even when you’re crafting your research question.
The DISPLAY stage is particularly important to design-based research in part because it lives “good design,” but also because it creates a “shared artifact” for the team to experience, annotate and co-own. This is perhaps the most ironic of all parts of Miles and Huberman’s book in that their own displays are really quite terrible. I’ve taken a stab at summarizing
Note that these stages are also iterative, with each beginning and ending in short sprints.
Miles and Huberman note that this is a critical step. Qual research generated voluminous amounts of data. It’s the hardest thing for us to reduce our data. But we do it, often without thinking about it. They note that “words are fatter than numbers.” This is the big problem with qual data
Ways we might reduce data
One way to do this is through writing a case summary or a field visit report. This is one you see here on the left that I did for an ethnography of people who use . You can see that I’m summarizing important points relating back to the research questions.
Another is through “coding.” On the right is an image from my friend Steve Portigal’s Web site. He’s doing research here on the nature of reading. You can see with the pink post its, he’s naming a category. In this way, he is summarizing or REDUCING. That’s what categorizing is – reducing the amount of data you have.
M & H summarize a few other authors’ suggestions for how to code. You can think of these as categories or even variables.
I personally am a big fan of strategies and tactics from a UX perspective. It shows you where the user is frustrated or over compensating or looking for a workaround. That can be a usability workaround or more recently we see social workarounds, like if we embarrass them.
Useful. As practitioners, we can’t be content to paint within the lines drawn by managers. We must have the courage and creativity to ask whether our products and systems are useful, and to apply our knowledge of craft + medium to define innovative solutions that are more useful.
Usable. Ease of use remains vital, and yet the interface-centered methods and perspectives of human-computer interaction do not address all dimensions of web design. In short, usability is necessary but not sufficient.
Desirable. Our quest for efficiency must be tempered by an appreciation for the power and value of image, identity, brand, and other elements of emotional design.
Findable. We must strive to design navigable web sites and locatable objects, so users can find what they need.
Accessible. Just as our buildings have elevators and ramps, our web sites should be accessible to people with disabilities (more than 10% of the population). Today, it’s good business and the ethical thing to do. Eventually, it will become the law.
Credible. Thanks to the Web Credibility Project, we’re beginning to understand the design elements that influence whether users trust and believe what we tell them.
Valuable. Our sites must deliver value to our sponsors. For non-profits, the user experience must advance the mission. With for-profits, it must contribute to the bottom line and improve customer satisfaction.
Onenote
Photo Gallery
Max QDA
Network or table
A simple table is pretty useful because it is easy to do and you can do it immediately in excel. The network style is harder because you have to use either Visio or I’ve just bought mind mapper, which I can show you in a second.