Slides for Janet Gregory and Lisa Crispin's workshop

1. Advanced
Topics
in
Agile
Tes0ng
Agile
Tes0ng
Days
2014
Lisa
Crispin
and
Janet
Gregory
Agile
Tes)ng:
A
Prac)cal
Guide
for
Testers
and
Agile
Teams
More
Agile
Tes)ng:
Learning
Journeys
for
the
Whole
Team

2. A
li=le
about
us
Janet
Agile
Tes0ng;
2009
More
Agile
Tes0ng:
Oct
2014
First
agile
team:
2000
Currently
coaching,
training
Twi=er:
janetgregoryca
Email:
janet@agiletester.ca
Website:
www.agiletester.com
www.agiletester.ca
Lisa
First
agile
team
–
2000
Currently
tes0ng
at
Piviotal
Tracker
Twi=er:
lisacrispin
Email:
lisa@agiletester.ca
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

3. The
Day…
Maybe!
1. Introduc0ons
2. What
do
we
want
to
talk
about?
3. Priori0ze
the
topics
4. Start
tackling
one
problem
at
a
0me,
using
different
brainstorming
techniques
5. Perhaps
0me
at
the
end
for
general
discussion
or
mini-­‐open
space
for
topics
not
discussed
earlier
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

4. Expecta0ons
• Collabora0ve,
problem
solving
a_tude,
open
• Workshop
–
explore
some
new
fron0ers!
• Some
slides
–
if
we
need
them
for
explana0on
• You’ll
leave
with
some
experiments
to
help
with
your
biggest
problems
and
goals
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

5. What
might
we
talk
about?
It’s
up
to
you!
• Skills
needed
• Selec0ng
tools
• Technical
debt
• Automa0on
• Pairing
pa=erns
• Exploratory
tes0ng
• Experimen0ng
• Agile
tes0ng
quadrants
Tes)ng
in:
• distributed
teams
• with
out-­‐sourcing
• enterprise
environments
• data
warehousing
/
BI
• regulatory
environments
• embedded
systems
• mobile
apps
Others?????
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

6. Introduc0ons
• What
is
your
specialty?
• What’s
your
goal
for
today?
• Self
organize
into
table
groups!
If
possible,
get
some
diverse
special0es.
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

7. Let’s
get
started
…
• Use
the
s0cky
notes
on
the
tables
to
iden0fy
your
problems
• Try
be
specific
because
we’ll
be
grouping
them
later
7

8. Now
…
Let’s
priori0ze
Put
your
s0ckies
on
the
wall
chart
Group
similar
issues
Dot
vote
for
your
“favorites”
(three
votes
each)
8

9. Next…
• Set
SMART
goals
for
the
top
3
problems
we
have
iden0fied.
• What
might
be
a
measure
for
each.
20
minutes

10. 4
Problems
–
4
Approaches
Brainstorming
techniques
experimenta0on
– to
help
achieve
goals
– to
reduce
problem
size
Techniques
we’ll
experiment
with
are:
1. Impact
mapping
2. Brain
wri0ng
3. Communica0ng
around
a
whiteboard:
drawing,
mind
mapping,
flow
diagrams
4. Brain
wri0ng
with
a
twist
Debrief
on
each
technique,
sharing
stories
and
experiences,
possibly
short
exercises
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

11. Round
1:
Impact
Mapping
–
Gojko
Adzic
• Why
are
we
doing
this?
-­‐-­‐-­‐
the
goal
• Who
can
help
or
hinder?
-­‐-­‐-­‐
the
stakeholders
• How
can
they
help
or
hinder?
-­‐-­‐-­‐
the
impacts!
• What
can
we
do
to
help?
-­‐-­‐-­‐
the
deliverables
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

12. Impact
Map
Example

13. Problem
#1
on
our
list
Use
impact
mapping
to
help
iden0fy
possible
solu0ons
1. Take
your
group’s
highest
priority
goal.
That’s
the
Why?
of
your
impact
map.
2. Create
an
impact
map
with
Whos,
and
Hows
for
each
Who,
and
Whats
for
each
How.
3. What’s
the
first
experiment
you’d
try?
Choose
one
path
in
the
map
to
share
with
other
groups.
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory
15
minutes

14. Round
1:
Outcomes
–
Impact
Mapping
• What
experiments
do
you
want
to
try?
• Any
interes0ng
stories?
• Any
outstanding
ques0ons?
• Any
surprises
about
using
impact
mapping?
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

15. Round
2:
Brain
Wri0ng
What
is
brain
wri0ng?
• It’s
a
way
to
share
your
ideas
in
wri0ng
and
for
others
to
add
theirs
h=ps://en.wikipedia.org/wiki/6-­‐3-­‐5_Brainwri0ng
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

16. Problem
#2
on
your
list
Use
brain
wri0ng
to
help
iden0fy
possible
solu0ons
1. Each
of
you
take
a
sheet
of
paper.
2. Write
your
ideas
for
ways
to
work
towards
the
goal
on
the
paper.
3. Ater
three
minutes,
pass
your
paper
to
the
next
person.
(we’ll
call
0me)
4. Read
the
ideas
on
the
paper
you
got,
and
add
more
of
your
own.
5. Con0nue
un0l
each
person
has
wri=en
on
each
paper.
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory
20
minutes

17. Round
2:
Outcomes
–
Brain
Wri0ng
• What
experiments
do
you
want
to
try?
• Any
interes0ng
stories?
• Any
outstanding
ques0ons?
• Any
surprises
about
using
brain
wri0ng?
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

18. Round
3:
Using
a
Whiteboard
It’s
about
:
• Collabora0ng
• Visualizing
• Asking
ques0ons
• Clarifying
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

19. Mind
Mapping
as
a
Tool
Sub
topic
Sub
topic
Sub
topic
MAIN
TOPIC
Sub
topic
Sub
topic
first
&me
change
new
account
password
rules
encryp&on
save
user
name
rules
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

20. Problem
#3
on
your
list
Use
the
flip
chart
paper
to
draw
to
help
clarify
ideas
and
generate
possible
solu0ons
1. Gather
around
the
flip
chart
paper
2. Start
discussing
ideas
for
working
towards
the
goal.
Draw
as
you
talk.
You
can
draw
a
mind
map,
flow
diagram,
pictures,
whatever
helps
you
think.
3. Capture
ideas
and
experiments
to
try
15
minutes
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

21. Round
3:
Outcomes
-­‐
Drawing
• Did
drawing
help?
• What
experiments
or
ideas
did
you
capture?
• Any
interes0ng
stories?
• Any
outstanding
ques0ons?
• Any
surprises
about
drawing?
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

22. Round
4:
Brain
Wri0ng
with
a
Twist
Use
other
groups
to
help
iden0fy
possible
solu0ons
15
minutes
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

23. Choose
your
next
problem
1. Start
on
your
flipchart
2. Write
your
ideas
for
ways
to
work
towards
the
goal.
3. Ater
five-­‐ten
minutes,
move
right
to
the
next
team’s
flip
chart
(we’ll
call
0me)
4. Read
the
problem/goal
and
the
ideas
wri=en
down,
and
add
more
of
your
own.
5. Con0nue
for
3
rounds
30
minutes
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

24. Round
4:
Outcomes
-­‐
• Take
a
look
at
all
the
ideas
• Can
you
turn
those
ideas
into
realis0c
experiments
to
try?
• Any
surprises
about
this
way
of
thinking?
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

25. What’s
next?
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

26. • The
More
Resources
following
slides
may
be
helpful
for
topics
we
discussed
or
for
future
reference.
• We’ll
write
down
resources,
and
there’s
a
separate
list
of
useful
links
• Guiding
development
with
examples
• Tes0ng
• Automa0on
tools
• Learning
/
skills
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

27. √

28. ATDD
(Acceptance
Test
Driven
Development)
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

29. The
discussion
is
the
important
part
• Try
this
in
your
groups
–
discuss
this
word
• Think
of
different
aspects
• How
many
different
perspec0ves
can
you
get?
• Does
it
have
different
consequences
based
on
how
you
use
it?

30. Pairing
for
Tes&ng
Tester-
Designer
Tester-
Support
Tester-Tester
Tester-Coder
Analyst, DBA,
Sys Admin,
Customer…
Tester-
Marketer
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

31. Story
Mapping
Ac0vi0es
by
0me
Stories
Child
From
Janet
Gregory
&
MaA
Barcomb
Jeff
Pa=on:
h=p://
www.agileproductdesign.com/
blog/the_new_backlog.html
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

32. Story
Mapping
Example
Story
Map
From
Steve
Rogalsky
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

33. Let’s
Talk
Tes&ng
….
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

34. 34
Agile
Tes0ng
Quadrants
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

35. Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
GregVoray
ria0on
from
Gojko
Adzic

36. Think
Tes&ng
at
Different
Levels
of
Precision

37. Test
Automa0on
Volcano
Original
idea
from
Ma=
Barcomb;
Image
by
Jenn
Sinclair
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

38. The
key
is
“sustainable
pace”
Technical
debt
slows
us
down
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

39. • Whole
Whole
Team
Approach
team
=
project
team
• Team
is
responsible
for
tes0ng
ac0vi0es
– Includes
automa0on
• Whole
team
has
all
the
skills
needed
• Team
designs
for
ease
of
test
automa0on
• Whole
team
is
‘automa0on-­‐infected’
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

40. Choosing
Your
Tools
One
size
does
not
fit
all
!
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

41. • Focus
Understand
the
Purpose
on
the
problem,
not
the
tool
• What’s
being
automated?
• What
are
the
exis0ng
tools,
environment?
• What
is
the
life
span,
or
future
use
of
tests
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

42. What
Fits
Your
Situa0on
• Exis0ng
skills
on
the
team
• Who’s
doing
what?
• What
are
your
constraints?
• Language
of
the
applica0on
under
test
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

43. • Enables
testers
/
business
to
define
tests
• test
code
can
be
in
programming
language
• Programmers
can
run
tests
as
they
code
• Testers
can
ask
programmers
for
help
• Takes
0me
from
‘coding’
produc0on
code
• Tests
are
usually
through
the
UI
• Programmers
aren’t
usually
willing
to
help
• Tests
are
implemented
ater
the
code
is
wri=en
• Testers
create
and
implement
all
tests
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

45. Tests
as
Living
Documenta0on
• Business
readable
• Once
passing,
must
always
pass
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

46. Learning
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

47. Mul0-­‐
discipline
skills
Expert
/
Discipline
skills
T-­‐Shaped
Skills

48. Square-­‐shaped
Team
Breadth of Skills
Depth of Skills
See
links
for
more
by
Rob
Lambert
and
Adam
P.
Knight

49. Context
Sensi0vity
Large
organiza0ons

50. Supportive Culture
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

51. The right infrastructure
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

52. The right people
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

53. Confidence
Building
Prac0ces
1. Use
real
examples
2. Perform
exploratory
tes0ng
3. Test
your
features
(and
the
system)
4. Learn
con0nually
5. Sensi0vity
to
your
context
6. Keep
it
real
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

54. References
See
the
“Recommended
Resources”
handout
Advanced
Topics
on
Agile
Tes0ng:
Lisa
Crispin
&
Janet
Gregory

55. Currently
Available
Agile
Tes)ng:
A
Prac)cal
Guide
for
Testers
and
Agile
Teams
By
Lisa
Crispin
and
Janet
Gregory
www.janetgregory.ca
email:
janet@agiletester.ca
Twi=er:
@janetgregoryca
55
Soon
Available
More
Agile
Tes)ng:
Learning
Journeys
for
the
Whole
Team
By
Janet
Gregory
and
Lisa
Crispin
www.agiletester.ca
www.agiletester.com
lisacrispin.com
email:
lisa@agiletester.ca
Twi=er:
@lisacrispin