Things always go wrong in production, but that’s not a bad thing. It’s an opportunity to learn about your system and the real world with which it interacts. I’ll show you how to build feedback mechanisms that help you find out about issues as they happen and ship fixes quickly. Using real examples, I’ll walk you through how we use production QA practices and how you can find a balance between pre-production and production quality practices.

1. Fail be(er
with QA in Production.
Rouan Wilsenach
@rouanw
rouanw.github.io
. . .. . . . .

2. Zero produc1on
defects.

3. Most produc1on
defects are surprises.

4. What you thought you
knew was wrong.

5. Try again. Fail again.
Fail be(er.
Samuel Beckett, 1983

6. https://martinfowler.com/articles/qa-in-production.html

7. No1ce.
Learn.
Change.
...
...
....
↺

9. Pay a(en1on to your
cri1cal success factors.
$$$

10. Talk to your humans.

11. Track metrics.
. . .. . . . .

12. Dashboards.

13. Alerts.
!

15. If you liked it, then you
should have put a
metric on it.
#BeyonceMonitoring
Dan Abel, 2016
@twicezer0

16. Simple start.
4s 500 1

17. Something a li(le
unexpected.

20. Playing detec1ve.

21. Logs.
. .... .. . ...

23. Empty logs.
.

24. Learn more next 1me.
. .

25. Audi1ng.
——————————>

28. Are your tests slowing
you down?

29. User interface tests.
....................................

30. Performance tests.
. . . . . ………..

31. Are you ready for QA in
Produc1on?

32. Yes, but…

33. How fast can you ship a
fix?
....................................

34. How fast do you need
to ship a fix?
.$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$.....

35. Finding the right
balance.
....................................

36. No1ce.
Learn.
Change.
...
...
....
↺

37. Fail be(er
with QA in Production.
Rouan Wilsenach
@rouanw
rouanw.github.io
. . .. . . . .