Testing Comes into its Own in DevOps by Jack Maher

1. Testing comes into its own
in DevOps
Development and Operations get their names in lights, but Testing is the Magic!
LinkedIn.com/in/jackmaherpmp

2. Testing has been the Rodney Dangerfield of the
technology space for the last time:
LinkedIn.com/in/jackmaherpmp

3. DevOps is a cultural and professional
movement that stresses communication,
collaboration and integration between
software developers and IT operations
professionals.
The resulting improved workflow provides
businesses the flexibility to change, and
change quickly, without sacrificing the
quality and reliability of their IT-based business services.
DevOps provides companies a competitive advantage
by delivering better software, faster and by enabling sustained innovation.
DevOps
clipped compound of "development" and "operations"
Graphic credit: By Kharnagy - Own work, CC BY-SA 4.0, https://commons.wikimedia.org/w/index.php?curid=51215412
LinkedIn.com/in/jackmaherpmp

4. • DevOps is frequently associated with automating technology development
practices, such as Continuous Integration and Continuous Delivery,
and the tools needed to do these things
• But it is a lot more than that, and goes much deeper, with the foundation of
The Three Ways:
1 - Systems Thinking
2 - Shorten & Amplify Feedback Loops
3 - Culture of Experimentation & Learning
DevOps & Testing
LinkedIn.com/in/jackmaherpmp

5. You might not guess it from the name
but testing rules DevOps
• Largely misunderstood as a way of reducing testing costs,
automated testing is now a demand, as companies realize
the need and benefit of 100% testing coverage.
•Automated testing is the key that unlocks our ability to
deliver solutions faster, cheaper, safer, and better!
LinkedIn.com/in/jackmaherpmp

6. You might not guess it from the name
but testing rules DevOps
Image copyright DevOps Institute®
used with permission
LinkedIn.com/in/jackmaherpmp

7. Lean
– never knowingly pass a defect downstream
“Just as long as the brakes work 99% of the time…”
- Noone Ever
• Automated testing brings breakthrough capabilities
with step change improvements to performance, cost,
and flexibility
• Testing coverage and types – logistical implications
LinkedIn.com/in/jackmaherpmp

8. Current state thinking is based on flow
In current state architecture and technology implementation practices
testing becomes center stage, because without automated testing and
its attendant logistics, the flow of value is disrupted.
Does that sound like a bad thing?
Yes, the disruption of the flow of value incurs, or is a symptom of,
waste.
LinkedIn.com/in/jackmaherpmp

9. Theory of
Constraints
There is always
one constraint
that limits the
performance
of a system.
LinkedIn.com/in/jackmaherpmp

10. -- The truest feedback loop --
Understanding the Value Stream
Flow
Flow

11. -- automate the flow --
Understanding the Value Stream

12. “Only brush and floss
the teeth you want to keep.”
- Dr. Heidi Munz, DDS
“Which half do you want to test?” - the last QA manager

13. • The fundamentals of test design become even more important
– Efficiency without effectiveness
becomes a faster way to waste
resources
• Long term re-usability
– as in Continuous Testing
• Built in telemetry
continuous monitoring for performance
boundary testing and negative testing
• No more manual testers?
– Not as many,
Much more strategic
Testing & Test Design
Allistair Scott –
https://watirmelon.blog/2016/05/18/ama-the-eye-above-my-testing-pyramid/LinkedIn.com/in/jackmaherpmp

14. Old Skills & New Skills
• Traditional Testing skills
• Test design
• Domain knowledge
• Process understanding
• Automated Testing skills
• Test automation concepts & practices
• Telemetry and real-time monitoring
• Machine Learning and data analysis
LinkedIn.com/in/jackmaherpmp

15. Resources – We need more people!
• Need MORE skills and people
Recruiting the displaced, leveraging experience
• Keeping it up
Charlie & The Chocolate Factory meets Groundhog Day
• Matching business technology investments
Risk (cost) vs. Value
LinkedIn.com/in/jackmaherpmp

16. Extra Credit: Personas
Personas
– they’re not just for marketing & UX/UI
• Shared Libraries – synthesized insights
• Re-use with evolutionary attributes
• Provide depth and context
LinkedIn.com/in/jackmaherpmp

17. Testing is the real magic!
Jack Maher, MSIS, PMP, DOL, CAL
jackmaherllc@gmail.com
Connect with me on LinkedIn at
https://LinkedIn.com/in/jackmaherpmp
https://StandingOnShoulders.us
Standing On Shoulders:
A Leader’s Guide to Digital Transformation