Suneeta Palande who is a Delivery Manager at LTI along with Sachin Sangle who is a Sr. Test Manager at LTI and Niharika Dutta who is a Sr. Business Development Executive in Quality Assurance at LTI took a Session on "QA alignment in the DevOps world" at Global Testing Retreat #ATAGTR2019 Please refer our following post for session details: https://atablogs.agiletestingalliance.org/2019/12/04/global-testing-retreat-atagtr2019-welcomes-suneeta-palande-as-our-esteemed-speaker/ https://atablogs.agiletestingalliance.org/2019/12/04/global-testing-retreat-atagtr2019-welcomes-sachin-sangle-as-our-esteemed-speaker/ https://atablogs.agiletestingalliance.org/2019/12/05/global-testing-retreat-atagtr2019-welcomes-niharika-dutta-as-our-esteemed-speaker/

1. #ATAGTR2019
QA alignment in DevOps world:
Suneeta Palande, Sachin Sangle and Niharika Dutta
14th 15th Dec 2019

2. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
Introduction to DevOps in QA
What is DevOps
o Extension to agile – Brings the
release and deployment activities
closer
o Enables software development and
testing to happen simultaneously
o Continuous collaboration between
all stakeholders
Collaboration of People
Process
Tools
People Automation of Processes
Integration of Tools
3pillarsofDevOps

3. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
Expected Challenges while implementing QA in DevOps
Quality
Engineers
Delivery
Manager
Quality
Manager
Project
Manager
Where does testing fit
in a DevOps Model?
How should I
collaborate with all the
different streams?
What additional skills
does QA need to
acquire?
How do I keep a check
on overall engagement
health?
Is testing still a phase?
What and How much to
automate?
Developers
How different is CI/CD than DevOps?
How is testing and QA in DevOps different than testing in Agile and Waterfall models?
How can we change the mindset of working in silos and working as One team (Dev+QA+Ops) instead
Common
Challenges
Persona-
Based
Challenges

4. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
Impact on QA in the DevOps World
• Alignment with DevOps Pipeline, New Technologies,
Tools
• Shorter Testing Cycles to ensure faster time to market
• Enablement of early testing in development lifecycle
• Comprehensive quality gates to ensure build at each
testing phase
• One Team Approach - Collaboration with Development
and Operations Team
• Understanding of Continuous Integration, Delivery, and
Deployment model
• Keeping up with fast moving lifecycle ensuring quality
• QA to QE Transformation
BuildCode Integrate Test Release Deploy Operate
Agile Development
Continuous Delivery
Continuous Deployment
DevOps
Continuous Integration

5. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
AO/AM
Continuous Testing
Test Monitoring
Test Design
Test Planning & Collaboration
 Business Process Test
 Multi directional Traceability
 Automated script development for
regression, Smoke, Integration and
Build verification tests
 Optimize regression suite
1
2Shift Left Practices
 Feature Verification
 Service Virtualization
 Static Code Analysis and
analyze Code Coverage using
tools like CAST and Sonar
 Automated Code quality
validation to eliminate
technical Debt
3
4
5 DevOps (UAT / Ops)
Automate Ops Verification
Activities Ex: Logs monitoring,
Log reviews, Environment
Health checks to ensure
availability of DB, web services
etc.
6
 Risk Impact Based Execution
 Automated Functional Test script Execution (Desktop, Web, Mobile)
 Automate Non-Functional Test (Security, Performance, Load)
 End to end Test Orchestration and faster deployments in DevOps
 In-sprint Automation using TDD/BDD
 Automated Test Data Provisioning
 Sprint Reporting
 Application &
management level reports
 Holistic view of utilization
of budget, tools and
resources
 Accelerated Defect triage
and resolution and metric
reporting using
 Smart Planning using Predictive
Analytics
QA interventions throughout the DevOps Model

6. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
QA contribution to DevOps Lifecycle Automation QA to QE Transformation Enabling AI/ ML
• Improve business agility and
reducing application downtime
failures through hyper collaboration
• Focus on End Customer
• Automate the complete Software
Development lifecycle
• Build in Cloud
• Better Monitoring and Transparent
Reporting
• Implement a Collaborative
platform business assurance
platform for faster Agile and
DevOps adoption
• Automate beyond test execution by
expanding to Test Reporting,
Application Hotspots & Code
Impact Analysis
• Identify key hotspots for
automation using AI
• Quality Engineer will have the
skillset of a Developer with the
mindset of a QA
• Basic Technical knowledge
including Unix/Shell Scripting
knowledge, CI/CD Jenkins,
Performance Monitoring tool and
Resiliency testing, Query
monitoring tools such as Splunk
• Cloud Services, Azure/AWS
• Deployment of Agile Coach and
Domain SMEs
• Ongoing skill enhancement &
multi-skilling
• AI & ML based Insights to run
intelligent regression packs and
Instant view of code functions
affected vs Test scenarios/ cases
• Helps to identify the hotspot and
anomalies for each code build
• Early defect detection via AI
driven defect analysis &
prediction on past QA defects,
logs, resolution notes &
production issues with real time
interactive dashboards
Key tenets for successful implementation of DevOps

7. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
Key Benefits of QA and DevOps integration
QA and DevOps integration will bring
Our Best Practices for DevOps:
• Active Stakeholder Participation-which says that developers
should work closely with all of their stakeholders, including
operations and support staff--not just business stakeholders.
This is a two-way street: Operations and support staff must
also be willing to work closely with developer.
• Automated Testing- Automated regression testing is a common
practice adopted by agile teams, which is sometimes extended
to test-first approaches such as test-driven development (TDD)
and behavior-driven development (BDD).
• Integrated Configuration Management- enables operations
staff to understand the potential impact of a new release,
thereby making it easy to decide when to allow the new
release to occur.
• Integrated Change Management- With integrated change
management, development teams must work closely with
operations teams to understand the implications of any
technology changes at an organization level.
• Continuous Integration- CI enables developers to develop a
high-quality working solution safely in small, regular steps by
providing immediate feedback on code

8. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
Thank You

9. #ATAGTR2019
As a author of this presentation I/we own the copyright and confirm the originality of the content. I/we allow Agile testing alliance to use the content for social media marketing, publishing it on ATA Blog or ATA social medial
channels(Provided due credit is given to me/us)
Project Execution Methodologies- The Change
QA involvement across
execution
methodologies