Presentation based on the Award Winning Paper by Varadarajan Srinivasan on Zero Touch QA Automation Platform at STC Nov 2018.
Companies that are in DevOps Journey go through a rough weather in QA Automation initiatives. With the industry transformation to Digital Trend, there is always a need for an efficient streamlined Continuous Delivery.
This Webinar would talk about Zero Touch QA Automation Platform. It deals with the Solution on Integrated DevOps & Quality Approach. This would consist of Artificial Intelligence in Reporting and Data Visualization. The Complete QA Cycle is automated from Test Design to Test Closure with Continuous Monitoring, involving no manual intervention. The Webinar would also give insights on Business benefits/outcome on adopting this approach with streamlined Governance.
2. About TaUB Solutions
• TaUB - “Taking you Beyond”
• HQ in Bangalore – Office in USA and Singapore
• Gamification Consulting, Training and
Implementation Services
• Focus on Value and help customer reach
strategic objectives
3. Hari
Gurumoorthi
| DevOps & Agile Practice Head
| Continuous Delivery Architect
| DevSecOps
| Data Analytics
| UXCIO @ TaUB Solutions
■ 19+ years of experience Quality
Assurance for fortune 500 clients
■ Experienced in building data-driven
solutions
■ Passionate in spreading DevOps Best
Practices
■ Frequent Blogger and Speaker in
International Conferences
4. Varadharajan
Srinivasan
| Delivery Management
| Quality Engineering
| Data Engineering
Associate Director
■ 17+ years of experience Quality
Assurance for fortune 500 clients
■ Expert in quality organization
transformation towards DevOps and
Agile delivery model
■ Focus on LeanQA and POD delivery
model
■ 50+ blogs and speaker in
conferences
■ Winner of QAI Best of the Best
Testing Leadership Award
5.
6. What is your current state of QA
Automation in your organization?
• QA is manual
• QA is 20% automated
• QA is 50% automated
• QA is 75% automated
• QA is fully automated
https://linkto.run/p/NIQ653OE
Please provide your answers in the below Link
8. Top 5 Challenges
01 Need simplified automation approach to enable functional
testers with test automation
02 Need manual effort reduction in end-to-end test process
03 Need ability to automatically analyze the test failures
04 Need ability to focus on 360 degree Quality Assurance
05 Need solution to measure Code coverage
9. Challenge 1
Need to simplify Test Automation
AGILE ADOPTION
Expected to have more
frequent releases
Current Team have less
automation expertise
Go beyond UI test to API and
data testing
Need to automate regression /
progression test cases
AND NO COMPROMISE ON PRODUCT
QUALITY
CHALLENGE
Stress endures handling knowledge
upskilling and project deadlines in parallel
Automation Enablement
for entire team is time taking process
Testing needs to go away from only E2E
to Component, API to reduce cycle time
Agile Transformation demands
Layered | High adoption | Simplified
10. Challenge 2
Need to automate the E2E QA Lifecycle
Is it practically possible to practice every phase of Software Test Life Cycle Process in DevOps/Agile Model ?
What if we skip QA Process?
No E2E Traceability
Lack of documentation
loss of knowhow
Low Defect Containment efficiency
No view on project health
Lack of Quality Control
What if hours on the QA Process?
Considerable manual effort
Prolonged Time to Market
Not suitable in Agile delivery models
ImpactsOutweigh
Focus not just on Test
Execution Automation
Efficient and
Continuous Testing
Agility possible through
Fully automated QA
Process
Requirement Analysis
Test Design
ALM Update
Test Scripts Development
Test Execution
Test Logs
Test Reporting
Test Closure
11. Costly &
Complicated
Adoption!
Challenge in adapting to
complicated tools amidst
project deadlines
No Transparency on
Project Health
Cumbersome to monitor
and maintain KPIs in
multiple forum
Delayed
Feedback!
Unproductive days due
to bad builds and test
failures caused by
environmental issues
Huge Effort spent!
Multiple test runs a day &
continuous investigation of
failures leading to
considerable effort spend
Challenge 3
Simplify Test Analysis & Reporting
13. Challenge 5
Need solution to measure Code coverage
There are too many test cases which test the same code path
A tester is not aware of the areas that have not been tested
Redundant
& non-productive
Incomplete
& un-tested
Conventional requirements-based testing of code tends to result in considerable over-testing
without the guarantee of complete coverage
Focusing on high
value tests?
Facilitating faster
Stabilization of final release ?
Enough testing
in place ?
Impact - This typically results in additional QA cost and extended testing timelines which in turn
impact project success
14. A Vision for Digital IT Industry
ZERO TOUCH QA
Adopt next-generation testing practices to test early, often, automatically and continuously
15. 1 Automated Functional Testing
Simplification/ Script less Automation
Challenge
01 Getting the existing team to
upskill in programming
language to automate
02 Meeting the current project
deliverables and upskilling
puts stress on the testers
03 To retain the domain
knowledge that enables
quality product delivery
Solution
Simplify the various types of
automation using a BDD
construct
Example: Karate for API test
Benefits
Enabled 90% of existing team
for progression and regression
automation
Reduced test automation effort
by 60%
16. 1 Automated Functional Testing
UI Test Simplification
Then I enter the text {103 John F Kennedy Pkwy, STE 234} into {Billing Street} Text Area
Then I enter the text {New York} into {Billing City} Text Box
Then I select the drop down value as {Available} in {Customer Status}
Then I select the {Active Account} checkbox
Then I select the {Current Date} date for {Data Update Date} field
Then I click on the {Edit} Button
Control 1. Identify Patten (Generic XPATH )
Text Area //label[text()='"+ LABEL +"']/following::td[1]/textarea
Text Box //label[text()='"+ LABEL +"']/following::input[1]
Check Box //label[text()='"+ LABEL +"']/following::input[1]
Date Field //label[text()='"+ LABEL +"']/following::td[1]//span[@class='dateFormat']
Button //input[@value='"+ LABEL +"']
Drop Down //label[text()='"+ LABEL +"']//following::td[1]//select
3. Abstract with BDD Construct (Scenario)
1. Identify Patterns
2. Review and Align with UI
Developers
3. Abstract with BDD Construct
4. Publish Language of
Automation
17. 1 Automated Functional Testing
API Test Simplification
1. Identify Patterns
2. Review and Align with UI
Developers
3. Abstract with BDD Construct
4. Publish Language of
Automation
Karate Framework Integration with BDD
18. 2 Automatic creation of Test Cases/Defects
Automate E2E QA Lifecycle Process
JIRA
Dashboard
with Test
Metrics
Creation of
Bugs in JIRA
for failed
test cases
and Auto
Analysis of
Failed Bugs
Update the
Test Cases
as Pass/Fail
as per Test
Results
Creation of
Test Cases
in JIRA
under the
Test Cycle
Run the
Automation
Test Cases in
QA
Environment
Trigger Job
from Jenkins
Begin
Step 1
Step 2
Step 3
Step 4
End
19. 2 Automatic creation of Test Cases/Defects
Zephyr JIRA Integration
AUTOMATED STATUS AND DEFECTSAUTOMATED TEST CASE
Note: Options are available to avoid logging of duplicate defects in JIRA
21. 3 Auto Analysis of failures
AI powered Test Automation Dashboard
with Real-Time Analytics
22. 3 Auto Analysis of failures
AI powered Test Automation Dashboard
with Real-Time Analytics
AL BASED ANALYSIS
CENTRAL REPOSITORY FOR INTEGRATED
DASHBOARD AND REPORTS
FAILURE TRACKING
/ MANAGEMENT
23. 4 Automatic trigger of NFT and auto upload of test results
360 degree Quality Assurance
Features:
Perform Performance Testing using Jmeter, integrated with Jenkins
Perform Security Testing using Fortify, integrated with Jenkins
Upload the Results in Confluence automatically
Benefits:
Transparent visibility of test results
70% of effort savings in Test Closure activities
24. 5 Quality Intelligence Test with Sealights tool
Automatic Code Coverage Analysis
Features:
o Test Gap Analytics
o Release Quality Analytics
o Block Untested Code Changes
o Utilize Test Impact Analytics to Test Smarter
Benefits:
o 100% Improvement in Code Coverage for Test Cases
o Test Quality Analytics to Test More with “Less Tests Approach”
25. UAT/STAKEHOLDER’S
DEMO
Production
Release
Zero Touch QA Automation Platform
Deployment Pipeline
AUTOMATED QA WORKFLOW
AUTOMATIC TRIGGER OF QA FUNCTIONAL TEST
AUTOMATIC CREATION
OF TEST CASES/DEFECTS
AUTOMATED
FAILURE ANALYSIS
Karate
1
2 3
AUTO., TRIGGER OF
QA PERF. TEST
AUTOMATIC RESULTS
RECORDING
AUTO., TRIGGER OF
SECURITY TEST 4
QUALITY
INTELLIGENCE TEST
5
USER STORY IDE
Code Commit Status update
Commit code
VERSION
CONTROL
CODE QUALITY
UNIT TEST
COVERAGE
UNIT TEST
BUILD PIPELINE
STATIC CODE
ANALYSIS
CI / CD ORCHESTRATION
UNIT TEST
27. Upcoming Events
Webinar
Lean Experimentational Model for DevOps
Public Training
Continuous Delivery Architect
Certified Agile Service Management
DevSecOps Engineering (DSOE)℠
16, 17 FEB 2019
Virtual Instructor Lead
16, 17 FEB 2019
Virtual Instructor Lead
09, 10 MAR 2019
Virtual Instructor Lead
Build features that provides an impact to
your customers by well structure and data
driven model
APRIL 2019
28. Thank You
15692 Kiefer Rd
Germantown,
Ohio
USA 45327
Novel Tech Park
Kudlu Gate,
Bangalore,
INDIA 560068
30 Cecil Street,
#19-08 Prudential Tower,
Singapore,
SINGAPORE 049712
www.taubsolutions.com info@taubsolutions.com