SlideShare uma empresa Scribd logo
1 de 29
Baixar para ler offline
Turn by Turn: A Practical Guide to Test Management
NICO KRÜGER, CTO, HELIX ALM — PERFORCE SOFTWARE
2 | A Practical Guide to Test Management in Helix ALM perforce.com
Presenter
Nico Krüger
Chief Technical Officer, Helix ALM
Perforce Software
3 | A Practical Guide to Test Management in Helix ALM perforce.com
What We’ll Cover
1
2
3
What shift left and shift right testing cover.
How to track testing progress, handle bugs, and manage re-testing efforts.
Why Helix ALM is the best way to ensure complete test coverage.
4 | A Practical Guide to Test Management in Helix ALM perforce.com
What Shift Left and Shift Right Testing Cover
Shift Left Shift Right
of New Code of Every Build of Every Deployment In Production
5 | A Practical Guide to Test Management in Helix ALM perforce.com
Why Shift Left?
• Deliver more software at a faster
rate.
• Shift left: start testing earlier in the
process.
• Focus on problem prevention.
AttentiontoQuality
Plan and
Design
Develop
and Build
Test Deploy and
Release
Monitor
and Analyze
Shift Left
Model Traditional
Quality
Model
6 | A Practical Guide to Test Management in Helix ALM perforce.com
Why Shift Right?
• Building quality in itself is not enough in today’s
competitive market.
• Using continuous feedback from users is equally
important in the testing process.
• Ensuring that what was created works in
practice for real users — not just matches the
design or user needs.
7 | A Practical Guide to Test Management in Helix ALM perforce.com
Benefits of Shifting Left and Shifting Right
• Find bugs earlier.
• Save time later on.
• Improve test coverage and quality.
• Foster teamwork between
developers and testers.
• Improve software delivery cycles.
• Reduce costs over time.
• Reduce technical debt.
Illustration from “Continuous testing in DevOps” (Dan Ashby)
8 | A Practical Guide to Test Management in Helix ALM perforce.com
Things to Think About
Change
How do you handle design changes
based on customer feedback?
Visibility
Can you capture all these testing results
effectively? And prioritize and act on
them?
Risk
How can this help you reduce risk and lower
time to market?
A Practical Guide to Test Management with Helix ALM
Track testing progress, handle bugs, and manage re-testing efforts
10 | A Practical Guide to Test Management in Helix ALM perforce.com
Common Test Activities For Each Release
Risk analysis
Effort estimates
Test strategy
Project plan
Requirements review
Test design
Test data creation
Test automation
Automated testing
Manual test execution
Performance testing
Test results
Defect reports
Metrics analysis
Actuals vs. planned
Planning Preparation Execution Outcome
11 | A Practical Guide to Test Management in Helix ALM perforce.com
Planning Activities
• What are we building?
• High risk items
• Release and sprint breakdown
• Test plan and strategy
Requirement / user story
Test cases, test suites, estimations
Commit work to sprint / release
Classification, risk score
12 | A Practical Guide to Test Management in Helix ALM perforce.com
1. What Are We Building?
• Requirement / user story in Helix ALM:
13 | A Practical Guide to Test Management in Helix ALM perforce.com
2. High Risk Items
• Classification and risk score in Helix ALM:
14 | A Practical Guide to Test Management in Helix ALM perforce.com
3. Release and Sprint Breakdown
• Commit work to sprint / release in Helix ALM:
15 | A Practical Guide to Test Management in Helix ALM perforce.com
4. Test Plan and Strategy
• Test cases and test suites in Helix ALM:
16 | A Practical Guide to Test Management in Helix ALM perforce.com
Preparation Activities
• Requirements reviewed
• Test coverage
• Test design
• Manual vs. automated
Review process, approvals
Traceability
Test cases
Manual vs. automated inputs
17 | A Practical Guide to Test Management in Helix ALM perforce.com
1. Requirements Reviewed
• Review process and approvals in Helix ALM:
18 | A Practical Guide to Test Management in Helix ALM perforce.com
2. Test Coverage
• Traceability in Helix ALM:
19 | A Practical Guide to Test Management in Helix ALM perforce.com
3. Test Design
• Manual test cases in Helix ALM:
20 | A Practical Guide to Test Management in Helix ALM perforce.com
4. Manual vs. Automated
• Capture results in Helix ALM:
REST API
< />
Helix ALM
Server
Define and manage test
cases in Helix ALM.
Use {ANY} test automation
framework to create and
execute tests in.
1. Create automation scripts.
2. Create test case in Helix
ALM for each automated
test.
3. Use Helix ALM’s REST API
to generate test runs and
record test results.
Endpoint:
…/helix-
alm/api/v0/testruns/generate/
POST:
{
testCaseIDs : [50,89],
events : []
}
21 | A Practical Guide to Test Management in Helix ALM perforce.com
Execution Activities
• Execution
• Results
Pass, fail actions
Track results
22 | A Practical Guide to Test Management in Helix ALM perforce.com
1. Execution
• Pass or fail actions in Helix ALM:
23 | A Practical Guide to Test Management in Helix ALM perforce.com
2. Execution
• Track results in Helix ALM:
24 | A Practical Guide to Test Management in Helix ALM perforce.com
Outcome Activities
• Production monitoring and feedback
• How to track and manage results and
feedback
• Incorporate into future testing
Capture feedback
Capture feedback
Improve test coverage
25 | A Practical Guide to Test Management in Helix ALM perforce.com
• Capture feedback in Helix ALM:
1. Production Monitoring and Feedback
26 | A Practical Guide to Test Management in Helix ALM perforce.com
2. How to Track and Manage Results and Feedback
• Capture feedback in Helix ALM:
SoloSubmit
REST API
Web or Desktop Client
27 | A Practical Guide to Test Management in Helix ALM perforce.com
3. Incorporate into Future Testing
• Improve test coverage in Helix ALM:
The Results
End-to-end traceability
Higher quality
Faster time to deployment
Q & A

Mais conteúdo relacionado

Mais procurados

How to organize qa process in agile speed
How to organize qa process in agile speedHow to organize qa process in agile speed
How to organize qa process in agile speed
Svitlana Dubyk
 
Agile performance testing
Agile performance testingAgile performance testing
Agile performance testing
Andriy Melnyk
 

Mais procurados (20)

Test automation - What? Why? How?
Test automation - What? Why? How?Test automation - What? Why? How?
Test automation - What? Why? How?
 
Agile Test Automation: Truth, Oxymoron or Lie?
Agile Test Automation: Truth, Oxymoron or Lie?Agile Test Automation: Truth, Oxymoron or Lie?
Agile Test Automation: Truth, Oxymoron or Lie?
 
Neotys PAC 2018 - Helen Bally
Neotys PAC 2018 - Helen BallyNeotys PAC 2018 - Helen Bally
Neotys PAC 2018 - Helen Bally
 
How to organize qa process in agile speed
How to organize qa process in agile speedHow to organize qa process in agile speed
How to organize qa process in agile speed
 
Optimising Quality Assurance in an Agile World
Optimising Quality Assurance in an Agile WorldOptimising Quality Assurance in an Agile World
Optimising Quality Assurance in an Agile World
 
Building a Test Automation Strategy for Success
Building a Test Automation Strategy for SuccessBuilding a Test Automation Strategy for Success
Building a Test Automation Strategy for Success
 
Agile performance testing
Agile performance testingAgile performance testing
Agile performance testing
 
QA Process Overview for Firefox OS 2014
QA Process Overview for Firefox OS 2014QA Process Overview for Firefox OS 2014
QA Process Overview for Firefox OS 2014
 
Shorten Business Life Cycle Using DevOps
Shorten Business Life Cycle Using DevOpsShorten Business Life Cycle Using DevOps
Shorten Business Life Cycle Using DevOps
 
Test Automation is for Everyone
Test Automation is for EveryoneTest Automation is for Everyone
Test Automation is for Everyone
 
Agile KPIs
Agile KPIsAgile KPIs
Agile KPIs
 
Deliver Fast, Break Nothing Via Effective Building Developer and Tester Colla...
Deliver Fast, Break Nothing Via Effective Building Developer and Tester Colla...Deliver Fast, Break Nothing Via Effective Building Developer and Tester Colla...
Deliver Fast, Break Nothing Via Effective Building Developer and Tester Colla...
 
Shift left as first transformation step into Quality Assurance
Shift left as first transformation step into Quality AssuranceShift left as first transformation step into Quality Assurance
Shift left as first transformation step into Quality Assurance
 
Small is Beautiful- Fully Automate your Test Case Design
Small is Beautiful- Fully Automate your Test Case DesignSmall is Beautiful- Fully Automate your Test Case Design
Small is Beautiful- Fully Automate your Test Case Design
 
Addressing Performance Testing Challenges in Agile- Impetus Webinar
Addressing Performance Testing Challenges in Agile- Impetus WebinarAddressing Performance Testing Challenges in Agile- Impetus Webinar
Addressing Performance Testing Challenges in Agile- Impetus Webinar
 
Agile Aspects of Performance Testing
Agile Aspects of Performance TestingAgile Aspects of Performance Testing
Agile Aspects of Performance Testing
 
Continuous Testing of Cloud Applications
Continuous Testing of Cloud ApplicationsContinuous Testing of Cloud Applications
Continuous Testing of Cloud Applications
 
MESUT DURUKAL «4 Pillars of Successful Agile Test Automation» Online QADay 2021
MESUT DURUKAL «4 Pillars of Successful Agile Test Automation» Online QADay 2021MESUT DURUKAL «4 Pillars of Successful Agile Test Automation» Online QADay 2021
MESUT DURUKAL «4 Pillars of Successful Agile Test Automation» Online QADay 2021
 
Managing software projects with Team Foundation Server 2013 in Agile Scrum
Managing software projects with Team Foundation Server 2013 in Agile ScrumManaging software projects with Team Foundation Server 2013 in Agile Scrum
Managing software projects with Team Foundation Server 2013 in Agile Scrum
 
An Agile Testing Dashboard: Metrics that Matter
An Agile Testing Dashboard: Metrics that MatterAn Agile Testing Dashboard: Metrics that Matter
An Agile Testing Dashboard: Metrics that Matter
 

Semelhante a Turn by Turn: A Practical Guide To Test Management

Semelhante a Turn by Turn: A Practical Guide To Test Management (20)

Quality Not Compromise; Best Practices for Automated Testing
Quality Not Compromise; Best Practices for Automated TestingQuality Not Compromise; Best Practices for Automated Testing
Quality Not Compromise; Best Practices for Automated Testing
 
Testing in Agile Development
Testing in Agile DevelopmentTesting in Agile Development
Testing in Agile Development
 
7 steps to Software test automation success
7 steps to Software test automation success7 steps to Software test automation success
7 steps to Software test automation success
 
Testing Essentials for the Age of Agile
Testing Essentials for the Age of AgileTesting Essentials for the Age of Agile
Testing Essentials for the Age of Agile
 
AgileTesting_Ver1.0
AgileTesting_Ver1.0AgileTesting_Ver1.0
AgileTesting_Ver1.0
 
RPALM for SAP S/4 Journey
RPALM for SAP S/4 JourneyRPALM for SAP S/4 Journey
RPALM for SAP S/4 Journey
 
Software Testing Process, Testing Automation and Software Testing Trends
Software Testing Process, Testing Automation and Software Testing TrendsSoftware Testing Process, Testing Automation and Software Testing Trends
Software Testing Process, Testing Automation and Software Testing Trends
 
Linking Testing Requirements to Test Cases to Save Time
Linking Testing Requirements to Test Cases to Save TimeLinking Testing Requirements to Test Cases to Save Time
Linking Testing Requirements to Test Cases to Save Time
 
Linking Requirements to Test Cases to Save Time & Frustration
Linking Requirements to Test Cases to Save Time & Frustration Linking Requirements to Test Cases to Save Time & Frustration
Linking Requirements to Test Cases to Save Time & Frustration
 
Shift Left Quality Assurance: How to do it. Why it matters.
Shift Left Quality Assurance: How to do it. Why it matters.Shift Left Quality Assurance: How to do it. Why it matters.
Shift Left Quality Assurance: How to do it. Why it matters.
 
Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".
Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".
Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".
 
Continuous testing in agile projects 2015
Continuous testing in agile projects 2015Continuous testing in agile projects 2015
Continuous testing in agile projects 2015
 
qLabs Test Automation
qLabs Test AutomationqLabs Test Automation
qLabs Test Automation
 
Agile Model & Methodology
Agile Model & MethodologyAgile Model & Methodology
Agile Model & Methodology
 
ALM-PLM Integration with Business Process Management
ALM-PLM Integration with Business Process ManagementALM-PLM Integration with Business Process Management
ALM-PLM Integration with Business Process Management
 
ALM-PLM Integration with BPM
ALM-PLM Integration with BPMALM-PLM Integration with BPM
ALM-PLM Integration with BPM
 
Does dev ops need continuous testing devops days des moines 2018 v1
Does dev ops need continuous testing devops days des moines 2018 v1Does dev ops need continuous testing devops days des moines 2018 v1
Does dev ops need continuous testing devops days des moines 2018 v1
 
Software Testing Process & Trend
Software Testing Process & TrendSoftware Testing Process & Trend
Software Testing Process & Trend
 
QA Role in Agile Teams
QA Role in Agile Teams QA Role in Agile Teams
QA Role in Agile Teams
 
Agile Methodology - Software Engineering
Agile Methodology - Software EngineeringAgile Methodology - Software Engineering
Agile Methodology - Software Engineering
 

Mais de Perforce

Mais de Perforce (20)

How to Organize Game Developers With Different Planning Needs
How to Organize Game Developers With Different Planning NeedsHow to Organize Game Developers With Different Planning Needs
How to Organize Game Developers With Different Planning Needs
 
Regulatory Traceability: How to Maintain Compliance, Quality, and Cost Effic...
Regulatory Traceability:  How to Maintain Compliance, Quality, and Cost Effic...Regulatory Traceability:  How to Maintain Compliance, Quality, and Cost Effic...
Regulatory Traceability: How to Maintain Compliance, Quality, and Cost Effic...
 
Efficient Security Development and Testing Using Dynamic and Static Code Anal...
Efficient Security Development and Testing Using Dynamic and Static Code Anal...Efficient Security Development and Testing Using Dynamic and Static Code Anal...
Efficient Security Development and Testing Using Dynamic and Static Code Anal...
 
Understanding Compliant Workflow Enforcement SOPs
Understanding Compliant Workflow Enforcement SOPsUnderstanding Compliant Workflow Enforcement SOPs
Understanding Compliant Workflow Enforcement SOPs
 
Branching Out: How To Automate Your Development Process
Branching Out: How To Automate Your Development ProcessBranching Out: How To Automate Your Development Process
Branching Out: How To Automate Your Development Process
 
How to Do Code Reviews at Massive Scale For DevOps
How to Do Code Reviews at Massive Scale For DevOpsHow to Do Code Reviews at Massive Scale For DevOps
How to Do Code Reviews at Massive Scale For DevOps
 
How to Spark Joy In Your Product Backlog
How to Spark Joy In Your Product Backlog How to Spark Joy In Your Product Backlog
How to Spark Joy In Your Product Backlog
 
Going Remote: Build Up Your Game Dev Team
Going Remote: Build Up Your Game Dev Team Going Remote: Build Up Your Game Dev Team
Going Remote: Build Up Your Game Dev Team
 
Shift to Remote: How to Manage Your New Workflow
Shift to Remote: How to Manage Your New WorkflowShift to Remote: How to Manage Your New Workflow
Shift to Remote: How to Manage Your New Workflow
 
Hybrid Development Methodology in a Regulated World
Hybrid Development Methodology in a Regulated WorldHybrid Development Methodology in a Regulated World
Hybrid Development Methodology in a Regulated World
 
Better, Faster, Easier: How to Make Git Really Work in the Enterprise
Better, Faster, Easier: How to Make Git Really Work in the EnterpriseBetter, Faster, Easier: How to Make Git Really Work in the Enterprise
Better, Faster, Easier: How to Make Git Really Work in the Enterprise
 
Easier Requirements Management Using Diagrams In Helix ALM
Easier Requirements Management Using Diagrams In Helix ALMEasier Requirements Management Using Diagrams In Helix ALM
Easier Requirements Management Using Diagrams In Helix ALM
 
How To Master Your Mega Backlog
How To Master Your Mega Backlog How To Master Your Mega Backlog
How To Master Your Mega Backlog
 
Achieving Software Safety, Security, and Reliability Part 3: What Does the Fu...
Achieving Software Safety, Security, and Reliability Part 3: What Does the Fu...Achieving Software Safety, Security, and Reliability Part 3: What Does the Fu...
Achieving Software Safety, Security, and Reliability Part 3: What Does the Fu...
 
How to Scale With Helix Core and Microsoft Azure
How to Scale With Helix Core and Microsoft Azure How to Scale With Helix Core and Microsoft Azure
How to Scale With Helix Core and Microsoft Azure
 
Achieving Software Safety, Security, and Reliability Part 2
Achieving Software Safety, Security, and Reliability Part 2Achieving Software Safety, Security, and Reliability Part 2
Achieving Software Safety, Security, and Reliability Part 2
 
Should You Break Up With Your Monolith?
Should You Break Up With Your Monolith?Should You Break Up With Your Monolith?
Should You Break Up With Your Monolith?
 
Achieving Software Safety, Security, and Reliability Part 1: Common Industry ...
Achieving Software Safety, Security, and Reliability Part 1: Common Industry ...Achieving Software Safety, Security, and Reliability Part 1: Common Industry ...
Achieving Software Safety, Security, and Reliability Part 1: Common Industry ...
 
What's New in Helix ALM 2019.4
What's New in Helix ALM 2019.4What's New in Helix ALM 2019.4
What's New in Helix ALM 2019.4
 
Free Yourself From the MS Office Prison
Free Yourself From the MS Office Prison Free Yourself From the MS Office Prison
Free Yourself From the MS Office Prison
 

Último

+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
Health
 

Último (20)

Chinsurah Escorts ☎️8617697112 Starting From 5K to 15K High Profile Escorts ...
Chinsurah Escorts ☎️8617697112  Starting From 5K to 15K High Profile Escorts ...Chinsurah Escorts ☎️8617697112  Starting From 5K to 15K High Profile Escorts ...
Chinsurah Escorts ☎️8617697112 Starting From 5K to 15K High Profile Escorts ...
 
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected WorkerHow To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
 
BUS PASS MANGEMENT SYSTEM USING PHP.pptx
BUS PASS MANGEMENT SYSTEM USING PHP.pptxBUS PASS MANGEMENT SYSTEM USING PHP.pptx
BUS PASS MANGEMENT SYSTEM USING PHP.pptx
 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.com
 
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
 
Sector 18, Noida Call girls :8448380779 Model Escorts | 100% verified
Sector 18, Noida Call girls :8448380779 Model Escorts | 100% verifiedSector 18, Noida Call girls :8448380779 Model Escorts | 100% verified
Sector 18, Noida Call girls :8448380779 Model Escorts | 100% verified
 
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
 
Define the academic and professional writing..pdf
Define the academic and professional writing..pdfDefine the academic and professional writing..pdf
Define the academic and professional writing..pdf
 
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
 
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
 
%in ivory park+277-882-255-28 abortion pills for sale in ivory park
%in ivory park+277-882-255-28 abortion pills for sale in ivory park %in ivory park+277-882-255-28 abortion pills for sale in ivory park
%in ivory park+277-882-255-28 abortion pills for sale in ivory park
 
Unlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language ModelsUnlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language Models
 
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
 
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
 
Microsoft AI Transformation Partner Playbook.pdf
Microsoft AI Transformation Partner Playbook.pdfMicrosoft AI Transformation Partner Playbook.pdf
Microsoft AI Transformation Partner Playbook.pdf
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
 
%in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park %in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park
 
Exploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdfExploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdf
 

Turn by Turn: A Practical Guide To Test Management

  • 1. Turn by Turn: A Practical Guide to Test Management NICO KRÜGER, CTO, HELIX ALM — PERFORCE SOFTWARE
  • 2. 2 | A Practical Guide to Test Management in Helix ALM perforce.com Presenter Nico Krüger Chief Technical Officer, Helix ALM Perforce Software
  • 3. 3 | A Practical Guide to Test Management in Helix ALM perforce.com What We’ll Cover 1 2 3 What shift left and shift right testing cover. How to track testing progress, handle bugs, and manage re-testing efforts. Why Helix ALM is the best way to ensure complete test coverage.
  • 4. 4 | A Practical Guide to Test Management in Helix ALM perforce.com What Shift Left and Shift Right Testing Cover Shift Left Shift Right of New Code of Every Build of Every Deployment In Production
  • 5. 5 | A Practical Guide to Test Management in Helix ALM perforce.com Why Shift Left? • Deliver more software at a faster rate. • Shift left: start testing earlier in the process. • Focus on problem prevention. AttentiontoQuality Plan and Design Develop and Build Test Deploy and Release Monitor and Analyze Shift Left Model Traditional Quality Model
  • 6. 6 | A Practical Guide to Test Management in Helix ALM perforce.com Why Shift Right? • Building quality in itself is not enough in today’s competitive market. • Using continuous feedback from users is equally important in the testing process. • Ensuring that what was created works in practice for real users — not just matches the design or user needs.
  • 7. 7 | A Practical Guide to Test Management in Helix ALM perforce.com Benefits of Shifting Left and Shifting Right • Find bugs earlier. • Save time later on. • Improve test coverage and quality. • Foster teamwork between developers and testers. • Improve software delivery cycles. • Reduce costs over time. • Reduce technical debt. Illustration from “Continuous testing in DevOps” (Dan Ashby)
  • 8. 8 | A Practical Guide to Test Management in Helix ALM perforce.com Things to Think About Change How do you handle design changes based on customer feedback? Visibility Can you capture all these testing results effectively? And prioritize and act on them? Risk How can this help you reduce risk and lower time to market?
  • 9. A Practical Guide to Test Management with Helix ALM Track testing progress, handle bugs, and manage re-testing efforts
  • 10. 10 | A Practical Guide to Test Management in Helix ALM perforce.com Common Test Activities For Each Release Risk analysis Effort estimates Test strategy Project plan Requirements review Test design Test data creation Test automation Automated testing Manual test execution Performance testing Test results Defect reports Metrics analysis Actuals vs. planned Planning Preparation Execution Outcome
  • 11. 11 | A Practical Guide to Test Management in Helix ALM perforce.com Planning Activities • What are we building? • High risk items • Release and sprint breakdown • Test plan and strategy Requirement / user story Test cases, test suites, estimations Commit work to sprint / release Classification, risk score
  • 12. 12 | A Practical Guide to Test Management in Helix ALM perforce.com 1. What Are We Building? • Requirement / user story in Helix ALM:
  • 13. 13 | A Practical Guide to Test Management in Helix ALM perforce.com 2. High Risk Items • Classification and risk score in Helix ALM:
  • 14. 14 | A Practical Guide to Test Management in Helix ALM perforce.com 3. Release and Sprint Breakdown • Commit work to sprint / release in Helix ALM:
  • 15. 15 | A Practical Guide to Test Management in Helix ALM perforce.com 4. Test Plan and Strategy • Test cases and test suites in Helix ALM:
  • 16. 16 | A Practical Guide to Test Management in Helix ALM perforce.com Preparation Activities • Requirements reviewed • Test coverage • Test design • Manual vs. automated Review process, approvals Traceability Test cases Manual vs. automated inputs
  • 17. 17 | A Practical Guide to Test Management in Helix ALM perforce.com 1. Requirements Reviewed • Review process and approvals in Helix ALM:
  • 18. 18 | A Practical Guide to Test Management in Helix ALM perforce.com 2. Test Coverage • Traceability in Helix ALM:
  • 19. 19 | A Practical Guide to Test Management in Helix ALM perforce.com 3. Test Design • Manual test cases in Helix ALM:
  • 20. 20 | A Practical Guide to Test Management in Helix ALM perforce.com 4. Manual vs. Automated • Capture results in Helix ALM: REST API < /> Helix ALM Server Define and manage test cases in Helix ALM. Use {ANY} test automation framework to create and execute tests in. 1. Create automation scripts. 2. Create test case in Helix ALM for each automated test. 3. Use Helix ALM’s REST API to generate test runs and record test results. Endpoint: …/helix- alm/api/v0/testruns/generate/ POST: { testCaseIDs : [50,89], events : [] }
  • 21. 21 | A Practical Guide to Test Management in Helix ALM perforce.com Execution Activities • Execution • Results Pass, fail actions Track results
  • 22. 22 | A Practical Guide to Test Management in Helix ALM perforce.com 1. Execution • Pass or fail actions in Helix ALM:
  • 23. 23 | A Practical Guide to Test Management in Helix ALM perforce.com 2. Execution • Track results in Helix ALM:
  • 24. 24 | A Practical Guide to Test Management in Helix ALM perforce.com Outcome Activities • Production monitoring and feedback • How to track and manage results and feedback • Incorporate into future testing Capture feedback Capture feedback Improve test coverage
  • 25. 25 | A Practical Guide to Test Management in Helix ALM perforce.com • Capture feedback in Helix ALM: 1. Production Monitoring and Feedback
  • 26. 26 | A Practical Guide to Test Management in Helix ALM perforce.com 2. How to Track and Manage Results and Feedback • Capture feedback in Helix ALM: SoloSubmit REST API Web or Desktop Client
  • 27. 27 | A Practical Guide to Test Management in Helix ALM perforce.com 3. Incorporate into Future Testing • Improve test coverage in Helix ALM:
  • 28. The Results End-to-end traceability Higher quality Faster time to deployment
  • 29. Q & A