SlideShare a Scribd company logo
1 of 24
Agile Testing for Large Projects
A practical Exmaple
Liang Gao
∗ 以色列空军信息管理系统
∗ Mission Critical
∗ 整个项目全部采用 XP 开发
概况
∗ 以色列空军信息管理系统
∗ 负责以色列空军日常运作与信息安全
∗ 得到党和国家领导人的多方关注
∗ Mission Critical
∗ 整个项目全部采用 XP 开发
概况
∗ No “Deliver to QA“
∗ No “Meeting the QA criteria for delivery”
∗ No ”Bug Priority”
∗ Short release
∗ Fully test in every two weeks
∗ Developer perform all regression at every cycle
∗ All Bugs fixed in each cycle
∗ “Planning Game” practice
∗ XP’s “Whole team” and “Site-together” practice
Conforming To XP
∗ Detailed documentation required
∗ Use professional testers for full acceptance test (User
test)
∗ TDD (test driven development)
∗ 1st line of code is a test case
∗ Test automation at the every step of the development
∗ Unit test
∗ Real user simulation
Variation To XP
∗ Everyone tests
∗ Developer
∗ Business analysis
∗ Customer
∗ Product size = test size
∗ Untested work = no work
Test Design and Execution
∗ Eliminate dedicate tester bottleneck
∗ Increase developer test awareness  more corner
case thinking  better quality code
∗ coding for testability in nature
Everyone tests
∗ Overall development progress = testing progress
∗ Test size is more correlated with complexity than line
of code
∗ Strong signal to the whole team: only features after a
fully regression at each iteration care counted as
delivered product size.
Product size = test size
∗ In all channels under all conditions
∗ In each iteration review, untested work = failure
∗ After 2 releases
∗ 90% of developer think acceptance and system test is
important
∗ 33% of developer are very interested or interested in
taking a lead role in acceptance test
∗ 60% of developers are interested in leading system test
Untested work = no work
∗ Ease testing bottleneck
Code less, Test more
∗ Isolation claims
∗ Testers should be separated from developer
∗ Only test on specifications, not something “unofficially
told” by developer
∗ Testers need not to be affected by developer words
∗ Interaction
∗ Shall we do more interaction between developers and
testers?
Interaction or Isolation
∗ Isolated testers only found minor defects on this
project (developers did more testing already)
∗ 2 minor bugs in 2 weeks
Interaction or Isolation - finding
∗ Integrate testing and coding
∗ Testing and coding time are usually equal
∗ Example : 5 hours specification, 10 hours coding, 10 hours
testing
Active Planning
∗ Regression as global effort – requires separate planning
∗ Run on each iteration’s last day
∗ Workload divided among each team members
Active Planning
∗ Allocate bug-fix time globally
Active Planning
∗ Team centered approach
∗ Fix Defects ASAP
Defects Management
∗ Anyone in team can open
∗ Anyone in team can close
∗ Anyone in team can assign
∗ Sit-together reduce junk and duplicate defects
Team centered approach
∗ Average time to fix a defect is about 1 hour
∗ Remain constant even project grows with complexity
∗ No need to prioritize bugs!
Fix Defects ASAP
Fix Defects ASAP
Agile Practice Cost of Curve
Average Bug Fix Time Per-
iteration
平均 Bug 寿命
∗ A successful project
∗ Full regression and testing at each iteration
∗ All bugs are fixed
Summary
Agile testing for large projects

More Related Content

What's hot

Agile QA Automation process
Agile QA Automation processAgile QA Automation process
Agile QA Automation processTanvi Nanda
 
Keynote AST 2016
Keynote AST 2016Keynote AST 2016
Keynote AST 2016Kim Herzig
 
Development and test infrastructure
Development and test infrastructureDevelopment and test infrastructure
Development and test infrastructureJun Li
 
Testing strategy for agile projects updated
Testing strategy for agile projects updatedTesting strategy for agile projects updated
Testing strategy for agile projects updatedTharinda Liyanage
 
Performance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
Performance Metrics for your Delivery Pipeline - Wolfgang GottesheimPerformance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
Performance Metrics for your Delivery Pipeline - Wolfgang GottesheimJAXLondon2014
 
Quality Assurance - The Other Side of the Fence
Quality Assurance - The Other Side of the FenceQuality Assurance - The Other Side of the Fence
Quality Assurance - The Other Side of the FenceTom Oketch
 
Unit tests 101
Unit tests 101Unit tests 101
Unit tests 101Guy Yogev
 
Software engineering
Software engineeringSoftware engineering
Software engineeringbartlowe
 
How to push a react js application in production and sleep better
How to push a react js application in production and sleep betterHow to push a react js application in production and sleep better
How to push a react js application in production and sleep betterEmanuele Rampichini
 
Continuous Deployment Pipeline for Systems at Cascadia IT Conference - 2017-0...
Continuous Deployment Pipeline for Systems at Cascadia IT Conference - 2017-0...Continuous Deployment Pipeline for Systems at Cascadia IT Conference - 2017-0...
Continuous Deployment Pipeline for Systems at Cascadia IT Conference - 2017-0...garrett honeycutt
 
Using Continuous Integration To Ensure Project Health New
Using Continuous Integration To Ensure Project Health NewUsing Continuous Integration To Ensure Project Health New
Using Continuous Integration To Ensure Project Health Newbartlowe
 
8th Alg - April4
8th Alg - April48th Alg - April4
8th Alg - April4jdurst65
 
Deterministic releases and how to get there with Nigel Babu
Deterministic releases and how to get there with Nigel BabuDeterministic releases and how to get there with Nigel Babu
Deterministic releases and how to get there with Nigel BabuGluster.org
 
QA Process Overview for Firefox OS 2014
QA Process Overview for Firefox OS 2014QA Process Overview for Firefox OS 2014
QA Process Overview for Firefox OS 2014Anthony Chung
 

What's hot (19)

Agile Evolution
Agile EvolutionAgile Evolution
Agile Evolution
 
ProductSavvy - Scrum and QA
ProductSavvy - Scrum and QAProductSavvy - Scrum and QA
ProductSavvy - Scrum and QA
 
Agile QA Automation process
Agile QA Automation processAgile QA Automation process
Agile QA Automation process
 
Keynote AST 2016
Keynote AST 2016Keynote AST 2016
Keynote AST 2016
 
Resource1 spm
Resource1 spmResource1 spm
Resource1 spm
 
The best day for qa
The best day for qaThe best day for qa
The best day for qa
 
Development and test infrastructure
Development and test infrastructureDevelopment and test infrastructure
Development and test infrastructure
 
Testing strategy for agile projects updated
Testing strategy for agile projects updatedTesting strategy for agile projects updated
Testing strategy for agile projects updated
 
Performance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
Performance Metrics for your Delivery Pipeline - Wolfgang GottesheimPerformance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
Performance Metrics for your Delivery Pipeline - Wolfgang Gottesheim
 
Quality Assurance - The Other Side of the Fence
Quality Assurance - The Other Side of the FenceQuality Assurance - The Other Side of the Fence
Quality Assurance - The Other Side of the Fence
 
Unit tests 101
Unit tests 101Unit tests 101
Unit tests 101
 
Software engineering
Software engineeringSoftware engineering
Software engineering
 
Ubiquitous Testing
Ubiquitous TestingUbiquitous Testing
Ubiquitous Testing
 
How to push a react js application in production and sleep better
How to push a react js application in production and sleep betterHow to push a react js application in production and sleep better
How to push a react js application in production and sleep better
 
Continuous Deployment Pipeline for Systems at Cascadia IT Conference - 2017-0...
Continuous Deployment Pipeline for Systems at Cascadia IT Conference - 2017-0...Continuous Deployment Pipeline for Systems at Cascadia IT Conference - 2017-0...
Continuous Deployment Pipeline for Systems at Cascadia IT Conference - 2017-0...
 
Using Continuous Integration To Ensure Project Health New
Using Continuous Integration To Ensure Project Health NewUsing Continuous Integration To Ensure Project Health New
Using Continuous Integration To Ensure Project Health New
 
8th Alg - April4
8th Alg - April48th Alg - April4
8th Alg - April4
 
Deterministic releases and how to get there with Nigel Babu
Deterministic releases and how to get there with Nigel BabuDeterministic releases and how to get there with Nigel Babu
Deterministic releases and how to get there with Nigel Babu
 
QA Process Overview for Firefox OS 2014
QA Process Overview for Firefox OS 2014QA Process Overview for Firefox OS 2014
QA Process Overview for Firefox OS 2014
 

Viewers also liked

Agile testing for large projects
Agile testing for large projectsAgile testing for large projects
Agile testing for large projectsgaoliang641
 
Make good use of explortary testing
Make good use of explortary testingMake good use of explortary testing
Make good use of explortary testinggaoliang641
 
Backward thinking design qa system for quality goals
Backward thinking   design qa system for quality goalsBackward thinking   design qa system for quality goals
Backward thinking design qa system for quality goalsgaoliang641
 
How to become a testing expert
How to become a testing expertHow to become a testing expert
How to become a testing expertgaoliang641
 
Bug best practice
Bug best practiceBug best practice
Bug best practicegaoliang641
 
Lessons learned on localization testing
Lessons learned on localization testingLessons learned on localization testing
Lessons learned on localization testinggaoliang641
 
Automation framework design and implementation
Automation framework design and implementationAutomation framework design and implementation
Automation framework design and implementationgaoliang641
 
Protocol Security Testing best practice
Protocol Security Testing best practiceProtocol Security Testing best practice
Protocol Security Testing best practicegaoliang641
 
Tester developer interaction
Tester developer interactionTester developer interaction
Tester developer interactiongaoliang641
 
Lessons learned on software testing automation
Lessons learned on software testing automationLessons learned on software testing automation
Lessons learned on software testing automationgaoliang641
 
Why we didn't catch that application bugs
Why we didn't catch that   application bugsWhy we didn't catch that   application bugs
Why we didn't catch that application bugsgaoliang641
 
The art of system and solution testing
The art of system and solution testingThe art of system and solution testing
The art of system and solution testinggaoliang641
 
Understand release engineering
Understand release engineeringUnderstand release engineering
Understand release engineeringgaoliang641
 
Tester performance evaluation
Tester performance evaluationTester performance evaluation
Tester performance evaluationgaoliang641
 
Understand regression testing
Understand regression testingUnderstand regression testing
Understand regression testinggaoliang641
 
Project management for qa manager
Project management for qa managerProject management for qa manager
Project management for qa managergaoliang641
 
Tester career path
Tester career pathTester career path
Tester career pathgaoliang641
 

Viewers also liked (19)

Agile testing for large projects
Agile testing for large projectsAgile testing for large projects
Agile testing for large projects
 
Make good use of explortary testing
Make good use of explortary testingMake good use of explortary testing
Make good use of explortary testing
 
Backward thinking design qa system for quality goals
Backward thinking   design qa system for quality goalsBackward thinking   design qa system for quality goals
Backward thinking design qa system for quality goals
 
How to become a testing expert
How to become a testing expertHow to become a testing expert
How to become a testing expert
 
Char Davies
Char DaviesChar Davies
Char Davies
 
Bug best practice
Bug best practiceBug best practice
Bug best practice
 
Lessons learned on localization testing
Lessons learned on localization testingLessons learned on localization testing
Lessons learned on localization testing
 
Retratos
RetratosRetratos
Retratos
 
Automation framework design and implementation
Automation framework design and implementationAutomation framework design and implementation
Automation framework design and implementation
 
Protocol Security Testing best practice
Protocol Security Testing best practiceProtocol Security Testing best practice
Protocol Security Testing best practice
 
Tester developer interaction
Tester developer interactionTester developer interaction
Tester developer interaction
 
Lessons learned on software testing automation
Lessons learned on software testing automationLessons learned on software testing automation
Lessons learned on software testing automation
 
Why we didn't catch that application bugs
Why we didn't catch that   application bugsWhy we didn't catch that   application bugs
Why we didn't catch that application bugs
 
The art of system and solution testing
The art of system and solution testingThe art of system and solution testing
The art of system and solution testing
 
Understand release engineering
Understand release engineeringUnderstand release engineering
Understand release engineering
 
Tester performance evaluation
Tester performance evaluationTester performance evaluation
Tester performance evaluation
 
Understand regression testing
Understand regression testingUnderstand regression testing
Understand regression testing
 
Project management for qa manager
Project management for qa managerProject management for qa manager
Project management for qa manager
 
Tester career path
Tester career pathTester career path
Tester career path
 

Similar to Agile testing for large projects

Continous testing for grails
Continous testing for grailsContinous testing for grails
Continous testing for grailswinkler1
 
A la découverte des google/test (aka gtest)
A la découverte des google/test (aka gtest)A la découverte des google/test (aka gtest)
A la découverte des google/test (aka gtest)Thierry Gayet
 
Test-Driven-Development.pptx
Test-Driven-Development.pptxTest-Driven-Development.pptx
Test-Driven-Development.pptxdheeraj438799
 
Automation testing IBM RFT - Rational Functional Tester
Automation testing IBM RFT - Rational Functional TesterAutomation testing IBM RFT - Rational Functional Tester
Automation testing IBM RFT - Rational Functional TesterVijayChowthri Nagaprakasham
 
STX Next - Scrum Development Process Overview
STX Next - Scrum Development Process OverviewSTX Next - Scrum Development Process Overview
STX Next - Scrum Development Process OverviewSTX Next
 
Ralph Jocham, effective agile - Scaled Scrum at Swiss Postal Services | Agile...
Ralph Jocham, effective agile - Scaled Scrum at Swiss Postal Services | Agile...Ralph Jocham, effective agile - Scaled Scrum at Swiss Postal Services | Agile...
Ralph Jocham, effective agile - Scaled Scrum at Swiss Postal Services | Agile...Agile Greece
 
DevOps presentation
DevOps presentationDevOps presentation
DevOps presentationAxsh Co. LTD
 
Into The Box 2018 | Assert control over your legacy applications
Into The Box 2018 | Assert control over your legacy applicationsInto The Box 2018 | Assert control over your legacy applications
Into The Box 2018 | Assert control over your legacy applicationsOrtus Solutions, Corp
 
Waterfallacies V1 1
Waterfallacies V1 1Waterfallacies V1 1
Waterfallacies V1 1Jorge Boria
 
STAMP at Open Cloud Forum by OW2 2017
STAMP at Open Cloud Forum by OW2 2017STAMP at Open Cloud Forum by OW2 2017
STAMP at Open Cloud Forum by OW2 2017STAMP Project
 
DevOps - Boldly Go for Distro
DevOps - Boldly Go for DistroDevOps - Boldly Go for Distro
DevOps - Boldly Go for DistroPaul Boos
 
[Webinar] Qt Test-Driven Development Using Google Test and Google Mock
[Webinar] Qt Test-Driven Development Using Google Test and Google Mock[Webinar] Qt Test-Driven Development Using Google Test and Google Mock
[Webinar] Qt Test-Driven Development Using Google Test and Google MockICS
 

Similar to Agile testing for large projects (20)

Continous testing for grails
Continous testing for grailsContinous testing for grails
Continous testing for grails
 
A la découverte des google/test (aka gtest)
A la découverte des google/test (aka gtest)A la découverte des google/test (aka gtest)
A la découverte des google/test (aka gtest)
 
Extreme programming (xp)
Extreme programming (xp)Extreme programming (xp)
Extreme programming (xp)
 
Unit testing (eng)
Unit testing (eng)Unit testing (eng)
Unit testing (eng)
 
Resource1
Resource1Resource1
Resource1
 
Resource1 spm
Resource1 spmResource1 spm
Resource1 spm
 
Test-Driven-Development.pptx
Test-Driven-Development.pptxTest-Driven-Development.pptx
Test-Driven-Development.pptx
 
Automation testing IBM RFT - Rational Functional Tester
Automation testing IBM RFT - Rational Functional TesterAutomation testing IBM RFT - Rational Functional Tester
Automation testing IBM RFT - Rational Functional Tester
 
Automation testing
Automation testingAutomation testing
Automation testing
 
STX Next - Scrum Development Process Overview
STX Next - Scrum Development Process OverviewSTX Next - Scrum Development Process Overview
STX Next - Scrum Development Process Overview
 
Ralph Jocham, effective agile - Scaled Scrum at Swiss Postal Services | Agile...
Ralph Jocham, effective agile - Scaled Scrum at Swiss Postal Services | Agile...Ralph Jocham, effective agile - Scaled Scrum at Swiss Postal Services | Agile...
Ralph Jocham, effective agile - Scaled Scrum at Swiss Postal Services | Agile...
 
Agile
AgileAgile
Agile
 
DevOps presentation
DevOps presentationDevOps presentation
DevOps presentation
 
Tdd
TddTdd
Tdd
 
Into The Box 2018 | Assert control over your legacy applications
Into The Box 2018 | Assert control over your legacy applicationsInto The Box 2018 | Assert control over your legacy applications
Into The Box 2018 | Assert control over your legacy applications
 
What is xp
What is xpWhat is xp
What is xp
 
Waterfallacies V1 1
Waterfallacies V1 1Waterfallacies V1 1
Waterfallacies V1 1
 
STAMP at Open Cloud Forum by OW2 2017
STAMP at Open Cloud Forum by OW2 2017STAMP at Open Cloud Forum by OW2 2017
STAMP at Open Cloud Forum by OW2 2017
 
DevOps - Boldly Go for Distro
DevOps - Boldly Go for DistroDevOps - Boldly Go for Distro
DevOps - Boldly Go for Distro
 
[Webinar] Qt Test-Driven Development Using Google Test and Google Mock
[Webinar] Qt Test-Driven Development Using Google Test and Google Mock[Webinar] Qt Test-Driven Development Using Google Test and Google Mock
[Webinar] Qt Test-Driven Development Using Google Test and Google Mock
 

Recently uploaded

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businesspanagenda
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024The Digital Insurer
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdflior mazor
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?Igalia
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesrafiqahmad00786416
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsNanddeep Nachan
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelNavi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelDeepika Singh
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...Zilliz
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 

Recently uploaded (20)

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelNavi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 

Agile testing for large projects

  • 1. Agile Testing for Large Projects A practical Exmaple Liang Gao
  • 2. ∗ 以色列空军信息管理系统 ∗ Mission Critical ∗ 整个项目全部采用 XP 开发 概况
  • 3. ∗ 以色列空军信息管理系统 ∗ 负责以色列空军日常运作与信息安全 ∗ 得到党和国家领导人的多方关注 ∗ Mission Critical ∗ 整个项目全部采用 XP 开发 概况
  • 4. ∗ No “Deliver to QA“ ∗ No “Meeting the QA criteria for delivery” ∗ No ”Bug Priority” ∗ Short release ∗ Fully test in every two weeks ∗ Developer perform all regression at every cycle ∗ All Bugs fixed in each cycle ∗ “Planning Game” practice ∗ XP’s “Whole team” and “Site-together” practice Conforming To XP
  • 5. ∗ Detailed documentation required ∗ Use professional testers for full acceptance test (User test) ∗ TDD (test driven development) ∗ 1st line of code is a test case ∗ Test automation at the every step of the development ∗ Unit test ∗ Real user simulation Variation To XP
  • 6. ∗ Everyone tests ∗ Developer ∗ Business analysis ∗ Customer ∗ Product size = test size ∗ Untested work = no work Test Design and Execution
  • 7. ∗ Eliminate dedicate tester bottleneck ∗ Increase developer test awareness  more corner case thinking  better quality code ∗ coding for testability in nature Everyone tests
  • 8. ∗ Overall development progress = testing progress ∗ Test size is more correlated with complexity than line of code ∗ Strong signal to the whole team: only features after a fully regression at each iteration care counted as delivered product size. Product size = test size
  • 9. ∗ In all channels under all conditions ∗ In each iteration review, untested work = failure ∗ After 2 releases ∗ 90% of developer think acceptance and system test is important ∗ 33% of developer are very interested or interested in taking a lead role in acceptance test ∗ 60% of developers are interested in leading system test Untested work = no work
  • 10. ∗ Ease testing bottleneck Code less, Test more
  • 11. ∗ Isolation claims ∗ Testers should be separated from developer ∗ Only test on specifications, not something “unofficially told” by developer ∗ Testers need not to be affected by developer words ∗ Interaction ∗ Shall we do more interaction between developers and testers? Interaction or Isolation
  • 12. ∗ Isolated testers only found minor defects on this project (developers did more testing already) ∗ 2 minor bugs in 2 weeks Interaction or Isolation - finding
  • 13. ∗ Integrate testing and coding ∗ Testing and coding time are usually equal ∗ Example : 5 hours specification, 10 hours coding, 10 hours testing Active Planning
  • 14. ∗ Regression as global effort – requires separate planning ∗ Run on each iteration’s last day ∗ Workload divided among each team members Active Planning
  • 15. ∗ Allocate bug-fix time globally Active Planning
  • 16. ∗ Team centered approach ∗ Fix Defects ASAP Defects Management
  • 17. ∗ Anyone in team can open ∗ Anyone in team can close ∗ Anyone in team can assign ∗ Sit-together reduce junk and duplicate defects Team centered approach
  • 18. ∗ Average time to fix a defect is about 1 hour ∗ Remain constant even project grows with complexity ∗ No need to prioritize bugs! Fix Defects ASAP
  • 21. Average Bug Fix Time Per- iteration
  • 23. ∗ A successful project ∗ Full regression and testing at each iteration ∗ All bugs are fixed Summary