SlideShare a Scribd company logo
1 of 10
Download to read offline
The Future of Testing

                                      Johan Hoberg




159/038 13-LXE 110 0048 Uen Rev PA2     2011-11-17   1   The Future of Testing
Introduction




    What is the future of testing 5 to 10 years from now?
Overview

              Industrialization


            Smart Automation &
                Testability


            Customer Feedback


             Competence Shift


           Tool Supported Testing
Industrialization

• Testing and Software development in general must move from being a craft to
 being an engineering science


• The analogy is that software should be built and tested just like a bridge, in that
 there is a way to build a bridge, and even if there are differences between
 bridges, there are even more similarities


• When an action is performed, as long as the operator meets competence
 requirements, the output should be the same independent of operator
Smart Automation & Testability

• It is not possible to do good automation without a software that is designed for
 being automatically tested


• The value of a static test cases that is executed automatically over and over
 again is not high, even though it still has value


• There needs to be support in software for creating more dynamic test cases
 which retain their value over time and evolves – this requires both better design
 of production code, and better design of test cases


• There also needs to be standardized and easier ways to write unit tests
  •   Automatic unit test design
  •   Model based testing
Customer Feedback

• With software releases becoming more and more frequent, the time for testing
 decreases, and the possibility to get feedback from the customer improves


• Feedback mechanisms must be in place to utilize the vast information flow that
 the customers generate when they use the products


• There must be a way to quickly analyze and take actions based on the feedback
 from the customers to get the fixes in to the next release


• Imagine if a new product software is released each week – ideally even a critical
 error that is missed by test will be fixed within a week as soon as customers find
 it


• Critical systems will of course be handled differently in that they cannot release
 hazardous software even if they can fix it within a week, but will still benefit
 from user feedback
Competence Shift

• There will be many tester roles in the future, but in general testers will move
 closer towards development


• Better understanding of automation and testability design


• Testers that mimic actual users will to some extent be replaced by actual user
 feedback and quick software releases


• Even testers who work with end-to-end testing will have major tool focus to
 empower their testing
Tool Supported Testing

• All testing will be tool supported in one way or another


• Using the software as an uninformed user is not effective or efficient


• Real time information on what is going on in the software system will
 continuously be provided to the tester to help steer the testing in the right
 direction

• Risk analysis will be tool supported to a much higher extent than is today


• All setup, prerequisites and reporting for testing should be automated – the
 tester should spend time testing not administrating

• Designing automated test cases will also be tool supported so that the tester is
 not required to have the same extensive knowledge about software
 development as an actual developer
Conclusion


                   Customer
                   Feedback


                                  Competence
                                     Shift



                 Tool Supported
                    Testing




                                               Industrialization


                    Smart
   Testability
                  Automation
Reference

• None of these ideas are new


• James Whittaker, Alan Page, Alberto Savoia, Bj Rollison and many others have
 influenced and/or formulated these thoughts before

More Related Content

What's hot

software testing metrics do's - don'ts-XBOSoft-QAI Webinar
software testing metrics do's - don'ts-XBOSoft-QAI Webinarsoftware testing metrics do's - don'ts-XBOSoft-QAI Webinar
software testing metrics do's - don'ts-XBOSoft-QAI Webinar
XBOSoft
 
Test Design with Action-based Testing Methodology - Ngo Hoang Minh
Test Design with Action-based Testing Methodology - Ngo Hoang MinhTest Design with Action-based Testing Methodology - Ngo Hoang Minh
Test Design with Action-based Testing Methodology - Ngo Hoang Minh
Ho Chi Minh City Software Testing Club
 
Presentation -Quality Metrics For Agile Development
Presentation -Quality Metrics For Agile DevelopmentPresentation -Quality Metrics For Agile Development
Presentation -Quality Metrics For Agile Development
Nabilahmed Patel
 

What's hot (20)

software testing metrics do's - don'ts-XBOSoft-QAI Webinar
software testing metrics do's - don'ts-XBOSoft-QAI Webinarsoftware testing metrics do's - don'ts-XBOSoft-QAI Webinar
software testing metrics do's - don'ts-XBOSoft-QAI Webinar
 
Introduction to software testing
Introduction to software testingIntroduction to software testing
Introduction to software testing
 
Test Design with Action-based Testing Methodology - Ngo Hoang Minh
Test Design with Action-based Testing Methodology - Ngo Hoang MinhTest Design with Action-based Testing Methodology - Ngo Hoang Minh
Test Design with Action-based Testing Methodology - Ngo Hoang Minh
 
Agile Metrics
Agile MetricsAgile Metrics
Agile Metrics
 
Performance Testing – Look Before you Leap
Performance Testing – Look Before you LeapPerformance Testing – Look Before you Leap
Performance Testing – Look Before you Leap
 
Presentation -Quality Metrics For Agile Development
Presentation -Quality Metrics For Agile DevelopmentPresentation -Quality Metrics For Agile Development
Presentation -Quality Metrics For Agile Development
 
Strategy vs. Tactical Testing: Actions for Today, Plans for Tomorrow​
Strategy vs. Tactical Testing: Actions for Today, Plans for Tomorrow​Strategy vs. Tactical Testing: Actions for Today, Plans for Tomorrow​
Strategy vs. Tactical Testing: Actions for Today, Plans for Tomorrow​
 
10 Warning Signs of Weak Requirements Management
10 Warning Signs of Weak Requirements Management10 Warning Signs of Weak Requirements Management
10 Warning Signs of Weak Requirements Management
 
Agile Test Automation: Truth, Oxymoron or Lie?
Agile Test Automation: Truth, Oxymoron or Lie?Agile Test Automation: Truth, Oxymoron or Lie?
Agile Test Automation: Truth, Oxymoron or Lie?
 
Importance of testing for the business
Importance of testing for the businessImportance of testing for the business
Importance of testing for the business
 
Quality Not Compromise; Best Practices for Automated Testing
Quality Not Compromise; Best Practices for Automated TestingQuality Not Compromise; Best Practices for Automated Testing
Quality Not Compromise; Best Practices for Automated Testing
 
Decreasing false positives in automated testing
Decreasing false positives in automated testingDecreasing false positives in automated testing
Decreasing false positives in automated testing
 
Devtribe a/ b testing on multiple platforms with recurring and paying users
Devtribe  a/ b testing on multiple platforms with recurring and paying usersDevtribe  a/ b testing on multiple platforms with recurring and paying users
Devtribe a/ b testing on multiple platforms with recurring and paying users
 
New technology new approaches - tmf - july 2016
New technology new approaches - tmf - july 2016New technology new approaches - tmf - july 2016
New technology new approaches - tmf - july 2016
 
Turn Performance Testing up to 11
Turn Performance Testing up to 11Turn Performance Testing up to 11
Turn Performance Testing up to 11
 
Agile Tester - Crash Slides
Agile Tester - Crash SlidesAgile Tester - Crash Slides
Agile Tester - Crash Slides
 
Agile Testing - Not Just Tester’s Story _ Dang Thanh Long
Agile Testing - Not Just Tester’s Story _ Dang Thanh LongAgile Testing - Not Just Tester’s Story _ Dang Thanh Long
Agile Testing - Not Just Tester’s Story _ Dang Thanh Long
 
Technical Testing Introduction
Technical Testing IntroductionTechnical Testing Introduction
Technical Testing Introduction
 
Agile testing presentation
Agile testing presentationAgile testing presentation
Agile testing presentation
 
A Top Down Approach to End-to-End Testing
A Top Down Approach to End-to-End TestingA Top Down Approach to End-to-End Testing
A Top Down Approach to End-to-End Testing
 

Viewers also liked

Career Path 1-pager (Past, Present and Future)
Career Path 1-pager (Past, Present and Future)Career Path 1-pager (Past, Present and Future)
Career Path 1-pager (Past, Present and Future)
Jung Woo Ryoo
 
Why software testing
Why software testingWhy software testing
Why software testing
transformtoit
 
Software testing lecture 9
Software testing lecture 9Software testing lecture 9
Software testing lecture 9
Abdul Basit
 
Software testing lecture 10
Software testing lecture 10Software testing lecture 10
Software testing lecture 10
Abdul Basit
 

Viewers also liked (9)

Testing the Future Of Testing
Testing the Future Of TestingTesting the Future Of Testing
Testing the Future Of Testing
 
Simple stress relief strategies
Simple stress relief strategiesSimple stress relief strategies
Simple stress relief strategies
 
Career Path 1-pager (Past, Present and Future)
Career Path 1-pager (Past, Present and Future)Career Path 1-pager (Past, Present and Future)
Career Path 1-pager (Past, Present and Future)
 
Why software testing
Why software testingWhy software testing
Why software testing
 
KJ Ross Software Testing Training Pack
KJ Ross Software Testing Training PackKJ Ross Software Testing Training Pack
KJ Ross Software Testing Training Pack
 
Software testing lecture 9
Software testing lecture 9Software testing lecture 9
Software testing lecture 9
 
Software testing lecture 10
Software testing lecture 10Software testing lecture 10
Software testing lecture 10
 
Railway Ticket Issuing System (Online)
Railway Ticket Issuing System (Online)Railway Ticket Issuing System (Online)
Railway Ticket Issuing System (Online)
 
Automated Software Testing
Automated Software TestingAutomated Software Testing
Automated Software Testing
 

Similar to The future of testing

Similar to The future of testing (20)

When agility meets software quality
When agility meets software qualityWhen agility meets software quality
When agility meets software quality
 
QA Best Practices in Agile World_new
QA Best Practices in Agile World_newQA Best Practices in Agile World_new
QA Best Practices in Agile World_new
 
How to make Automation an asset for Organization
How to make Automation an asset for OrganizationHow to make Automation an asset for Organization
How to make Automation an asset for Organization
 
QA in an Agile Environment
QA in an Agile EnvironmentQA in an Agile Environment
QA in an Agile Environment
 
Presentation1
Presentation1Presentation1
Presentation1
 
! Testing for agile teams
! Testing for agile teams! Testing for agile teams
! Testing for agile teams
 
7 steps to Software test automation success
7 steps to Software test automation success7 steps to Software test automation success
7 steps to Software test automation success
 
Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".
Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".
Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".
 
Paul Gerrard - The Redistribution of Testing – Where to Innovate and What to ...
Paul Gerrard - The Redistribution of Testing – Where to Innovate and What to ...Paul Gerrard - The Redistribution of Testing – Where to Innovate and What to ...
Paul Gerrard - The Redistribution of Testing – Where to Innovate and What to ...
 
AMI Lessons Learned
AMI Lessons LearnedAMI Lessons Learned
AMI Lessons Learned
 
Testing Best Practices
Testing Best PracticesTesting Best Practices
Testing Best Practices
 
Test Driven Development – What Works And What Doesn’t
Test Driven Development – What Works And What Doesn’t Test Driven Development – What Works And What Doesn’t
Test Driven Development – What Works And What Doesn’t
 
Chapter6
Chapter6Chapter6
Chapter6
 
AMI Case Studies
AMI Case StudiesAMI Case Studies
AMI Case Studies
 
what-is-devops.ppt
what-is-devops.pptwhat-is-devops.ppt
what-is-devops.ppt
 
Testing throughout the software life cycle - Testing & Implementation
Testing throughout the software life cycle - Testing & ImplementationTesting throughout the software life cycle - Testing & Implementation
Testing throughout the software life cycle - Testing & Implementation
 
Agile Journey to agile
Agile   Journey to agileAgile   Journey to agile
Agile Journey to agile
 
Delivering A Great End User Experience
Delivering A Great End User ExperienceDelivering A Great End User Experience
Delivering A Great End User Experience
 
AMI Case Studies
AMI Case StudiesAMI Case Studies
AMI Case Studies
 
Qtp - Introduction values
Qtp - Introduction valuesQtp - Introduction values
Qtp - Introduction values
 

More from Johan Hoberg

More from Johan Hoberg (20)

Approaches to unraveling a complex test problem
Approaches to unraveling a complex test problemApproaches to unraveling a complex test problem
Approaches to unraveling a complex test problem
 
A business case for a modern QA organization
A business case for a modern QA organizationA business case for a modern QA organization
A business case for a modern QA organization
 
Signing off on Quality
Signing off on QualitySigning off on Quality
Signing off on Quality
 
Quality Information Coverage - A QI Concept
Quality Information Coverage - A QI ConceptQuality Information Coverage - A QI Concept
Quality Information Coverage - A QI Concept
 
The Bug Backlog - An Evergrowing Mountain
The Bug Backlog - An Evergrowing MountainThe Bug Backlog - An Evergrowing Mountain
The Bug Backlog - An Evergrowing Mountain
 
Quality Intelligence: Transparency & Visibility
Quality Intelligence: Transparency & VisibilityQuality Intelligence: Transparency & Visibility
Quality Intelligence: Transparency & Visibility
 
Building a QA Mindset
Building a QA Mindset Building a QA Mindset
Building a QA Mindset
 
What is QI?
What is QI?What is QI?
What is QI?
 
Building High Quality Software
Building High Quality Software Building High Quality Software
Building High Quality Software
 
Testit 2017 - Exploratory Testing for Everyone
Testit 2017 - Exploratory Testing for EveryoneTestit 2017 - Exploratory Testing for Everyone
Testit 2017 - Exploratory Testing for Everyone
 
Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...
Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...
Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...
 
Moving from scripted regression testing to exploratory testing
Moving from scripted regression testing to exploratory testingMoving from scripted regression testing to exploratory testing
Moving from scripted regression testing to exploratory testing
 
Building High Quality Software
Building High Quality SoftwareBuilding High Quality Software
Building High Quality Software
 
Quality, Testing & Agile Methodologies
Quality, Testing & Agile MethodologiesQuality, Testing & Agile Methodologies
Quality, Testing & Agile Methodologies
 
QI, not QA
QI, not QAQI, not QA
QI, not QA
 
Defining Test Competence
Defining Test CompetenceDefining Test Competence
Defining Test Competence
 
Why all deadlines are bad for quality
Why all deadlines are bad for qualityWhy all deadlines are bad for quality
Why all deadlines are bad for quality
 
QI, not QA
QI, not QAQI, not QA
QI, not QA
 
Do we really need game testers?
Do we really need game testers?Do we really need game testers?
Do we really need game testers?
 
Hardware/Software Integration Testing
Hardware/Software Integration TestingHardware/Software Integration Testing
Hardware/Software Integration Testing
 

Recently uploaded

Recently uploaded (20)

Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
A Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusA Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source Milvus
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 

The future of testing

  • 1. The Future of Testing Johan Hoberg 159/038 13-LXE 110 0048 Uen Rev PA2 2011-11-17 1 The Future of Testing
  • 2. Introduction  What is the future of testing 5 to 10 years from now?
  • 3. Overview Industrialization Smart Automation & Testability Customer Feedback Competence Shift Tool Supported Testing
  • 4. Industrialization • Testing and Software development in general must move from being a craft to being an engineering science • The analogy is that software should be built and tested just like a bridge, in that there is a way to build a bridge, and even if there are differences between bridges, there are even more similarities • When an action is performed, as long as the operator meets competence requirements, the output should be the same independent of operator
  • 5. Smart Automation & Testability • It is not possible to do good automation without a software that is designed for being automatically tested • The value of a static test cases that is executed automatically over and over again is not high, even though it still has value • There needs to be support in software for creating more dynamic test cases which retain their value over time and evolves – this requires both better design of production code, and better design of test cases • There also needs to be standardized and easier ways to write unit tests • Automatic unit test design • Model based testing
  • 6. Customer Feedback • With software releases becoming more and more frequent, the time for testing decreases, and the possibility to get feedback from the customer improves • Feedback mechanisms must be in place to utilize the vast information flow that the customers generate when they use the products • There must be a way to quickly analyze and take actions based on the feedback from the customers to get the fixes in to the next release • Imagine if a new product software is released each week – ideally even a critical error that is missed by test will be fixed within a week as soon as customers find it • Critical systems will of course be handled differently in that they cannot release hazardous software even if they can fix it within a week, but will still benefit from user feedback
  • 7. Competence Shift • There will be many tester roles in the future, but in general testers will move closer towards development • Better understanding of automation and testability design • Testers that mimic actual users will to some extent be replaced by actual user feedback and quick software releases • Even testers who work with end-to-end testing will have major tool focus to empower their testing
  • 8. Tool Supported Testing • All testing will be tool supported in one way or another • Using the software as an uninformed user is not effective or efficient • Real time information on what is going on in the software system will continuously be provided to the tester to help steer the testing in the right direction • Risk analysis will be tool supported to a much higher extent than is today • All setup, prerequisites and reporting for testing should be automated – the tester should spend time testing not administrating • Designing automated test cases will also be tool supported so that the tester is not required to have the same extensive knowledge about software development as an actual developer
  • 9. Conclusion Customer Feedback Competence Shift Tool Supported Testing Industrialization Smart Testability Automation
  • 10. Reference • None of these ideas are new • James Whittaker, Alan Page, Alberto Savoia, Bj Rollison and many others have influenced and/or formulated these thoughts before