SlideShare uma empresa Scribd logo
1 de 16
SOASTA Webinar Series




CLOUD TESTING            RULE 3:
Rewriting the Rules of   Performance
                         Testing Across the
Performance Testing
                         Lifecycle
Performance Has Been a Lab Exercise


        Dev & Test Lab              DEPLOY
                                                  Production Environment


     Status Quo:                                 Performance Testing is often
small test window prior                          considered hard & non-repeatable
       to release                                due to real constraints:

                                                 • Linear, multi-step approaches
                      Analyze                    • Non-correlated, offline analysis
                                   • Tune Code
   • Build Test
                                   • Adjust      • Disconnected teams
   • Setup         • Collect
     Environment     Metrics
                                     Settings
                                                 • Costly test hardware
                   • Find Issues
         Run                              Fix    • Time-intensive test setup
                                                 • Inability to hit realistic scale

        Time-consuming testing limits
            deployment options
Do We Spend Time Where It Counts?


   Many approaches are process and pre-test heavy

                                            Traditional Approaches
               TEST BUILDING               HW Setup         TEST     ANALYZE          FIX       RETEST    REPEAT?




                                                          TIME

       BUILD   H
               W
                     TEST      H
                               W
                                    TEST              H
                                                      W
                                                            TEST       H
                                                                       W
                                                                               TEST         H
                                                                                            W
                                                                                                  TEST
                                                                                                            Extra
                   ANALYZE         ANALYZE                 ANALYZE         ANALYZE              ANALYZE
               S      FIX      S                      S                S                    S
                                                                                                            time!
                                     FIX                     FIX               FIX                FIX
               e               e                      e                e                    e
               t               t                      t                t                    t
               u               u                      u                u                    u
               p               p                      p                p                    p
                     Eliminate constraints and TEST MORE, at SCALE, in LESS TIME




    Agile approaches deliver results fast
Continuous Performance Testing is Progressive

                  Dev & Test Lab                  Production Environment




     Start              Include    Hit expected
                                                                 Recheck
small, early to      performance      scale in
                                                    Test in    regularly for   Plan for
root out code-         focus in    staging and
                                                  Production    regression     growth
 level issues         iterations   maintenance
                                                               and capacity
                                     windows




                         Keys to agile performance testing?
                            SPEED – SCALE – COST
Performance Bugs Know No Borders
       Issues span teams, time and scale

                                                                                                                       Latency between systems

               Network                                                                                        Network configuration
                                                                                                                                                    Capacity limits
                & Ops
                                                                                                       Network bandwidth
                                                                                                                                             CDN file placement
                                                                                           Conflict with other apps
Stage / Team




                                                                                                                                      DNS routing
                                                                                Load Balancer configuration                 Firewall max capacity
                                                                            Auto-scaling failures                Unbalanced web servers
                                                                  Max sockets exceeded
                Release
               & Deploy                                Slow third-party plug-ins             s            Global latency variance

                                                                                                Security bottlenecks
                                           Caching issues and benefits
                                                                                      Search technology limits
                                Default configuration settings
                                                                       Inadequate server resources
                                      Garbage collection
                                Memory leaks
                               Memory leaks
                                                              Database thread counts
                  Dev        Slow pages
                & Test                           Inefficient database queries
                          Code bugs
                                        Method-level tuning


                                      Test Lab                                          Staging                                     Production (100% +++)

                                                                           Scale and Time
Complete Performance Testing
Proactive and Predictive


                               Track performance regression
                                (and progression) over time!



                                  Performance Coverage Status




  Begin to track performance
  coverage across a range of
      critical objectives!
Let’s Look at the NEW RULES


    Performance Testing: Early, Often, Always
                Matt Heusser




                matt@xndev.com
Q&A
           Questions & Answers will post on CloudLink:
                   http://cloudlink.soasta.com

          Previous & Upcoming SOASTA Webinars:
Stop Cheating & Start Running Realistic Tests (w/ Scott Barber)
     Run More Tests & Find More Issues (w/ Neil Gunther)
         http://www.soasta.com/info-center/webinars/

    Contact SOASTA:                 Contact Matt
    www.soasta.com/cloudtest/       matt@xndev.com
    info@soasta.com                 Follow Matt:
    866.344.8766
    Follow us:
                                       twitter.com/mheusser
        twitter.com/cloudtest
        facebook.com/cloudtest

Mais conteúdo relacionado

Mais de SOASTA

Building a Performance A-Team
Building a Performance A-TeamBuilding a Performance A-Team
Building a Performance A-TeamSOASTA
 
Dach webinar - Image Absicherung – Lektionen aus dem Facebook Crash
Dach webinar - Image Absicherung – Lektionen aus dem Facebook CrashDach webinar - Image Absicherung – Lektionen aus dem Facebook Crash
Dach webinar - Image Absicherung – Lektionen aus dem Facebook CrashSOASTA
 
Four best practices for performance testing mobile apps soasta and utopia
Four best practices for performance testing mobile apps   soasta and utopiaFour best practices for performance testing mobile apps   soasta and utopia
Four best practices for performance testing mobile apps soasta and utopiaSOASTA
 
Synthetic and rum webinar
Synthetic and rum webinarSynthetic and rum webinar
Synthetic and rum webinarSOASTA
 
7 steps to pragmatic mobile testing
7 steps to pragmatic mobile testing7 steps to pragmatic mobile testing
7 steps to pragmatic mobile testingSOASTA
 
Secrets to Realistic Load Testing
Secrets to Realistic Load TestingSecrets to Realistic Load Testing
Secrets to Realistic Load TestingSOASTA
 
How to measure the business impact of web performance
How to measure the business impact of web performanceHow to measure the business impact of web performance
How to measure the business impact of web performanceSOASTA
 
Lasttest auf Zuruf CloudTest on Demand webinar presentation
Lasttest auf Zuruf CloudTest on Demand webinar presentationLasttest auf Zuruf CloudTest on Demand webinar presentation
Lasttest auf Zuruf CloudTest on Demand webinar presentationSOASTA
 
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and DeliveryAccelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and DeliverySOASTA
 
The Mobile Testing Checklist
The Mobile Testing ChecklistThe Mobile Testing Checklist
The Mobile Testing ChecklistSOASTA
 
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...SOASTA
 
Reducing 3rd party content risk with Real User Monitoring
Reducing 3rd party content risk with Real User MonitoringReducing 3rd party content risk with Real User Monitoring
Reducing 3rd party content risk with Real User MonitoringSOASTA
 
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal ReadinessTis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal ReadinessSOASTA
 
Modern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the PresentModern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the PresentSOASTA
 
Getting started w ct lite load_testing 21.05.14
Getting started w ct lite load_testing 21.05.14Getting started w ct lite load_testing 21.05.14
Getting started w ct lite load_testing 21.05.14SOASTA
 
Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014
Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014
Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014SOASTA
 
What Retailers Know About Performance and User Experience
What Retailers Know About Performance and User ExperienceWhat Retailers Know About Performance and User Experience
What Retailers Know About Performance and User ExperienceSOASTA
 
Getting started w ct lite load_testing 03.04.14
Getting started w ct lite load_testing 03.04.14Getting started w ct lite load_testing 03.04.14
Getting started w ct lite load_testing 03.04.14SOASTA
 
Erste schritte mit ct lite load_testing 02.04.14
Erste schritte mit ct lite load_testing 02.04.14Erste schritte mit ct lite load_testing 02.04.14
Erste schritte mit ct lite load_testing 02.04.14SOASTA
 
Agile Load Testing In The Real World
Agile Load Testing In The Real WorldAgile Load Testing In The Real World
Agile Load Testing In The Real WorldSOASTA
 

Mais de SOASTA (20)

Building a Performance A-Team
Building a Performance A-TeamBuilding a Performance A-Team
Building a Performance A-Team
 
Dach webinar - Image Absicherung – Lektionen aus dem Facebook Crash
Dach webinar - Image Absicherung – Lektionen aus dem Facebook CrashDach webinar - Image Absicherung – Lektionen aus dem Facebook Crash
Dach webinar - Image Absicherung – Lektionen aus dem Facebook Crash
 
Four best practices for performance testing mobile apps soasta and utopia
Four best practices for performance testing mobile apps   soasta and utopiaFour best practices for performance testing mobile apps   soasta and utopia
Four best practices for performance testing mobile apps soasta and utopia
 
Synthetic and rum webinar
Synthetic and rum webinarSynthetic and rum webinar
Synthetic and rum webinar
 
7 steps to pragmatic mobile testing
7 steps to pragmatic mobile testing7 steps to pragmatic mobile testing
7 steps to pragmatic mobile testing
 
Secrets to Realistic Load Testing
Secrets to Realistic Load TestingSecrets to Realistic Load Testing
Secrets to Realistic Load Testing
 
How to measure the business impact of web performance
How to measure the business impact of web performanceHow to measure the business impact of web performance
How to measure the business impact of web performance
 
Lasttest auf Zuruf CloudTest on Demand webinar presentation
Lasttest auf Zuruf CloudTest on Demand webinar presentationLasttest auf Zuruf CloudTest on Demand webinar presentation
Lasttest auf Zuruf CloudTest on Demand webinar presentation
 
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and DeliveryAccelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
 
The Mobile Testing Checklist
The Mobile Testing ChecklistThe Mobile Testing Checklist
The Mobile Testing Checklist
 
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
 
Reducing 3rd party content risk with Real User Monitoring
Reducing 3rd party content risk with Real User MonitoringReducing 3rd party content risk with Real User Monitoring
Reducing 3rd party content risk with Real User Monitoring
 
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal ReadinessTis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
 
Modern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the PresentModern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the Present
 
Getting started w ct lite load_testing 21.05.14
Getting started w ct lite load_testing 21.05.14Getting started w ct lite load_testing 21.05.14
Getting started w ct lite load_testing 21.05.14
 
Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014
Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014
Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014
 
What Retailers Know About Performance and User Experience
What Retailers Know About Performance and User ExperienceWhat Retailers Know About Performance and User Experience
What Retailers Know About Performance and User Experience
 
Getting started w ct lite load_testing 03.04.14
Getting started w ct lite load_testing 03.04.14Getting started w ct lite load_testing 03.04.14
Getting started w ct lite load_testing 03.04.14
 
Erste schritte mit ct lite load_testing 02.04.14
Erste schritte mit ct lite load_testing 02.04.14Erste schritte mit ct lite load_testing 02.04.14
Erste schritte mit ct lite load_testing 02.04.14
 
Agile Load Testing In The Real World
Agile Load Testing In The Real WorldAgile Load Testing In The Real World
Agile Load Testing In The Real World
 

Último

Google I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGoogle I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGDSC PJATK
 
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfLinux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfFIDO Alliance
 
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...FIDO Alliance
 
Design Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptxDesign Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptxFIDO Alliance
 
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdfThe Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdfFIDO Alliance
 
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?Paolo Missier
 
Working together SRE & Platform Engineering
Working together SRE & Platform EngineeringWorking together SRE & Platform Engineering
Working together SRE & Platform EngineeringMarcus Vechiato
 
Where to Learn More About FDO _ Richard at FIDO Alliance.pdf
Where to Learn More About FDO _ Richard at FIDO Alliance.pdfWhere to Learn More About FDO _ Richard at FIDO Alliance.pdf
Where to Learn More About FDO _ Richard at FIDO Alliance.pdfFIDO Alliance
 
Your enemies use GenAI too - staying ahead of fraud with Neo4j
Your enemies use GenAI too - staying ahead of fraud with Neo4jYour enemies use GenAI too - staying ahead of fraud with Neo4j
Your enemies use GenAI too - staying ahead of fraud with Neo4jNeo4j
 
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsContinuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsLeah Henrickson
 
AI mind or machine power point presentation
AI mind or machine power point presentationAI mind or machine power point presentation
AI mind or machine power point presentationyogeshlabana357357
 
ERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage IntacctERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage IntacctBrainSell Technologies
 
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdfIntroduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdfFIDO Alliance
 
Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Patrick Viafore
 
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfHow we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfSrushith Repakula
 
Microsoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireMicrosoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireExakis Nelite
 
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdfSimplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdfFIDO Alliance
 
Structuring Teams and Portfolios for Success
Structuring Teams and Portfolios for SuccessStructuring Teams and Portfolios for Success
Structuring Teams and Portfolios for SuccessUXDXConf
 
Portal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russePortal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russe中 央社
 
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxFIDO Alliance
 

Último (20)

Google I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGoogle I/O Extended 2024 Warsaw
Google I/O Extended 2024 Warsaw
 
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfLinux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
 
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
 
Design Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptxDesign Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptx
 
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdfThe Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
 
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
 
Working together SRE & Platform Engineering
Working together SRE & Platform EngineeringWorking together SRE & Platform Engineering
Working together SRE & Platform Engineering
 
Where to Learn More About FDO _ Richard at FIDO Alliance.pdf
Where to Learn More About FDO _ Richard at FIDO Alliance.pdfWhere to Learn More About FDO _ Richard at FIDO Alliance.pdf
Where to Learn More About FDO _ Richard at FIDO Alliance.pdf
 
Your enemies use GenAI too - staying ahead of fraud with Neo4j
Your enemies use GenAI too - staying ahead of fraud with Neo4jYour enemies use GenAI too - staying ahead of fraud with Neo4j
Your enemies use GenAI too - staying ahead of fraud with Neo4j
 
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsContinuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
 
AI mind or machine power point presentation
AI mind or machine power point presentationAI mind or machine power point presentation
AI mind or machine power point presentation
 
ERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage IntacctERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage Intacct
 
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdfIntroduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
 
Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024
 
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfHow we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdf
 
Microsoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireMicrosoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - Questionnaire
 
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdfSimplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
 
Structuring Teams and Portfolios for Success
Structuring Teams and Portfolios for SuccessStructuring Teams and Portfolios for Success
Structuring Teams and Portfolios for Success
 
Portal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russePortal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russe
 
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
 

Changing rules 3_performance testing across lifecycle_slideshare

  • 1. SOASTA Webinar Series CLOUD TESTING RULE 3: Rewriting the Rules of Performance Testing Across the Performance Testing Lifecycle
  • 2. Performance Has Been a Lab Exercise Dev & Test Lab DEPLOY Production Environment Status Quo: Performance Testing is often small test window prior considered hard & non-repeatable to release due to real constraints: • Linear, multi-step approaches Analyze • Non-correlated, offline analysis • Tune Code • Build Test • Adjust • Disconnected teams • Setup • Collect Environment Metrics Settings • Costly test hardware • Find Issues Run Fix • Time-intensive test setup • Inability to hit realistic scale Time-consuming testing limits deployment options
  • 3. Do We Spend Time Where It Counts? Many approaches are process and pre-test heavy Traditional Approaches TEST BUILDING HW Setup TEST ANALYZE FIX RETEST REPEAT? TIME BUILD H W TEST H W TEST H W TEST H W TEST H W TEST Extra ANALYZE ANALYZE ANALYZE ANALYZE ANALYZE S FIX S S S S time! FIX FIX FIX FIX e e e e e t t t t t u u u u u p p p p p Eliminate constraints and TEST MORE, at SCALE, in LESS TIME Agile approaches deliver results fast
  • 4. Continuous Performance Testing is Progressive Dev & Test Lab Production Environment Start Include Hit expected Recheck small, early to performance scale in Test in regularly for Plan for root out code- focus in staging and Production regression growth level issues iterations maintenance and capacity windows Keys to agile performance testing? SPEED – SCALE – COST
  • 5. Performance Bugs Know No Borders Issues span teams, time and scale Latency between systems Network Network configuration Capacity limits & Ops Network bandwidth CDN file placement Conflict with other apps Stage / Team DNS routing Load Balancer configuration Firewall max capacity Auto-scaling failures Unbalanced web servers Max sockets exceeded Release & Deploy Slow third-party plug-ins s Global latency variance Security bottlenecks Caching issues and benefits Search technology limits Default configuration settings Inadequate server resources Garbage collection Memory leaks Memory leaks Database thread counts Dev Slow pages & Test Inefficient database queries Code bugs Method-level tuning Test Lab Staging Production (100% +++) Scale and Time
  • 6. Complete Performance Testing Proactive and Predictive Track performance regression (and progression) over time! Performance Coverage Status Begin to track performance coverage across a range of critical objectives!
  • 7. Let’s Look at the NEW RULES Performance Testing: Early, Often, Always Matt Heusser matt@xndev.com
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16. Q&A Questions & Answers will post on CloudLink: http://cloudlink.soasta.com Previous & Upcoming SOASTA Webinars: Stop Cheating & Start Running Realistic Tests (w/ Scott Barber) Run More Tests & Find More Issues (w/ Neil Gunther) http://www.soasta.com/info-center/webinars/ Contact SOASTA: Contact Matt www.soasta.com/cloudtest/ matt@xndev.com info@soasta.com Follow Matt: 866.344.8766 Follow us: twitter.com/mheusser twitter.com/cloudtest facebook.com/cloudtest

Notas do Editor

  1. Thank you so much for attending this webinar. The archive will be available on our website by the end of this week. Please tell others about it.