SlideShare uma empresa Scribd logo
1 de 26
Baixar para ler offline
Improving Overall Software
Quality Through Profiling and
Performance Testing
Ervin Loh and Lai Ee
ALM Program Manager and ALM Engineer
K365Labs Sdn Bhd
Agenda
 Load & Performance Testing with Visual Studio
   Proven within Microsoft
   External Success Stories
 The Visual Studio Load & Performance Offering
 The Visual Studio Load & Performance
 Community
Visual Studio: Battle Hardened
Visual Studio is
the de facto load
testing tool
within Microsoft
  Scales to massive
  loads
  Handles the most
  complex
  scenarios
Load Test Internal Success Stories
Team             Test Target              Description
Office Server    Office SharePoint        Perf and stress testing of Office Server System
                 Windows SharePoint
                 Excel Server

SQL              SQL Reporting Services   Perf and Stress, benchmarking, sizing
                 SQL BI
Dynamics AX      Dynamics 4.0             Perf and Stress, benchmarking, sizing
MSN/Live         Ad Center                High volume perf and stress testing
                 Hot Mail
                 Virtual Earth            Recent 12-hour production test:
                 Autos
                 March Madness
                                          Total requests generated 3.63 Billion
                 Music                    Average requests/sec      84,248
                 More…
Groove           Open Office              Perf and Stress Testing
DevDiv           Team Foundation Server   Perf and Stress Test TFS
MSIT             SAP                      Load Test SAP via Web Services
MSTV             IPTV servers             Huge tests to load test IPTV national rollout
MS CRM           MS CRM                   Perf and Stress, benchmarking, sizing
                                          Using Load Tests to validate IPTV pods
Microsoft.com    Microsoft.com            Perf and Stress Testing
                                           Each services 100,000 customers
Dr Watson        Log collection servers   Perf andmajor telecoms are customers:
                                           Many Stress Testing
Windows Update   Patch download servers   Perf andTel Italia, Bell Canada, more…
                                           AT&T, Stress Testing
External Success Stories
  Services Test Labs
    Professional performance and stress testing services
    Before: 100% on HP Load Runner and Borland Silk
    Performer
    After: 100% on VS, with many successful customer
    engagements
    Prefer VS over Load Runner and Silk Performer
  Many others
Tailspin Toys
Agenda
 Load & Performance Testing with Visual Studio
 The Visual Studio Load & Performance Offering
   Web Test Architecture & Feature Set
   Load Test Architecture & Feature Set
 The Visual Studio Load & Performance
 Community
Web Performance Test Feature Set
 Deep integration with Visual Studio
 Web (HTTP) Tests
 Data Collection
   Performance Counter Sets capture key measurements
   Test results stored in SQL for custom reporting
 Performance Analysis
   Correlate of server activity with performance measurements
   Drill into error logs
Web Performance Test Recorder

                           Visual Studio Launches Internet Explorer



 Visual Studio                                            Internet Explorer
                                                                                        Recorder BHO
                                                                Browser events

Recorder Listener                        Record events
                                                                                    Browser Control
                                                          Browser Recorder
                                  Merging Recorder                                   Wininet Shim
               Record events                              Wininet Recorder
                                          Record events                                 Wininet


                                                                   Intercepts wininet calls
Web Test Recorder Plugin
                  Visual Studio Launches Internet Explorer



                                                                  Internet Explorer
  Visual Studio                                                                              Recorder
                                                                                             BHO
                                                                                 Browser events
                                                                 Record events
                                                                                            Browser
                                                                            Browser         Control
                                                             Merging        Recorder
                                                             Recorder                        Wininet
                                                                           Wininet           Shim
                                                                           Recorder          Wininet
                                                                 Record events


                                                                                  Intercept s wininet calls

                                          Record events
                       Recorder   Listener
Key Capabilities in 2010
 Declarative branching and looping in a web performance test
 Excel based performance reporting
 Run UI tests as performance tests
 Integration with data collectors
   ASP.net profiler
   Intellitrace™
Web Performance Tests
Visual Studio 2010 Load Test
Architecture
Visual Studio



                              Load agent              web server




   test controller




                                           database server

Microsoft Test Manager 2010
Load/Stress Test Feature Set
 Flexible Load Modeling
   “Scenarios” for modeling different user groups
   Goal-based, step, constant, and custom load
   patterns
   Model different browsers and networks
   Duration-based and iteration based
 Efficient Load Generation
 “Unit” tests can be run under load
Key Capabilities in 2010
 Virtual user activity chart
 64-bit test execution
 Driver level network emulation
 Collect the full test result on error
 Numerous enhancements to make creating
 scripts easier
 New extensibility points
 … and more
Load Tests
Agenda
 Load & Performance Testing with Visual Studio
 The Visual Studio Load & Performance Offering
 The Visual Studio Load & Performance
 Community
   Plugins, Extensibility
   Forums, Blogs
Extensibility
  Load test plugins
  Many extensibility points in Web performance
  tests
    web test plugins
    web test request plugins
    web test recorder plugins
  diagnostic data adapters (DDA) (a.k.a “data
  collectors”)
Visual Studio Load & Performance
Community
 Forums
   http://social.msdn.microsoft.com/Forums/en-
   US/vstswebtest/threads
 Blogs
   Blogs.msdn.com/edglas
   Blogs.msdn.com/billbar
   Blogs.msdn.com/slumley
   http://blogs.msdn.com/edglas/pages/content-
   index-for-web-tests-and-load-tests.aspx
Visual Studio Load & Performance
Community
 CodePlex
   Quick Reference Guide
   WCF Load Test Recorder
   SQL Load Test Recorder
   Load Test Reports
   Web and Load Test Plugins
   SharePoint Scripts



                                   continue….
How Do I Get It?
Questions & Answers
Resources
Getting Started with Load and Web Performance Test Walkthroughs
http://msdn.microsoft.com/en-us/library/ee923685.aspx


Web Performance Test Walkthroughs
http://msdn.microsoft.com/en-us/library/aa337591.aspx


Load Test Walkthroughs
http://msdn.microsoft.com/en-us/library/ff406963.aspx


Walkthrough: Using a Test Controller and Test Agents in a Load Test
http://msdn.microsoft.com/en-us/library/ff400223.aspx
We value your feedback!


Please remember to complete the
overall conference evaluation form and
return it to the Registration Counter.

Mais conteúdo relacionado

Semelhante a Improving Software Quality Through Profiling and Performance Testing

Software Testen mit Visual Studio Lab Management
Software Testen mit Visual Studio Lab ManagementSoftware Testen mit Visual Studio Lab Management
Software Testen mit Visual Studio Lab ManagementNico Orschel
 
ShowNTell: An easy-to-use tool for answering students’ questions with voice-o...
ShowNTell: An easy-to-use tool for answering students’ questions with voice-o...ShowNTell: An easy-to-use tool for answering students’ questions with voice-o...
ShowNTell: An easy-to-use tool for answering students’ questions with voice-o...Anand Bhojan
 
InduSoft VBScript Webinar
 InduSoft VBScript Webinar InduSoft VBScript Webinar
InduSoft VBScript WebinarAVEVA
 
SF DevOps: Introducing Vagrant
SF DevOps: Introducing VagrantSF DevOps: Introducing Vagrant
SF DevOps: Introducing VagrantMitchell Hashimoto
 
New Generation Record/Playback Tools for AJAX Testing
New Generation Record/Playback Tools for AJAX TestingNew Generation Record/Playback Tools for AJAX Testing
New Generation Record/Playback Tools for AJAX TestingClever Moe
 
Creativity Day Milano 27 Febbraio Milano
Creativity Day Milano 27 Febbraio MilanoCreativity Day Milano 27 Febbraio Milano
Creativity Day Milano 27 Febbraio Milanoroberto.design
 
SVG in Data Acquisition and Control Systems
SVG in Data Acquisition and Control SystemsSVG in Data Acquisition and Control Systems
SVG in Data Acquisition and Control SystemsTao Jiang
 
Porque Odeio Branches
Porque Odeio BranchesPorque Odeio Branches
Porque Odeio BranchesRafael Petry
 
Dotcom monitor platform overview
Dotcom monitor platform overviewDotcom monitor platform overview
Dotcom monitor platform overviewtrippj
 
An Introduction To Rich Internet Apllications
An Introduction To Rich Internet ApllicationsAn Introduction To Rich Internet Apllications
An Introduction To Rich Internet ApllicationsMrinal Wadhwa
 
Automation Open Source tools
Automation Open Source toolsAutomation Open Source tools
Automation Open Source toolsQA Club Kiev
 
VASmalltalk, Today and Tomorrow
VASmalltalk, Today and TomorrowVASmalltalk, Today and Tomorrow
VASmalltalk, Today and TomorrowESUG
 
Audio and Video streaming.ppt
Audio and Video streaming.pptAudio and Video streaming.ppt
Audio and Video streaming.pptVideoguy
 
Migrating from HP QuickTest Pro QTP to TestMaker Object Designer
Migrating from HP QuickTest Pro QTP to TestMaker Object DesignerMigrating from HP QuickTest Pro QTP to TestMaker Object Designer
Migrating from HP QuickTest Pro QTP to TestMaker Object DesignerClever Moe
 
Migrating From HP QTP To TestMaker 6
Migrating From HP QTP To TestMaker 6Migrating From HP QTP To TestMaker 6
Migrating From HP QTP To TestMaker 6Clever Moe
 
Flash Camp Chennai - Build automation of Flex and AIR applications
Flash Camp Chennai - Build automation of Flex and AIR applicationsFlash Camp Chennai - Build automation of Flex and AIR applications
Flash Camp Chennai - Build automation of Flex and AIR applicationsRIA RUI Society
 
IBM Performance Optimizaiton Toolkit for Rational Application Developer
IBM Performance Optimizaiton Toolkit for Rational Application DeveloperIBM Performance Optimizaiton Toolkit for Rational Application Developer
IBM Performance Optimizaiton Toolkit for Rational Application DeveloperAshish Patel
 

Semelhante a Improving Software Quality Through Profiling and Performance Testing (20)

Software Testen mit Visual Studio Lab Management
Software Testen mit Visual Studio Lab ManagementSoftware Testen mit Visual Studio Lab Management
Software Testen mit Visual Studio Lab Management
 
ShowNTell: An easy-to-use tool for answering students’ questions with voice-o...
ShowNTell: An easy-to-use tool for answering students’ questions with voice-o...ShowNTell: An easy-to-use tool for answering students’ questions with voice-o...
ShowNTell: An easy-to-use tool for answering students’ questions with voice-o...
 
InduSoft VBScript Webinar
 InduSoft VBScript Webinar InduSoft VBScript Webinar
InduSoft VBScript Webinar
 
SF DevOps: Introducing Vagrant
SF DevOps: Introducing VagrantSF DevOps: Introducing Vagrant
SF DevOps: Introducing Vagrant
 
New Generation Record/Playback Tools for AJAX Testing
New Generation Record/Playback Tools for AJAX TestingNew Generation Record/Playback Tools for AJAX Testing
New Generation Record/Playback Tools for AJAX Testing
 
Creativity Day Milano 27 Febbraio Milano
Creativity Day Milano 27 Febbraio MilanoCreativity Day Milano 27 Febbraio Milano
Creativity Day Milano 27 Febbraio Milano
 
SVG in Data Acquisition and Control Systems
SVG in Data Acquisition and Control SystemsSVG in Data Acquisition and Control Systems
SVG in Data Acquisition and Control Systems
 
Porque Odeio Branches
Porque Odeio BranchesPorque Odeio Branches
Porque Odeio Branches
 
Dotcom monitor platform overview
Dotcom monitor platform overviewDotcom monitor platform overview
Dotcom monitor platform overview
 
An Introduction To Rich Internet Apllications
An Introduction To Rich Internet ApllicationsAn Introduction To Rich Internet Apllications
An Introduction To Rich Internet Apllications
 
Automation Open Source tools
Automation Open Source toolsAutomation Open Source tools
Automation Open Source tools
 
VASmalltalk, Today and Tomorrow
VASmalltalk, Today and TomorrowVASmalltalk, Today and Tomorrow
VASmalltalk, Today and Tomorrow
 
Audio and Video streaming.ppt
Audio and Video streaming.pptAudio and Video streaming.ppt
Audio and Video streaming.ppt
 
Migrating from HP QuickTest Pro QTP to TestMaker Object Designer
Migrating from HP QuickTest Pro QTP to TestMaker Object DesignerMigrating from HP QuickTest Pro QTP to TestMaker Object Designer
Migrating from HP QuickTest Pro QTP to TestMaker Object Designer
 
Migrating From HP QTP To TestMaker 6
Migrating From HP QTP To TestMaker 6Migrating From HP QTP To TestMaker 6
Migrating From HP QTP To TestMaker 6
 
Load Runner
Load RunnerLoad Runner
Load Runner
 
Flash Camp Chennai - Build automation of Flex and AIR applications
Flash Camp Chennai - Build automation of Flex and AIR applicationsFlash Camp Chennai - Build automation of Flex and AIR applications
Flash Camp Chennai - Build automation of Flex and AIR applications
 
Eclipse summit-2010
Eclipse summit-2010Eclipse summit-2010
Eclipse summit-2010
 
V mukti streamingwhitepaper2[1]
V mukti streamingwhitepaper2[1]V mukti streamingwhitepaper2[1]
V mukti streamingwhitepaper2[1]
 
IBM Performance Optimizaiton Toolkit for Rational Application Developer
IBM Performance Optimizaiton Toolkit for Rational Application DeveloperIBM Performance Optimizaiton Toolkit for Rational Application Developer
IBM Performance Optimizaiton Toolkit for Rational Application Developer
 

Último

Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 

Último (20)

Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 

Improving Software Quality Through Profiling and Performance Testing

  • 1.
  • 2. Improving Overall Software Quality Through Profiling and Performance Testing Ervin Loh and Lai Ee ALM Program Manager and ALM Engineer K365Labs Sdn Bhd
  • 3.
  • 4. Agenda Load & Performance Testing with Visual Studio Proven within Microsoft External Success Stories The Visual Studio Load & Performance Offering The Visual Studio Load & Performance Community
  • 5. Visual Studio: Battle Hardened Visual Studio is the de facto load testing tool within Microsoft Scales to massive loads Handles the most complex scenarios
  • 6. Load Test Internal Success Stories Team Test Target Description Office Server Office SharePoint Perf and stress testing of Office Server System Windows SharePoint Excel Server SQL SQL Reporting Services Perf and Stress, benchmarking, sizing SQL BI Dynamics AX Dynamics 4.0 Perf and Stress, benchmarking, sizing MSN/Live Ad Center High volume perf and stress testing Hot Mail Virtual Earth Recent 12-hour production test: Autos March Madness Total requests generated 3.63 Billion Music Average requests/sec 84,248 More… Groove Open Office Perf and Stress Testing DevDiv Team Foundation Server Perf and Stress Test TFS MSIT SAP Load Test SAP via Web Services MSTV IPTV servers Huge tests to load test IPTV national rollout MS CRM MS CRM Perf and Stress, benchmarking, sizing Using Load Tests to validate IPTV pods Microsoft.com Microsoft.com Perf and Stress Testing Each services 100,000 customers Dr Watson Log collection servers Perf andmajor telecoms are customers: Many Stress Testing Windows Update Patch download servers Perf andTel Italia, Bell Canada, more… AT&T, Stress Testing
  • 7. External Success Stories Services Test Labs Professional performance and stress testing services Before: 100% on HP Load Runner and Borland Silk Performer After: 100% on VS, with many successful customer engagements Prefer VS over Load Runner and Silk Performer Many others
  • 9. Agenda Load & Performance Testing with Visual Studio The Visual Studio Load & Performance Offering Web Test Architecture & Feature Set Load Test Architecture & Feature Set The Visual Studio Load & Performance Community
  • 10. Web Performance Test Feature Set Deep integration with Visual Studio Web (HTTP) Tests Data Collection Performance Counter Sets capture key measurements Test results stored in SQL for custom reporting Performance Analysis Correlate of server activity with performance measurements Drill into error logs
  • 11. Web Performance Test Recorder Visual Studio Launches Internet Explorer Visual Studio Internet Explorer Recorder BHO Browser events Recorder Listener Record events Browser Control Browser Recorder Merging Recorder Wininet Shim Record events Wininet Recorder Record events Wininet Intercepts wininet calls
  • 12. Web Test Recorder Plugin Visual Studio Launches Internet Explorer Internet Explorer Visual Studio Recorder BHO Browser events Record events Browser Browser Control Merging Recorder Recorder Wininet Wininet Shim Recorder Wininet Record events Intercept s wininet calls Record events Recorder Listener
  • 13. Key Capabilities in 2010 Declarative branching and looping in a web performance test Excel based performance reporting Run UI tests as performance tests Integration with data collectors ASP.net profiler Intellitrace™
  • 15. Visual Studio 2010 Load Test Architecture Visual Studio Load agent web server test controller database server Microsoft Test Manager 2010
  • 16. Load/Stress Test Feature Set Flexible Load Modeling “Scenarios” for modeling different user groups Goal-based, step, constant, and custom load patterns Model different browsers and networks Duration-based and iteration based Efficient Load Generation “Unit” tests can be run under load
  • 17. Key Capabilities in 2010 Virtual user activity chart 64-bit test execution Driver level network emulation Collect the full test result on error Numerous enhancements to make creating scripts easier New extensibility points … and more
  • 19. Agenda Load & Performance Testing with Visual Studio The Visual Studio Load & Performance Offering The Visual Studio Load & Performance Community Plugins, Extensibility Forums, Blogs
  • 20. Extensibility Load test plugins Many extensibility points in Web performance tests web test plugins web test request plugins web test recorder plugins diagnostic data adapters (DDA) (a.k.a “data collectors”)
  • 21. Visual Studio Load & Performance Community Forums http://social.msdn.microsoft.com/Forums/en- US/vstswebtest/threads Blogs Blogs.msdn.com/edglas Blogs.msdn.com/billbar Blogs.msdn.com/slumley http://blogs.msdn.com/edglas/pages/content- index-for-web-tests-and-load-tests.aspx
  • 22. Visual Studio Load & Performance Community CodePlex Quick Reference Guide WCF Load Test Recorder SQL Load Test Recorder Load Test Reports Web and Load Test Plugins SharePoint Scripts continue….
  • 23. How Do I Get It?
  • 25. Resources Getting Started with Load and Web Performance Test Walkthroughs http://msdn.microsoft.com/en-us/library/ee923685.aspx Web Performance Test Walkthroughs http://msdn.microsoft.com/en-us/library/aa337591.aspx Load Test Walkthroughs http://msdn.microsoft.com/en-us/library/ff406963.aspx Walkthrough: Using a Test Controller and Test Agents in a Load Test http://msdn.microsoft.com/en-us/library/ff400223.aspx
  • 26. We value your feedback! Please remember to complete the overall conference evaluation form and return it to the Registration Counter.