SlideShare uma empresa Scribd logo
1 de 3
Baixar para ler offline
1 Extreme Automation Enables Satellite TV Provider to ”Shift Left” API Testing
”Shifting Left” Testing with Extreme Automation
Recently, the Enterprise Integration group, which is responsible for ensuring the integrity of the
REST and SOAP APIs associated with the company’s business enablement systems, grew concerned
that the accelerating pace of development was cutting into the time available for testing. They
began exploring ways to optimize their testing efforts so that shrinking test windows would not
require them to compromise their exhaustive testing and stringent quality processes.
After exploring several API testing solutions, the group determined that Parasoft’s solution was the
best fit for their needs due to its mature enterprise-grade functionality, extensive set of built-in
validation tools, and ability to create robust, flexible, and highly-reusable test assets.
By applying extreme automation to their API testing, the Enterprise Integration group was able
to significantly reduce the time required to construct, execute, evaluate, and manage their test
scenarios. Shortly after adopting Parasoft’s API Testing solution, the team quickly developed into
“power users,” taking full advantage of the solution’s flexibility to automate their complex test and
validation processes. As a result, they can not only test significantly faster than they did previously,
but also test more extensively.
The team’s investment in automation has helped them achieve nearly 100% regression test
coverage. “Previously, it took us 3 days to run a regression test suite that consisted of about 500
test cases which primarily covered the highest-traffic transactions,” the Enterprise Integration
group’s QA Lead explained. “Now, in the same 3 days, we’re able to cover approximately 3500 test
cases—and we’re adding from 400-1000 new test cases to the suite with each release.”
This expanded test coverage has made it much easier for the team to uncover many types of edge
scenario issues that are extremely time-consuming to find via manual testing. “Software issues
escaped to production have a very direct impact on customer satisfaction, so we’ve always made it
top priority to maintain an industry-low rate of escaping defects,” the group’s QA Lead noted. “With
this automation, we’ve been able to further reduce the rate of escaping defects by about 60-70%.”
Committed to leading the market in customer satisfaction, DirecTV is continuously enhancing
and upgrading the business enablement systems that drive communications across the
disparate systems critical to their business. Ensuring positive, seamless customer experiences
with everything from programming, to billing, to customer support depends on data being
properly translated and moved between core systems. Using Parasoft API Testing solution to
automate a complex manual testing process, the company’s Enterprise Integration group has
dramatically increased the speed and scope of their testing—enabling them to bring
top-quality software innovations to market in record time. This helps DirecTV foster high
customer satisfaction and bolster their competitive edge.
Extreme Automation Enables
DirecTV to ”Shift Left” API Testing
2 Extreme Automation Enables Satellite TV Provider to ”Shift Left” API Testing
Advancing from Manual Testing to Extreme Automation
Some specific ways that the team squeezed more testing into shorter test cycles include:
Previously With Parasoft API Testing Solution
The team had to wait for the preparation and
delivery of data that met their very specific
data requirements in each iteration—then
manually incorporate the data into their test
scenarios.
Tests automatically retrieve and use the
most recent data from the appropriate data
sources at the time of test execution. No
waiting or test updating is required.
Manual inspection of the response message
was required to determine whether test
transactions were successful and, if not, to
identify exactly where the problem occurred.
Given that a single manual validation could
take up to an hour, validation of the complete
message (with thousands of rows of data)
simply was not feasible. Tests focused
exclusively on data that was expected to
change.
5000+ fully-automated validations all run
completely unattended and report results
through the HP ALM (the team’s primary test
management system). Each end-to-end test
includes myriad intra-process validations to
ensure that even the most subtle problems
are exposed and to help the team rapidly
pinpoint the source of test failures. These
tests cover corner cases and expose any
regressions impacting existing functionality.
Tests had to be manually repeated in the
various test environments (development,
staging, triage, etc.).
Flexible tests are built once, and reused
across all of the required environments with
zero test updating required. This allows them
to begin testing in each environment the
moment that the application under test is
deployed there.
Manual testing required a very specific skill
set. Each time a domain expert left the team,
it was difficult to find someone with the
expertise required to continue the same level
of testing.
Automated tests capture domain experts’
knowledge. Tests can be executed by any
team member, and new team members
can get up to speed quickly by studying the
existing set of test artifacts.
Mitigating the Risks of Middleware Migration
Having a robust set of reusable tests is also helping the team ensure the integrity of core functionality
during their multi-year middleware migration process. The test assets they built over time essentially
place “bracers” around the legacy functionality. Whenever a part of the infrastructure is updated,
the team’s existing test suites automatically determine if the modifications impacted the existing
functionality.
This automated regression testing allows the company to upgrade with confidence—enabling
them to continuously optimize the performance and reliability of their systems without risking any
negative impact to customer or partner experiences.
3
© Parasoft Corporation All rights reserved. Parasoft and all Parasoft products and services listed within are trademarks or registered trademarks of Parasoft Corporation.
All other products, services, and companies are trademarks, registered trademarks, or servicemarks of their respective holders in the US and/or other countries.
USA PARASOFT HEADQUARTERS
101 E. Huntington Drive, Monrovia, CA 91016
Phone: (888) 305-0041, Email: info@parasoft.com
Extreme Automation Enables Satellite TV Provider to ”Shift Left” API Testing
Next Steps: ”Shifting Left” Further into Development
The teams’ success at “shifting left” their regression testing, which is now completed in parallel
with their functional testing, has already had a major impact on the speed and length of delivery
cycles. The next step in their optimization efforts will be to roll out the solution to the development
team so they can create and execute basic tests for each service before passing it on to QA.
In addition to enabling test execution, reporting, and analysis directly within the HP ALM environment
where testers spend the majority of their time, Parasoft API Testing solution also integrates into
Eclipse, which is the company’s standard development environment. After completing a service,
developers can use the solution to build basic tests that verify whether that service works properly.
With these service-level tests augmenting their current unit testing efforts, developers will have
additional feedback on whether a service is truly “done” before move they move on to the next
development task. These tests will also extend the development regression test suite, reducing the
risk that an inadvertent change to existing functionality could progress to the next phase of the SDLC.
In terms of QA, the Enterprise Integration group’s QA Lead anticipates that this approach will yield
several benefits:
	 Since defects will be exposed earlier, QA will gain a more stable testing environment.
A defect that escapes development can impact multiple systems, preventing the QA team
frombeingabletoexecutefunctionalorregressiontests.Duetothehighly-interconnected
nature of their systems, just one defect can commonly limit or block testing for up to
4 days.
	 The developers’ tests will serve as “building blocks” that QA can integrate and extend as
they design their end-to-end test scenarios.
	 Collaborating with development, QA can start designing functional tests even earlier
in each cycle.

Mais conteúdo relacionado

Mais procurados

Aspires Testing Services Presentation
Aspires Testing Services PresentationAspires Testing Services Presentation
Aspires Testing Services Presentation
Vasanthmusic
 

Mais procurados (20)

5 Key Steps to Effective SAP Testing
5 Key Steps to Effective SAP Testing  5 Key Steps to Effective SAP Testing
5 Key Steps to Effective SAP Testing
 
Aspires Testing Services Presentation
Aspires Testing Services PresentationAspires Testing Services Presentation
Aspires Testing Services Presentation
 
Continuous testing webinar 041017 slideshare
Continuous testing webinar 041017 slideshareContinuous testing webinar 041017 slideshare
Continuous testing webinar 041017 slideshare
 
Software testing and test environment​
Software testing and test environment​Software testing and test environment​
Software testing and test environment​
 
Enhops Services & Capabilities
Enhops Services & CapabilitiesEnhops Services & Capabilities
Enhops Services & Capabilities
 
Software testing services growth report oct 11
Software testing services growth report oct 11Software testing services growth report oct 11
Software testing services growth report oct 11
 
Benefits of QA automation
Benefits of QA automationBenefits of QA automation
Benefits of QA automation
 
How to Fit Performance Testing into a DevOps Environment
How to Fit Performance Testing into a DevOps EnvironmentHow to Fit Performance Testing into a DevOps Environment
How to Fit Performance Testing into a DevOps Environment
 
Ashwini - Effective use of CI by QA
Ashwini - Effective use of CI by QAAshwini - Effective use of CI by QA
Ashwini - Effective use of CI by QA
 
EXTENT-2016: The Future of Software Testing
EXTENT-2016:	 The Future of Software TestingEXTENT-2016:	 The Future of Software Testing
EXTENT-2016: The Future of Software Testing
 
Cost of Quality How to Save Money
Cost of Quality How to Save MoneyCost of Quality How to Save Money
Cost of Quality How to Save Money
 
What is sanity testing
What is sanity testingWhat is sanity testing
What is sanity testing
 
An Essential Guide to Effective Test Automation Leveraging Open Source
An Essential Guide to Effective Test Automation Leveraging Open SourceAn Essential Guide to Effective Test Automation Leveraging Open Source
An Essential Guide to Effective Test Automation Leveraging Open Source
 
MESUT DURUKAL «4 Pillars of Successful Agile Test Automation» Online QADay 2021
MESUT DURUKAL «4 Pillars of Successful Agile Test Automation» Online QADay 2021MESUT DURUKAL «4 Pillars of Successful Agile Test Automation» Online QADay 2021
MESUT DURUKAL «4 Pillars of Successful Agile Test Automation» Online QADay 2021
 
Deploy + Destroy Complete Test Environments
Deploy + Destroy Complete Test EnvironmentsDeploy + Destroy Complete Test Environments
Deploy + Destroy Complete Test Environments
 
Test environment management anti patterns
Test environment management anti patterns Test environment management anti patterns
Test environment management anti patterns
 
Difference between crowd testing & in house QA
Difference between crowd testing & in house QADifference between crowd testing & in house QA
Difference between crowd testing & in house QA
 
Role of Test Automation in Agile and DevOps
Role of Test Automation in Agile and DevOpsRole of Test Automation in Agile and DevOps
Role of Test Automation in Agile and DevOps
 
User Acceptance Testing in the Testing Center of Excellence
User Acceptance Testing in the Testing Center of ExcellenceUser Acceptance Testing in the Testing Center of Excellence
User Acceptance Testing in the Testing Center of Excellence
 
Best Practises In Test Automation
Best Practises In Test AutomationBest Practises In Test Automation
Best Practises In Test Automation
 

Destaque (6)

Acta 20-de-julio
Acta 20-de-julioActa 20-de-julio
Acta 20-de-julio
 
Software Safety and Security Through Standards
Software Safety and Security Through Standards Software Safety and Security Through Standards
Software Safety and Security Through Standards
 
How earn money from blog
How earn money from blogHow earn money from blog
How earn money from blog
 
How to increase youtube traffic
How to increase youtube trafficHow to increase youtube traffic
How to increase youtube traffic
 
What does ghostwriting mean
What does ghostwriting meanWhat does ghostwriting mean
What does ghostwriting mean
 
Networking topology
Networking topologyNetworking topology
Networking topology
 

Semelhante a Extreme Automation Enables DirecTV to ”Shift Left” API Testing

Performance Test Slideshow Recent
Performance Test Slideshow RecentPerformance Test Slideshow Recent
Performance Test Slideshow Recent
Future Simmons
 
Performance Test Slideshow R E C E N T
Performance Test Slideshow R E C E N TPerformance Test Slideshow R E C E N T
Performance Test Slideshow R E C E N T
Future Simmons
 
ParasoftServiceVirtualizationAPITestingIgnis
ParasoftServiceVirtualizationAPITestingIgnisParasoftServiceVirtualizationAPITestingIgnis
ParasoftServiceVirtualizationAPITestingIgnis
Sonya S
 

Semelhante a Extreme Automation Enables DirecTV to ”Shift Left” API Testing (20)

Need for automation testing
Need for automation testingNeed for automation testing
Need for automation testing
 
Mantra Tech Overview.pdf
Mantra Tech Overview.pdfMantra Tech Overview.pdf
Mantra Tech Overview.pdf
 
QA.pdf
QA.pdfQA.pdf
QA.pdf
 
Impact of QAOps on Software Quality
Impact of QAOps on Software QualityImpact of QAOps on Software Quality
Impact of QAOps on Software Quality
 
Automation testing
Automation testingAutomation testing
Automation testing
 
Benefits of regression testing
Benefits of regression testingBenefits of regression testing
Benefits of regression testing
 
Test Orchestration and Its Need for Successful Automation (2).pdf
Test Orchestration and Its Need for Successful Automation (2).pdfTest Orchestration and Its Need for Successful Automation (2).pdf
Test Orchestration and Its Need for Successful Automation (2).pdf
 
Testing frameworks
Testing frameworksTesting frameworks
Testing frameworks
 
Performance Test Slideshow Recent
Performance Test Slideshow RecentPerformance Test Slideshow Recent
Performance Test Slideshow Recent
 
Performance Test Slideshow R E C E N T
Performance Test Slideshow R E C E N TPerformance Test Slideshow R E C E N T
Performance Test Slideshow R E C E N T
 
Reducing the complexity of your Enterprise Packaged Application Automation Te...
Reducing the complexity of your Enterprise Packaged Application Automation Te...Reducing the complexity of your Enterprise Packaged Application Automation Te...
Reducing the complexity of your Enterprise Packaged Application Automation Te...
 
An Ultimate Guide to Continuous Testing in Agile Projects.pdf
An Ultimate Guide to Continuous Testing in Agile Projects.pdfAn Ultimate Guide to Continuous Testing in Agile Projects.pdf
An Ultimate Guide to Continuous Testing in Agile Projects.pdf
 
Top Benefits of Automation Testing for a Successful Product Release.pdf
Top Benefits of Automation Testing for a Successful Product Release.pdfTop Benefits of Automation Testing for a Successful Product Release.pdf
Top Benefits of Automation Testing for a Successful Product Release.pdf
 
ParasoftServiceVirtualizationAPITestingIgnis
ParasoftServiceVirtualizationAPITestingIgnisParasoftServiceVirtualizationAPITestingIgnis
ParasoftServiceVirtualizationAPITestingIgnis
 
Software Testing Concepts
Software Testing  ConceptsSoftware Testing  Concepts
Software Testing Concepts
 
Non-Functional testing
Non-Functional testingNon-Functional testing
Non-Functional testing
 
Upstream testing.
Upstream testing.Upstream testing.
Upstream testing.
 
Best ERP Testing Practices for Large Organizations
Best ERP Testing Practices for Large OrganizationsBest ERP Testing Practices for Large Organizations
Best ERP Testing Practices for Large Organizations
 
Everything You Need to Know About Regression Testing Automation.pdf
Everything You Need to Know About Regression Testing Automation.pdfEverything You Need to Know About Regression Testing Automation.pdf
Everything You Need to Know About Regression Testing Automation.pdf
 
Mastering Continuous Testing_ A Definitive Guide to Seamless Software Deliver...
Mastering Continuous Testing_ A Definitive Guide to Seamless Software Deliver...Mastering Continuous Testing_ A Definitive Guide to Seamless Software Deliver...
Mastering Continuous Testing_ A Definitive Guide to Seamless Software Deliver...
 

Mais de Parasoft

AppsSec In a DevOps World
AppsSec In a DevOps WorldAppsSec In a DevOps World
AppsSec In a DevOps World
Parasoft
 

Mais de Parasoft (16)

Better Software East 2016: Evolving Automated to Continuous
Better Software East 2016: Evolving Automated to ContinuousBetter Software East 2016: Evolving Automated to Continuous
Better Software East 2016: Evolving Automated to Continuous
 
ABC's of Service Virtualization
ABC's of Service VirtualizationABC's of Service Virtualization
ABC's of Service Virtualization
 
The Legend of Software Hollow: Defeating the Headless Horseman of Faulty Appl...
The Legend of Software Hollow: Defeating the Headless Horseman of Faulty Appl...The Legend of Software Hollow: Defeating the Headless Horseman of Faulty Appl...
The Legend of Software Hollow: Defeating the Headless Horseman of Faulty Appl...
 
AppsSec In a DevOps World
AppsSec In a DevOps WorldAppsSec In a DevOps World
AppsSec In a DevOps World
 
Driving Risks Out of Embedded Automotive Software
Driving Risks Out of Embedded Automotive SoftwareDriving Risks Out of Embedded Automotive Software
Driving Risks Out of Embedded Automotive Software
 
Rx for FDA Software Compliance
Rx for FDA Software ComplianceRx for FDA Software Compliance
Rx for FDA Software Compliance
 
MedicAlert API Testing Case Study
MedicAlert API Testing Case StudyMedicAlert API Testing Case Study
MedicAlert API Testing Case Study
 
End-to-end Testing for IoT Integrity
End-to-end Testing for IoT IntegrityEnd-to-end Testing for IoT Integrity
End-to-end Testing for IoT Integrity
 
Leveraging Static Analysis to Secure Software
Leveraging Static Analysis to Secure SoftwareLeveraging Static Analysis to Secure Software
Leveraging Static Analysis to Secure Software
 
BUSTED! How to Find Security Bugs Fast!
BUSTED! How to Find Security Bugs Fast!BUSTED! How to Find Security Bugs Fast!
BUSTED! How to Find Security Bugs Fast!
 
Are Your Continuous Tests Too Fragile for Agile?
Are Your Continuous Tests Too Fragile for Agile?Are Your Continuous Tests Too Fragile for Agile?
Are Your Continuous Tests Too Fragile for Agile?
 
Software Development Metrics You Can Count On
Software Development Metrics You Can Count On Software Development Metrics You Can Count On
Software Development Metrics You Can Count On
 
Accelerating Mobile Testing
Accelerating Mobile TestingAccelerating Mobile Testing
Accelerating Mobile Testing
 
C/C++test Qualification Kit for DO-178B/C Compliance
C/C++test Qualification Kit for DO-178B/C ComplianceC/C++test Qualification Kit for DO-178B/C Compliance
C/C++test Qualification Kit for DO-178B/C Compliance
 
A Comparison of Three Bug-Finding Techniques and Their Relative Effectiveness
A Comparison of Three Bug-Finding Techniques and Their Relative EffectivenessA Comparison of Three Bug-Finding Techniques and Their Relative Effectiveness
A Comparison of Three Bug-Finding Techniques and Their Relative Effectiveness
 
How to Avoid Continuously Delivering Faulty Software
How to Avoid Continuously Delivering Faulty SoftwareHow to Avoid Continuously Delivering Faulty Software
How to Avoid Continuously Delivering Faulty Software
 

Último

introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdfintroduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
VishalKumarJha10
 
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM TechniquesAI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
VictorSzoltysek
 

Último (20)

The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
 
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdfintroduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf
 
Exploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdfExploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdf
 
A Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxA Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docx
 
Azure_Native_Qumulo_High_Performance_Compute_Benchmarks.pdf
Azure_Native_Qumulo_High_Performance_Compute_Benchmarks.pdfAzure_Native_Qumulo_High_Performance_Compute_Benchmarks.pdf
Azure_Native_Qumulo_High_Performance_Compute_Benchmarks.pdf
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
 
Optimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTVOptimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTV
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
 
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
 
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
 
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 
Software Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsSoftware Quality Assurance Interview Questions
Software Quality Assurance Interview Questions
 
Introducing Microsoft’s new Enterprise Work Management (EWM) Solution
Introducing Microsoft’s new Enterprise Work Management (EWM) SolutionIntroducing Microsoft’s new Enterprise Work Management (EWM) Solution
Introducing Microsoft’s new Enterprise Work Management (EWM) Solution
 
AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM TechniquesAI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
 
Unlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language ModelsUnlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language Models
 
Diamond Application Development Crafting Solutions with Precision
Diamond Application Development Crafting Solutions with PrecisionDiamond Application Development Crafting Solutions with Precision
Diamond Application Development Crafting Solutions with Precision
 
Microsoft AI Transformation Partner Playbook.pdf
Microsoft AI Transformation Partner Playbook.pdfMicrosoft AI Transformation Partner Playbook.pdf
Microsoft AI Transformation Partner Playbook.pdf
 
Define the academic and professional writing..pdf
Define the academic and professional writing..pdfDefine the academic and professional writing..pdf
Define the academic and professional writing..pdf
 
5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf
 

Extreme Automation Enables DirecTV to ”Shift Left” API Testing

  • 1. 1 Extreme Automation Enables Satellite TV Provider to ”Shift Left” API Testing ”Shifting Left” Testing with Extreme Automation Recently, the Enterprise Integration group, which is responsible for ensuring the integrity of the REST and SOAP APIs associated with the company’s business enablement systems, grew concerned that the accelerating pace of development was cutting into the time available for testing. They began exploring ways to optimize their testing efforts so that shrinking test windows would not require them to compromise their exhaustive testing and stringent quality processes. After exploring several API testing solutions, the group determined that Parasoft’s solution was the best fit for their needs due to its mature enterprise-grade functionality, extensive set of built-in validation tools, and ability to create robust, flexible, and highly-reusable test assets. By applying extreme automation to their API testing, the Enterprise Integration group was able to significantly reduce the time required to construct, execute, evaluate, and manage their test scenarios. Shortly after adopting Parasoft’s API Testing solution, the team quickly developed into “power users,” taking full advantage of the solution’s flexibility to automate their complex test and validation processes. As a result, they can not only test significantly faster than they did previously, but also test more extensively. The team’s investment in automation has helped them achieve nearly 100% regression test coverage. “Previously, it took us 3 days to run a regression test suite that consisted of about 500 test cases which primarily covered the highest-traffic transactions,” the Enterprise Integration group’s QA Lead explained. “Now, in the same 3 days, we’re able to cover approximately 3500 test cases—and we’re adding from 400-1000 new test cases to the suite with each release.” This expanded test coverage has made it much easier for the team to uncover many types of edge scenario issues that are extremely time-consuming to find via manual testing. “Software issues escaped to production have a very direct impact on customer satisfaction, so we’ve always made it top priority to maintain an industry-low rate of escaping defects,” the group’s QA Lead noted. “With this automation, we’ve been able to further reduce the rate of escaping defects by about 60-70%.” Committed to leading the market in customer satisfaction, DirecTV is continuously enhancing and upgrading the business enablement systems that drive communications across the disparate systems critical to their business. Ensuring positive, seamless customer experiences with everything from programming, to billing, to customer support depends on data being properly translated and moved between core systems. Using Parasoft API Testing solution to automate a complex manual testing process, the company’s Enterprise Integration group has dramatically increased the speed and scope of their testing—enabling them to bring top-quality software innovations to market in record time. This helps DirecTV foster high customer satisfaction and bolster their competitive edge. Extreme Automation Enables DirecTV to ”Shift Left” API Testing
  • 2. 2 Extreme Automation Enables Satellite TV Provider to ”Shift Left” API Testing Advancing from Manual Testing to Extreme Automation Some specific ways that the team squeezed more testing into shorter test cycles include: Previously With Parasoft API Testing Solution The team had to wait for the preparation and delivery of data that met their very specific data requirements in each iteration—then manually incorporate the data into their test scenarios. Tests automatically retrieve and use the most recent data from the appropriate data sources at the time of test execution. No waiting or test updating is required. Manual inspection of the response message was required to determine whether test transactions were successful and, if not, to identify exactly where the problem occurred. Given that a single manual validation could take up to an hour, validation of the complete message (with thousands of rows of data) simply was not feasible. Tests focused exclusively on data that was expected to change. 5000+ fully-automated validations all run completely unattended and report results through the HP ALM (the team’s primary test management system). Each end-to-end test includes myriad intra-process validations to ensure that even the most subtle problems are exposed and to help the team rapidly pinpoint the source of test failures. These tests cover corner cases and expose any regressions impacting existing functionality. Tests had to be manually repeated in the various test environments (development, staging, triage, etc.). Flexible tests are built once, and reused across all of the required environments with zero test updating required. This allows them to begin testing in each environment the moment that the application under test is deployed there. Manual testing required a very specific skill set. Each time a domain expert left the team, it was difficult to find someone with the expertise required to continue the same level of testing. Automated tests capture domain experts’ knowledge. Tests can be executed by any team member, and new team members can get up to speed quickly by studying the existing set of test artifacts. Mitigating the Risks of Middleware Migration Having a robust set of reusable tests is also helping the team ensure the integrity of core functionality during their multi-year middleware migration process. The test assets they built over time essentially place “bracers” around the legacy functionality. Whenever a part of the infrastructure is updated, the team’s existing test suites automatically determine if the modifications impacted the existing functionality. This automated regression testing allows the company to upgrade with confidence—enabling them to continuously optimize the performance and reliability of their systems without risking any negative impact to customer or partner experiences.
  • 3. 3 © Parasoft Corporation All rights reserved. Parasoft and all Parasoft products and services listed within are trademarks or registered trademarks of Parasoft Corporation. All other products, services, and companies are trademarks, registered trademarks, or servicemarks of their respective holders in the US and/or other countries. USA PARASOFT HEADQUARTERS 101 E. Huntington Drive, Monrovia, CA 91016 Phone: (888) 305-0041, Email: info@parasoft.com Extreme Automation Enables Satellite TV Provider to ”Shift Left” API Testing Next Steps: ”Shifting Left” Further into Development The teams’ success at “shifting left” their regression testing, which is now completed in parallel with their functional testing, has already had a major impact on the speed and length of delivery cycles. The next step in their optimization efforts will be to roll out the solution to the development team so they can create and execute basic tests for each service before passing it on to QA. In addition to enabling test execution, reporting, and analysis directly within the HP ALM environment where testers spend the majority of their time, Parasoft API Testing solution also integrates into Eclipse, which is the company’s standard development environment. After completing a service, developers can use the solution to build basic tests that verify whether that service works properly. With these service-level tests augmenting their current unit testing efforts, developers will have additional feedback on whether a service is truly “done” before move they move on to the next development task. These tests will also extend the development regression test suite, reducing the risk that an inadvertent change to existing functionality could progress to the next phase of the SDLC. In terms of QA, the Enterprise Integration group’s QA Lead anticipates that this approach will yield several benefits: Since defects will be exposed earlier, QA will gain a more stable testing environment. A defect that escapes development can impact multiple systems, preventing the QA team frombeingabletoexecutefunctionalorregressiontests.Duetothehighly-interconnected nature of their systems, just one defect can commonly limit or block testing for up to 4 days. The developers’ tests will serve as “building blocks” that QA can integrate and extend as they design their end-to-end test scenarios. Collaborating with development, QA can start designing functional tests even earlier in each cycle.