SlideShare uma empresa Scribd logo
1 de 2
Baixar para ler offline
CASE STUDY


Third-Party LSPS Evaluation Ensures
Successful Product Deployment

                                                 STAG’s evaluation of a eCommodity finance
                                                   application for load, performance, and scalability
                                                   among concurrent users for an IT services
                                                   company ensures successful deployment of the
                                                  product at a leading commercial bank in India.




                                                                         Technology - Web, Java
           Domain - Banking and Finance
                                                                         Tools - JMeter




CUSTOMER AND PRODUCT BACKGROUND
The customer is an IT services company focused on designing, developing, and maintaining customized business solutions
in the domains of finance, travel, and compliance management.


The product in question is an integrated Web-based solution for banks in the commodity finance segment covering the
lifecycle of commercial operations – account sourcing, operations, monitoring and control, recovery management, audit,
and closure through repayment.



PROBLEM STATEMENT
The customer was looking for an independent expert to evaluate the product’s performance before deploying it at their
client’s end.


The performance of the product was suspect, with a large number of users accessing it. Hence, there was a demand from
their client for a third party evaluation of the product for concurrency among 600 users, a check of the system’s load
handling capacity – by replicating ‘third’ year usage – and also of its endurance and stress capability.
SOLUTION
STAG team devised an automation solution to include the
following:                                                                                         Data records created: 40000 loan
                                                                                                   booking records and 50000 loan
Deriving the Operational Profile                                                                   liquidation records
The team captured the key operations for the test, the arrival
rates for each of these operations, the number of concurrent                                       New set of test cases automated by
users for each operation, and the number of ‘think times’ for                                      the client QA team: 120
each operation to ensure that the test simulation was
realistic.


Script Development
The team then developed scripts for 40 operations that were identified. The objective was to use the same scripts for both
data population and test execution. The team adopted a data driven approach to drive the operations with a unique and
relevant set of data. Workarounds were developed for tool limitations like uploading and viewing images from the Java
applet that gets loaded into the Web application.


Test Data Population
After interactions with the customer, the team identified the test data sets to be populated. One of the key objectives of
this exercise was to avoid creation of incorrect data sets that would lead to incorrect results. Hence, it was important to
understand the impact of creating the required data sets for the actual test. Issues related to the database were fixed,
thereby resolving the problem of performance deadlock.


Test Execution
Load and performance tests were conducted for three different combinations of operations, with the mix of the number
of operations being different for each combination. This was done to simulate the peak load for specific operations in each
combination. An eight-hour endurance test was conducted to simulate the one-month usage of the system, with the
intention of finding any potential memory leaks. The team also conducted a stress test by increasing the user think times
and the number of concurrent users.


Analysis
The STAG team modified the existing framework to bring in flexibility to scale and support new features or to maintain the
existing libraries to support the changes in the application. As a result, the client QA team was able to successfully
automate a new set of 120 test cases with a 50% reduction in effort.


Besides, the team also addressed issues related to configuration on web server, fine-tuned database queries and open
connections, and tweaked search filter options for report generation, that helped improve the end-user experience.


OUTCOME AND VALUE ADDITIONS
The automation solution provided by the STAG team helped uncover many performance issues in the existing system and
fix them.


The product was certified to handle 600 concurrent users for the ‘third year’ usage and all performance issues were
resolved as well. Along with this, recommendations were also made that largely enhanced the customer’s release
confidence to successfully deploy the product at their client end.



Visit: www.stagsoftware.com | E-mail: marketing@stagsoftware.com
Bangalore: +91 80 28495574 / 41263009 | Chennai: +91 44 4214 3469 / 2442 0396


2013 © STAG Software Private Limited. All rights reserved. HBT is the IP of STAG Software Private Limited. All trademarks are acknowledged.

Mais conteúdo relacionado

Mais de STAG Software Private Limited

Mais de STAG Software Private Limited (20)

Is regression hindering your progression?
Is regression hindering your progression?Is regression hindering your progression?
Is regression hindering your progression?
 
The Power of Checklist
The Power of ChecklistThe Power of Checklist
The Power of Checklist
 
The power of checklist
The power of checklist The power of checklist
The power of checklist
 
Webinar - 'Test Case Immunity’- Optimize testing
Webinar - 'Test Case Immunity’- Optimize testing Webinar - 'Test Case Immunity’- Optimize testing
Webinar - 'Test Case Immunity’- Optimize testing
 
Design Scientifically (How to test a user story)
Design Scientifically (How to test a user story)Design Scientifically (How to test a user story)
Design Scientifically (How to test a user story)
 
Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)
 
Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)
 
Language shapes the way you think
Language shapes the way you thinkLanguage shapes the way you think
Language shapes the way you think
 
Deliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization ToolDeliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization Tool
 
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
 
Are Your Test Cases Fit For Automation?
Are Your Test Cases Fit For Automation?Are Your Test Cases Fit For Automation?
Are Your Test Cases Fit For Automation?
 
Think better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” ApproachThink better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” Approach
 
Improving Defect Yield - a three step approach
Improving Defect Yield - a three step approachImproving Defect Yield - a three step approach
Improving Defect Yield - a three step approach
 
Regression Suite Optimization
Regression Suite OptimizationRegression Suite Optimization
Regression Suite Optimization
 
Reflect and Change
Reflect and ChangeReflect and Change
Reflect and Change
 
Test Process Transformation Protects Product Development Investment
Test Process Transformation Protects Product Development InvestmentTest Process Transformation Protects Product Development Investment
Test Process Transformation Protects Product Development Investment
 
Agile Sutra "Do more by doing less, Prevent rather than detect"
Agile Sutra "Do more by doing less, Prevent rather than detect"Agile Sutra "Do more by doing less, Prevent rather than detect"
Agile Sutra "Do more by doing less, Prevent rather than detect"
 
Intelligent Automation and Smart Tooling
Intelligent Automation and Smart ToolingIntelligent Automation and Smart Tooling
Intelligent Automation and Smart Tooling
 
Enhanced Delivery Confidence Improved Product Maturity
Enhanced Delivery Confidence Improved Product MaturityEnhanced Delivery Confidence Improved Product Maturity
Enhanced Delivery Confidence Improved Product Maturity
 
Too Many Conditions!
Too Many Conditions!Too Many Conditions!
Too Many Conditions!
 

Último

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 

Último (20)

Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Evaluating the top large language models.pdf
Evaluating the top large language models.pdfEvaluating the top large language models.pdf
Evaluating the top large language models.pdf
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 

Third-Party LSPS Evaluation Ensures Successful Product Deployment

  • 1. CASE STUDY Third-Party LSPS Evaluation Ensures Successful Product Deployment STAG’s evaluation of a eCommodity finance application for load, performance, and scalability among concurrent users for an IT services company ensures successful deployment of the product at a leading commercial bank in India. Technology - Web, Java Domain - Banking and Finance Tools - JMeter CUSTOMER AND PRODUCT BACKGROUND The customer is an IT services company focused on designing, developing, and maintaining customized business solutions in the domains of finance, travel, and compliance management. The product in question is an integrated Web-based solution for banks in the commodity finance segment covering the lifecycle of commercial operations – account sourcing, operations, monitoring and control, recovery management, audit, and closure through repayment. PROBLEM STATEMENT The customer was looking for an independent expert to evaluate the product’s performance before deploying it at their client’s end. The performance of the product was suspect, with a large number of users accessing it. Hence, there was a demand from their client for a third party evaluation of the product for concurrency among 600 users, a check of the system’s load handling capacity – by replicating ‘third’ year usage – and also of its endurance and stress capability.
  • 2. SOLUTION STAG team devised an automation solution to include the following: Data records created: 40000 loan booking records and 50000 loan Deriving the Operational Profile liquidation records The team captured the key operations for the test, the arrival rates for each of these operations, the number of concurrent New set of test cases automated by users for each operation, and the number of ‘think times’ for the client QA team: 120 each operation to ensure that the test simulation was realistic. Script Development The team then developed scripts for 40 operations that were identified. The objective was to use the same scripts for both data population and test execution. The team adopted a data driven approach to drive the operations with a unique and relevant set of data. Workarounds were developed for tool limitations like uploading and viewing images from the Java applet that gets loaded into the Web application. Test Data Population After interactions with the customer, the team identified the test data sets to be populated. One of the key objectives of this exercise was to avoid creation of incorrect data sets that would lead to incorrect results. Hence, it was important to understand the impact of creating the required data sets for the actual test. Issues related to the database were fixed, thereby resolving the problem of performance deadlock. Test Execution Load and performance tests were conducted for three different combinations of operations, with the mix of the number of operations being different for each combination. This was done to simulate the peak load for specific operations in each combination. An eight-hour endurance test was conducted to simulate the one-month usage of the system, with the intention of finding any potential memory leaks. The team also conducted a stress test by increasing the user think times and the number of concurrent users. Analysis The STAG team modified the existing framework to bring in flexibility to scale and support new features or to maintain the existing libraries to support the changes in the application. As a result, the client QA team was able to successfully automate a new set of 120 test cases with a 50% reduction in effort. Besides, the team also addressed issues related to configuration on web server, fine-tuned database queries and open connections, and tweaked search filter options for report generation, that helped improve the end-user experience. OUTCOME AND VALUE ADDITIONS The automation solution provided by the STAG team helped uncover many performance issues in the existing system and fix them. The product was certified to handle 600 concurrent users for the ‘third year’ usage and all performance issues were resolved as well. Along with this, recommendations were also made that largely enhanced the customer’s release confidence to successfully deploy the product at their client end. Visit: www.stagsoftware.com | E-mail: marketing@stagsoftware.com Bangalore: +91 80 28495574 / 41263009 | Chennai: +91 44 4214 3469 / 2442 0396 2013 © STAG Software Private Limited. All rights reserved. HBT is the IP of STAG Software Private Limited. All trademarks are acknowledged.