2. www.ekatechserv.com
EKA Testing Services
Bringing decades of testing experience to you
• Founded by
– Dr. Prakash Mutalik (Co-founder of RelQ – acquired by EDS, now part of HP), a
pioneer in Software Testing
• Our focus
– Testing & Knowledge Management technology, tools and Services
• Our objectives
– help customers improve business performance through increased efficiencies by
using our products and services
• We are not another testing company
– are a technology company venturing into newer models of Testing Engagements
and Delivery (though ‘cloud’)
About
Us
2
3. www.ekatechserv.com
EKA’s product and
services
With vast experience in hundreds of testing projects (functionality
testing, test automation and performance testing ) in the last 15 years,
EKA has developed test frameworks, technology and tools which help
in doing cost effective and efficient testing
– CBTF, a cloud based test platform with built-in test phases and templates for
‘functionality testing’ makes testing more efficient and significantly reduces cost of
testing
– EAF , a cloud based framework for conducting test automation using open source
tool ’selenium’
– Performance testing service using open-source tool ‘ Jmeter’
3
About
Us
4. www.ekatechserv.com
What is Performance
Testing?
“It is a testing to determine whether the current system meets the
performance requirements of time sensitive parameters such
as response times and the load of peak or high-volume
processing “.
Performance
Testing
4
Measuring Time Sensitive
Parameters under different loads
Analysis
Inputs to development team
for system tuning
6. www.ekatechserv.com
Why Performance
Testing?
It would be business disaster if the software released to the customer does not
respond within the stipulated times and does not respond well when the
system is loaded. Performance tests are performed to
find out if the performance acceptance criteria are met.
find out if the system/application has any serious performance issues when loaded
provide benchmark figures
find out architectural/design flaws
to find out if the system and the underlying hardware has been tuned for optimal
performance
Performance
Testing
6
7. www.ekatechserv.com
Performance Testing
Types
1. Performance testing – to analyze software/system response
times when performing different functions
2. Load/Volume testing – to examine whether the system
performs well under the normal specified load.
3. Stress/Endurance testing – to analyze how software/system
performs at peak loads or when it is stressed.
Performance
Testing
7
8. www.ekatechserv.com
Performance testing
tools
There are several proven tools the industry uses
• HP LoadRunner
• JMeter
• Silk Performer
While LoadRunner and Silk performer are
Commercial (paid ) tools, Jmeter is an
Open source tool. EKA has developed expertise in conducting
performance testing using Jmeter.
Performance
Testing
8
9. www.ekatechserv.com
Performance testing
benefits
• Evaluate Risk, Identifies critical decision points - Determine system
capabilities
• Early identification of major application defects and architectural issues helps
in scaling up
• Guaranteed customer satisfaction
• Builds confidence in the product
• Better Quality Software
Performance
Testing
9
10. www.ekatechserv.com
Our Approach
Performance
Requirement
Identify Work Load
Load Generation &
Execution
Monitoring
Analysis
Script Creation
Test Report
Identifying bottlenecks
and report to client
Gather requirements
Analyze requirements
Identify test scenarios
Identify user load pattern
Create Vuser scripts
Enhance the scripts
Generate the user load
Run the tests and collect
metrics
Performanc
e Testing
Monitor the servers
Gather performance data
Analyze the performance
data,Benchmarking
Prepare Performance test
execution report 10
Application
navigation using
Jmeter
12. www.ekatechserv.com
Some of the
performance metrics
• Response Time - The time it takes a request to fully load. From the time
the request is initiated until the time it is complete. This generally
indicates the performance level of the entire system under test (web
server + DB). This measure represents the average response time.
• Latency -Time until first response. The time it takes for the first byte to
be received as part of the response. This generally indicates the
performance level of the web server. This measurement represents the
average latency time at a certain minute of the test.
• Users -This measurement represents the number of active users at a
certain minute of the test.
• Hits -This measure represents the number of hits per minute at a certain
minute of the test.
• Errors -Errors generated by the server during the test and errors due to
connection timeouts, refusals or broken connections.
• Bandwidth -The amount of bandwidth used by a request or set of
requests.
• Throughput – Represents the number of requests/business transactions
processed by the product in a specified time duration
Performance
Testing
12
13. www.ekatechserv.com
Performance test
Analysis
• Analysing test results : During any scenario execution, the tool used for testing the performance records the application
performance under different test conditions. The graphs and reports obtained from the tool are used to analyse the
application’s performance
• Indicated below are samples of reports generated by performance testing tools which are helpful during the performance test
analysis
Performance
Testing
Response
time graph
Response
time vs user
load graph
Throughput vs user
load graph
13
14. www.ekatechserv.com
Performance
Engineering
• EKA makes use of the graphs and charts generated by the tool used for
performance testing to analyze the performance of the system
• EKA then identifies the possible bottlenecks in the system and reports the
same to the client
• EKA also takes up the activity of doing a retest after the system is tuned to
meet the performance requirements
Performance
Testing
14
15. www.ekatechserv.com
Case Study
Scope and Application type: To carry out load, stress testing and determine end user response time with application under load for a
reputed client on a web based trade deal application
Approach : Eka followed its Performance testing methodology with the use of the tool Jmeter
Project Execution: Objectives tested by simulating different workloads on the application
Observations:
The application breaks down once a load of 98 users is simulated
After 60 users, the application performance values are linearly increasing for transactions
From a performance perspective, the application can handle upto 60 users without any linear increase in response time
Deliverables: Average response time, throughput graphs with detailed analysis of the system performance subjected to increasing load and
number of users.
Benefits to client:
The overall performance testing and analysis carried out by EKA helped the client to scale the system upto 250 users
The client was able to tune the system based on the suggestions given by EKA
Performance
Testing
15
16. www.ekatechserv.com
Contact Us
Address
#890, 15th main, 5th cross, BTM Layout 2nd Stage, 1st phase,
Bangalore - 560076.
Contact
+91 7829 2541 69
Other information
General enquiry: info@ekatechserv.com
Sales enquiry: sales@ekatechserv.com
Job enquiry: careers@ekatechserv.com
Free consultation: testconsulting@ekatechserv.com
Contact
Us
16