StormRunner Load is the newest innovative HPE Software Solution for Agile Cloud testing. It is Simple, Smart and Scalable.
Simple: Because customer can now create and execute tests in less than 10 min. Very easy to create and simulate transactions, no need to create complex scripts
Smart: It provides real-time analytics, helping customers to find performance issues before moving apps to production.
Scalable: It allows customer to deploy load-generators across the globe via multiple cloud providers (Amazon, Azure and HP Helion). Customers can simulate from 1 to millions of virtual users within minutes.
2. 2
The age of savvy shoppers with high expectations
See in store, buy online.
Expects omnichannel
shopping across any device
Search on a mobile,
complete purchase on
desktop.
Websites has to be always
available and load in > 3s
Shops on mobile apps only.
Awesome user experience,
apps have to respond in
milliseconds
3. 3
The chain reaction of poor web/app performance
Low user
satisfaction
Decreased
user
retention
High
bounce
rate
Poor
brand
perception
Lost
revenue
Prevented by extensive performance testing
6. Factor in
different
worldwide
networks
See the impact
mobile users
have on your
back end
Because you need to
Simulate
realistic user
scenarios
and test your
CDNs
Double the size
of users from
last year
7. Introducing StormRunner Load
Real world cloud
locations via
AWS
Azure
Rackspace
Comprehensive
client, network
and server-side
breakdown
report
Built-in network
emulation with
various
worldwide
networks
Self serve with
1M+ VUsers
8. HPE StormRunner Load
Performance Testing in the Cloud for Web & Mobile Apps
Simple
Scalable
Smart
Design create a load test
In under 10 minutes
Real time predictive analytics
For quick problem isolation
1 to 1M+ Vusers
From real world locations
9. 1
Create and run a
load test using your
favorite scripting tool
2
Load Generators spin up
in AWS EC2 or MS Azure
3
Results and app
insights are available
in real time
How StormRunner works
New
New
New
10. Key features – easy test creation
Protocol coverage
Web and Mobile
TruClient
SAP
TruAPI
Open source
Test creation
HAR File
REST call
CSV File
Test definition
Real world cloud locations
No Hardware required
Built in network emulation from
Network Virtualization
Support for using own hardware /
testing inside the firewall
Test run scheduling
11. 11
Key features – monitors and integrations
Monitors
SiteScope – cloud and
on premise
New Relic
Dynatrace
Integrations
AWS, Azure,
Rackspace
Network Virtualization
WebPageTest
DevOps tools
Jenkins
AWS Code Pipeline
CLI Tool
REST API
12. 12
Key features – analysis
Online analysis
Real time results
Client side, server side, transaction breakdown
LG monitoring and script error logs
Online merging, splitting and filtering
Anomaly detection and SLA alerts
Snapshot on Error
Offline reporting
Client side breakdown report
Exportable offline report
Export in Word, PDF and CSV formats
13. 13
Key features – additional functionality
Collaboration
Multi user, multi test execution
Shared asset management
Tagging and folder structure
Project management and license sharing
Snapshot on error
Education
Online documentation
Public forum
Linkedin group
Youtube channel
14. Success Stories
Phase 1 (2015): The LoB purchased
StormRunner Load for its usability and
integrations
Phase 2 (2016): The LoB renewed and
CoE moved to StormRunner Load
Phase 1 in 2015: 600K VUsers in one
test, 900K VUsers in 2 concurrent tests.
Soasta lost because of higher price and
slower ramp up times
Phase 2 in 2016: Renewal of HPE
StormRunner Load for 3 years. Digital
LoB and CoE moved to StormRunner
Load
TCO analysis of running load tests
internally, including new hardware, is
easily over $3M
Even with operational cost included, the
Customer got a 75% cost savings
Time to market was immediate as there
was no time spent on purchasing and
setting up hardware
Describe type of shoppers and what their expectations are.
Discuss the impact, make a strong statement that poor performance is the root cause of all of those problems. And only extensive performance testing is the way to avoid all the consequences.
Talk about the implication. The above are real examples= Best Buys failing on black Friday because of heavy mobile traffic Ticketmaster failed when thousands of people tried to buy Adele tickets at the same time. The Australian government failed census- again because of many simultaneous users
Talk about the types of testing they need to perform in order to do realistic user scenarios
And explain why they need to do this type of testing
Show how our product matches up with those needs
Introduce the product, Open and Affordable
Supports Web(HTTP/HTML), Mobile (Web), Web Services, SAP (Web), TruClient, TruAPI, Flex, Java, SAP GUI, JMeter, Gatling
Integrates with HPE Sitescope, New Relic, Dynatrace, WebPageTest, HP Network Virtualization, HP Mobile Center
Protocol list, script feature coverage, versioning
Cloud vendors and locations, OPLG
Integrations – SiteScope, New Relic, Dynatrace, NV, WebPageTest, Jenkins, CLI, REST*, Code Pipeline, NGA*, Helion*
Testing
Test definition: basic scheduling; distribution; RTS; delayed execution; ip whitelisting; ip spoofing*; SLA and suggestion; easy test creation – HAR, REST, CSV
Test execution: online analysis, including client, monitor and breakdown; online merging, splitting and filtering; widget views; online anomaly detection and sla warnings; LG warnings; script errors
Offline analysis: client side breakdown; offline report; export as CSV or PDF; download logs
Collaboration: multi-users; asset management; tagging*; project management and license sharing*
Education: online documentation; public forum; linkedin group; youtube channel; irock group; TAW and design partnerships
Protocol list, script feature coverage, versioning
Cloud vendors and locations, OPLG
Integrations – SiteScope, New Relic, Dynatrace, NV, WebPageTest, Jenkins, CLI, REST*, Code Pipeline, NGA*, Helion*
Testing
Test definition: basic scheduling; distribution; RTS; delayed execution; ip whitelisting; ip spoofing*; SLA and suggestion; easy test creation – HAR, REST, CSV
Test execution: online analysis, including client, monitor and breakdown; online merging, splitting and filtering; widget views; online anomaly detection and sla warnings; LG warnings; script errors
Offline analysis: client side breakdown; offline report; export as CSV or PDF; download logs
Collaboration: multi-users; asset management; tagging*; project management and license sharing*
Education: online documentation; public forum; linkedin group; youtube channel; irock group; TAW and design partnerships
Protocol list, script feature coverage, versioning
Cloud vendors and locations, OPLG
Integrations – SiteScope, New Relic, Dynatrace, NV, WebPageTest, Jenkins, CLI, REST*, Code Pipeline, NGA*, Helion*
Testing
Test definition: basic scheduling; distribution; RTS; delayed execution; ip whitelisting; ip spoofing*; SLA and suggestion; easy test creation – HAR, REST, CSV
Test execution: online analysis, including client, monitor and breakdown; online merging, splitting and filtering; widget views; online anomaly detection and sla warnings; LG warnings; script errors
Offline analysis: client side breakdown; offline report; export as CSV or PDF; download logs
Collaboration: multi-users; asset management; tagging*; project management and license sharing*
Education: online documentation; public forum; linkedin group; youtube channel; irock group; TAW and design partnerships
Protocol list, script feature coverage, versioning
Cloud vendors and locations, OPLG
Integrations – SiteScope, New Relic, Dynatrace, NV, WebPageTest, Jenkins, CLI, REST*, Code Pipeline, NGA*, Helion*
Testing
Test definition: basic scheduling; distribution; RTS; delayed execution; ip whitelisting; ip spoofing*; SLA and suggestion; easy test creation – HAR, REST, CSV
Test execution: online analysis, including client, monitor and breakdown; online merging, splitting and filtering; widget views; online anomaly detection and sla warnings; LG warnings; script errors
Offline analysis: client side breakdown; offline report; export as CSV or PDF; download logs
Collaboration: multi-users; asset management; tagging*; project management and license sharing*
Education: online documentation; public forum; linkedin group; youtube channel; irock group; TAW and design partnerships
Nike
Situation: The LoB teams for an athletics web application
needed a cloud solution for burst testing and long endurance tests. CoE was using PC SaaS, but had no influence on LoB.
Incumbent: The LoB teams used Soasta
Driver: Soasta services cost, SRL usability, and integrations
Phase 1 (2015): $700K - The LoB purchased StormRunner Load and dumped Soasta
Phase 2 (2016): $800K– The LoB renewed and CoE moved to StormRunner Load
For qualified customers we’re currently offering 100kVUsers for up to one hour