1. How to survive the perfect storm
Protect yourself through scaling in the Cloud
1

2. Web Performance as
a Cloud Service
Test, Analyze,
Monitor and Improve
Web Performance

3. Industry Expertise
Public Sector Cloud Telecom Media
Travel
Gaming eRetail Finance
3

4. Load testing Service
Scales via Amazon Cloud and Apica’s own ISP Resources
More then 100,000 concurrent users
2,000,000 users in 15 minutes
 Dynamic scaling in Amazon Cloud
 Inside agents monitoring vital signs together with Amazon Cloudwatch
 Loadtest execution and result collection integrated with Amazon AWS API
4

5. Monitoring Network
Worldwide Monitoring Network > 200 locations
In most big clouds and data centers, run rate > 500,000,000 total checks in 2012
UK/Europe
Canada Russia Moscow Norway Finland
Russia
Boston
US Beijing United
Kingdom
Sweden
Ireland
Ukraine
Poland
Belgium
France
Egypt
Spain
Italy
Seattle Greece
Portugal
Portland
Singapore
Boston
Minneapolis New
York
Chicago Cleveland
San
Francisco
Phoenix
Denver WASHINGTON Brazil
D.C
Los Angeles
Dallas
Atlanta
Australia
Houston
Miami
5

6. Planning for Unlimited Website Loads
6

7. Business challenge – handling peak web loads
Response time
Many sites unprepared for:
 Holiday sales spikes
 New product launches
Time
 Extreme weather events
No. of users
 Major announcements
Lost
business
Time
Peak
Hour
7

8. Can you handle the perfect storm?
8

9. Key Challenges
 How to Scale ?
– Need for quick ramp up in capacity
– Cloud & Physical Backend
 How to work with fixed capacity ?
– Fixed capacity on DB or backend
 What to do when peak load is unlimited ?
– No way to control overload vs. capacity
9

10. Scaling with Cloud
10

11. Scaling
11

12. How much capacity do you actually need?
Large
Medium
Small
12

13. Why LoadTest Cloud
 Planning proactive cloud scaling
– A capacity test provides the metrics to identify the
infrastructures limits
– Cloud application managers can act proactively before
performance is degraded
 Actual capacity of adding new servers
– Doubling server capacity doesn’t mean the application
can handle double the load.
– Capacity testing shows what the new user capacity is.
 Test failover procedures
– During peak loads and in multi-tenancy environments
– “Work out the kinks” of their failover procedures before
they really need it.
13

14. Dynamic Queing
 All applications have a maximum load level
– Load start page
– Deliver dynamic content
– Database transactions
 Exceeding limits typically lead to a crash
 Implement Queing
14

15. Case:
15

16. How it works
Customer site
1 User
2
Apica Connection
Control
Web front 3
Cloud Farm
Wait page/Emergency Site
16

17. Key Features
 Unlimited Capacity – designed to handle the largest possible
unexpected event loads, beyond 100,000 concurrent users per minute
 Flexible subscription – ready to take over on a moments notice, or use it
24/7/365 ongoing operation
 Dynamic Queuing Management – reroutes excess users to “wait page”;
reroutes queued users to a separate network
 Real Time Monitoring – displays user response times and application
performance
 Easy Setup – can by used by any website or service regardless of its
host location or ISP.
17

18. To sum it up
1 2 3 4
 Perform a  Analyse  Plan for worst  Handle
pre-event  Optimize
case scenarios overload
load test  Scaling rules  Fire drill
 Capacity
planning  Failover  Monitoring
All systems have weak points – Where are yours?
18

19. Thank You!
19