Everyone who runs a website already does initial Web Performance optimization during development with browser web toolkits. In order to survive Black Friday, Cyber Monday and other events we do load testing, and for production monitoring we have real user monitoring solutions in place. By using these tools we already have the foundation in place to start working on a DevOps strategy for our companies. In this session, we will explore why these tools are essential for a DevOps strategy. What limitations are we currently running into by using them with single page load apps? I will show real-life examples from different companies I’ve worked with, what their performance and DevOps problems were and how they tackled them.

1. 1 #kenzenhofer
Klaus Enzenhofer
klaus.enzenhofer@dynatrace.com
#kenzenhofer
Web-Performance the base for
DevOps?!

2. 2 #kenzenhofer
Performance Tools

3. 3 #kenzenhofer
Klaus Enzenhofer
klaus.enzenhofer@dynatrace.com
#kenzenhofer
Web-Performance the base for
DevOps?!

8. And just very recently @ Euro Song Contest

10. What you should check out …

11. 11 #kenzenhofer
DevOps Team
Developer Tester Operations

12. 12 #kenzenhofer
Developer
Tester
Operations
Customer

13. 13 #kenzenhofer
The Problem
in the World
today is
COMMUNICATION

14. 14 #kenzenhofer
Metrics…
…the IT language

15. 15 #kenzenhofer
# of Requests Weight Response Time

16. 16 #kenzenhofer
# of Requests

17. 17 #kenzenhofer
“We want more Web 2.0”

18. 18 #kenzenhofer
Load Test Prior to Change

19. 19 #kenzenhofer
Load Test After Change

20. 20 #kenzenhofer

21. 21 #kenzenhofer
There is more than you think …
Third Party Content
Our Content

22. 22 #kenzenhofer

23. 23 #kenzenhofer
Adult Industry
XXX.com
142 TPC Domains

24. 24 #kenzenhofer
Weight

25. 25 #kenzenhofer
Mobile Landing Page of Super Bowl Ad
434 Resources in total on that page:
230 JPEGs, 75 PNGs, 50 GIFs, …
Total size of ~
20MB

26. 26 #kenzenhofer
m.store.com redirects to www.store.com
ALL CSS and JS files are
redirected to the www domain
This is a lot of time “wasted”
especially on high latency mobile
connections

27. 27 #kenzenhofer
Critical Pages not Optimized!
Browse, Search
and Product Info
performs well
… because they don’t follow
best practices: 87 Requests, 28
Redirects, …
Critical Pages such as
Shopping Cart are very
slow …

28. 28 #kenzenhofer
Response Time

29. 29 #kenzenhofer
Did the Superbowl Investment pay off for KIA?

30. 30 #kenzenhofer
Adonair

31. 31 #kenzenhoferCOMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
@
1h before
SuperBowl KickOff
1h after
Game ended

32. 32 #kenzenhofer
The Developer‘s/Operator‘s Nightmare
Customer Support

33. 33 #kenzenhofer
The Developer‘s/Operator‘s Nightmare
Biz/Support IT Operations
Development
Fix the issue!
We are losing money!

34. 34 #kenzenhofer
“Teamwork” between Dev and Ops
SEV1 Problem in Production
Need access to log files
Where are they? Can’t get
them
Need to increase log level
Can’t do! Can’t change config
files in prod!

35. 35 #kenzenhofer
A user’s contact list

36. 36 #kenzenhofer
A user’s contact list
Switch from Mail to Contacts
Visit of the user that complained

37. 37 #kenzenhofer
A user’s contact list
Error in Browser
Which JavaScript File
Line of Code

38. 38 #kenzenhofer
? ? ?
Unit/Integration
Tests
Acceptance
Tests
Capacity
Tests
ReleaseDevelopers

39. 39 #kenzenhofer
Performance Issues
Unit Tests Integration
Tests
Acceptance
Tests
Load Tests
Meets requirements
Responds correctly to
input
Performs in acceptable
time
Usability
Deployment
Achieves Correct Result

40. 40 #kenzenhofer
Basics
Metric:
Test duration
I don’t like endsWith…
… I like regex!

41. 41 #kenzenhofer
What is the response time?

42. 42 #kenzenhofer
The Performance Impact
Navigation Timings
This is 2012 style!

43. 43 #kenzenhofer
The Performance Impact
http://apdex.org/
0 2.0s 8.0s
(4 x 2.0s)
Satisfied Tolerating Frustrated
Navigation Timings

44. 44 #kenzenhofer
Single Page Load Apps
W3C Timings Blindspots!
http://blogs.telerik.com/telerikmarketing/posts/14-05-21/everything-you-wanted-to-know-about-native-hybrid-and-web-apps-but-were-afraid-to-ask
Omni Channel Market
Navigation Timings Navigation Timings
User Action Response Time

45. 45 #kenzenhofer
Errors – Have the biggest „social“ impact!

46. 46 #kenzenhofer
User Experience Index
User Action
Response Time
Errors

47. 47 #kenzenhofer
Learn from a Users Journey

48. 48 #kenzenhofer
User Experience Index
User Behavior
User Action
Response Time Errors

49. 49 #kenzenhofer
Is this STILL Enough?
Bandwidth

50. 50 #kenzenhofer
User Behavior
User Environment
User Experience Index
User Action
Response Time
Errors

51. 51 #kenzenhofer
The mobile challenge and metrics

52. 52 #kenzenhofer

53. 53 #kenzenhofer
We need a mobile strategy!

54. 54 #kenzenhofer

55. 55 #kenzenhofer

56. 56 #kenzenhoferhttp://fintalk.cdw.com/2015/01/08/financial-it-trends-banks-infographic-2015/

57. 57 #kenzenhofer
“Our customers expect the same experience
throughout all our channels no matter if it is
the website, mobile site or the real physical store!”
Mike Austin, Director of e-Commerce
RoomstoGo.com

58. 58 #kenzenhofer
Developer
Tester
Operations
Customer CareBusiness
Customer
Do metrics
as a common language
still work?

59. 59 #kenzenhofer

60. 60 #kenzenhofer
Successful
searches
Unsuccessful searches
broken down by reason

61. 61 #kenzenhofer
If we do all that

62. 62 #kenzenhofer
We align Technical Goals …
80% Dev Time for Bug Fixing
$60B Costs by Defects

63. 63 #kenzenhofer
… with Business Goals

64. 64 #kenzenhofer
Klaus Enzenhofer
Senior Technology Strategist
#kenzenhofer
klaus.enzenhofer@dynatrace.com
http://blog.dyntrace.com
Thank You!