talk at the YaJUG - 31 Octobre 2012

1. DES TESTS DE PERFORMANCES ...
MAIS POURQUOI ?
YAJUG - Octobre 2012
Claude Falguière @cfalguiere goo.gl/4mmJQ
mercredi 7 novembre 12

2. CLAUDE FALGUIERE
Technical architect
http://cfalguiere.wordpress.com
Duchess France JUG Leader
@cfalguiere
+Claude Falguiere
mercredi 7 novembre 12

3. performance
how to persuade your boss
design relevant tests
be aware of bias
prepare for the go live
mercredi 7 novembre 12

4. sprint
ou
marathon
Performance ?
mercredi 7 novembre 12

5. or
capacity
speed
or
volume
mercredi 7 novembre 12

6. and availability
mercredi 7 novembre 12

7. and efficiency
mercredi 7 novembre 12

8. attente constaté
2s 6s 8s
distance between happy and unhappy
It can be measured ...
mercredi 7 novembre 12

9. assumed complexity
rendering order
performance stability
... and it depends on users
mercredi 7 novembre 12

10. 1 We use the most performing frameworks !
2 Let’s upgrade the CPU
3 Let’s go to the Cloud
mercredi 7 novembre 12

11. Performance
enhancement
Faster
Amazon : Google :
+100 ms +500 ms
-1% sales –20% pages seen
costs
revenues
mercredi 7 novembre 12

12. Performance
enhancement
Less calls to the call center
costs Less customers in the office
savings
mercredi 7 novembre 12

13. Performance
enhancement
costs
Less resources
savings
mercredi 7 novembre 12

14. revenues
More turnover
temps
Less costs
costs Performance enhancement
mercredi 7 novembre 12

15. An endless struggle
mercredi 7 novembre 12

16. Individual Group Crowd
Behavior under stress
mercredi 7 novembre 12

17. Individual Group Crowd
Slowness
Iterations
Volume
Wait and timeouts
«unit» Test
breakdown
mercredi 7 novembre 12

18. YSlow
Page Speed
HTTP Proxy
mercredi 7 novembre 12

19. mercredi 7 novembre 12

20. Individual Group Crowd
race condition
contention
live/dead locks
mimic a few
concurrent users
mercredi 7 novembre 12

21. Individu Groupe Foule
Capacity bounds
Overloading
Leaks
iso-prod
Aging test Load test
Failure simulation Peak stress test
mercredi 7 novembre 12

22. Sizing according to the capacity
mercredi 7 novembre 12

23. REQ-1234 : High performance
is required
mercredi 7 novembre 12

24. Who ?
What ?
Where ?
When ?
How ?
Why ?
mercredi 7 novembre 12

25. High-Risk
Essential
What are
they doing ? Frequent
Frequent
Frequent
Frequent
mercredi 7 novembre 12

26. mercredi 7 novembre 12

27. mercredi 7 novembre 12

28. REQ-5678 : Landpage should
show up in less than 600 ms
mercredi 7 novembre 12

29. Time Serie
and distribution
mercredi 7 novembre 12

30. Unaware of
Striking
Rare
90% des relevés
Moyenne 1,2s
sont < 3,5s
Quantile 90% = 3,5s
mercredi 7 novembre 12

31. Some bad response time
Unstable
response time
Bimodal !? ...
mercredi 7 novembre 12

32. Goals and drivers
Indicators
Scenarios
Volumes
Datasets
Types of test and
duration
Target platform
mercredi 7 novembre 12

33. representativeness
Garbage in - Garbage out
mercredi 7 novembre 12

34. ias
b
mercredi 7 novembre 12

35. Find biases to degrade the result
Find biases to
improve the result
mercredi 7 novembre 12

36. volumes
scenario, data, search phrases
caches
test duration and rate
ignore errors
ignore uncommon use cases
Simplify
Arrange
mercredi 7 novembre 12

37. Which show better results ?
A B
mercredi 7 novembre 12

38. Which shows more errors ?
A B
mercredi 7 novembre 12

39. Anticipate
Iso-prod Iso-prod
not required
algorithms load test (capacity)
contentions response time
robustness reliability on load
scalability
aging
failure simulation
mercredi 7 novembre 12

40. Design for failure
mercredi 7 novembre 12

41. Test to learn
mercredi 7 novembre 12

42. Prepare monitoring
mercredi 7 novembre 12

43. Thank
you
Claude Falguière "Reality is merely an illusion,
@cfalguiere albeit a very persistent one. "
goo.gl/4mmJQ - Albert Einstein
mercredi 7 novembre 12