Web systems architecture, Performance and More

The VP R&D Open Seminar

Web Systems Architecture
and Performance Analysis
moshe.kaplan@
brightaqua.com
http://blogs.microsoft.co.il/blogs/vprnd
http://top-performance.blogspot.com

Presentation Objectives

http://www.webperformancetoday.com/2010/06/15/everything-you-wanted-to-know-about-web-performance/

2


Why Do I Care?
From 0 to 100 (US mass adaptation)
Phone:
Radio:
TV:
Mobile:
Internet:
Facebook:

3

100 yrs
40 yrs
30 yrs
20 yrs
10 yrs
2 yrs


100K New Users/Week

4


The Network Effect

5


Motivation

6



20 YEARS OF WEB
ARCHITECTURES
http://www.trucoteca.com/juego/erase-una-vez-el-hombre-del-antiguo-egipto-a-la-r-10236.html

7


Once Upon a Time... Man

http://act2.me/full-stack-web-development/

8



GETTING BACK

9


Where Are We?

10


The Prime Suspect

11


Know Your Business

12


Buzz*: The Funnel

http://blog.clicktale.com/2011/01/18/new-clicktale-product-launches-for-2011/

13


Assumptions…

14



IS IT THE SERVER OR THE
CLIENT?
15


Waterfall Time!

16


Better a Neighbor Nearby Than a Brother Far Away

http://www.tcpipguide.com/free/t_TCPWindowSizeAdjustmentandFlowControl.htm

17


Network Effect Solutions
CDN
Compression; Minification; Sprites; Embed

http://www.akamai.com/stateoftheinternet/

18


Show Time!

19


Buzz*: Bootstrap

20



STEP 2: IT'S DEFINITELY IN THE
CODE!
21


Code Profilers

22


Code Anti Patterns
Do It Yourself Infrastructure
Cache
Data Stores

Locks and Semaphores
Code that Cannot be Tested/Automated

23


Load Stress

24



Buzz*: node.js

FULL STACK DEVELOPMENT

25


Server Side JavaScript

26



CACHING

27


Don’t Use Caching

28


If You Have To

ad
Re
29


Invalidation Can Be Nightmare

http://luauf.com/2009/06/08/%C2%BFque-es-memcached/

30


Geo Load Balancing Can be Worse

31


Finally, Recovery May Not Be Better

32


KISS

http://marriagelifeministries.org/?p=962

33



STEP 3: WHERE DO WE STORE
THE DATA?
http://1userverrack.net/2011/06/08/hp-blade-server-9/

34


SQL Server Alerts
Connection Leak: >200
Object Execution Times
Locks

35


SQL Server Execution Time Graphs

36


SQL Server Execution Time Details

37


Activity Monitor

38


Database Anti Patterns
Software Engineering Patterns
ORM
Blobs
No Denormalization
Nested/Complex SQL Statements
Too Few/Many Indexes

39



ALTERNATIVE STRATEGIES FOR
BIG DATA CASES
40


Strategy A - Sharding

41


Strategy B – In Memory Databases

42


700 Inserts/Sec

In Memory Engine
3000 Inserts/Sec
Amazon
AWS
Standard
Large
Instance

43

InnoDB Engine
700 Inserts/Sec


Strategy C – MapReduce



44

Strategy D - NoSQL
insert
get
multiget

remove
truncate

<Key, Value>

http://wiki.apache.org/cassandra/API

45


Sharding Again

46


Vertical Sharding

47


Horizontal Sharding
Static Hashing
Complex growth
Simple

Mod 10 = 0
Mod 10 = 1
Mod 10 = 2
Mod 10 = 3
Mod 10 = 4
Mod 10 = 5
Mod 10 = 6
Mod 10 = 7
Mod 10 = 8
Mod 10 = 9

48



Buzz*: MongoDB

DOCUMENT DATABASES

49


When Should I Choose NoSQL?

•
•
•

Eventually Consistent
Document Store
Key Value
http://guyharrison.squarespace.com/blog/tag/nosql

50


Same Terminology

Database
Table
Row

51

 Database
 Collection
 Document


Same Terminology

Database
Table
Row

52

 Database
 Collection
 Document


A Blog Case Study in RDBMS

http://www.slideshare.net/nateabele/building-apps-with-mongodb

53


And as a SW Engineer would like it to be…

http://www.slideshare.net/nateabele/building-apps-with-mongodb

54


Classic RDBMS Replication

55


Auto Selection Using Quorum
Selection Methods:
• Low Priority
• Hidden
• (Weighted) Voting

56


MongoDB and Sharding

http://www.10gen.com/products/mongodb

57



STEP 4: SYSTEM ASPECTS

58


Network
WireShark
Ping
Tracert
Netstat –na
WAN

59


Storage
Attribute

RAM

SSD

HDD (SAS)

Volatile

Yes (*)

No

No

Latency

Low

Low

High

Read MB/s

4000+

520

164

Write MB/s

4000+

480

164

100,000

100

$0.5

$0.05

IOPS
Price/GB

60

$5.5


Monitoring

61



Buzz*: Scale

KEEP YOUR SYSTEM AVAILABLE

62


Load Balancer

63


Session Offloading

64


Cookie Encryption
private static void SetEncryptedCookie(
string name, string value
) {
var encryptName = SomeEncryptionMethod(name);
Response.Cookies[encryptName].Value = SomeEncryptionMethod(value);
//set other cookie properties here, expiry &c.
//Response.Cookies[encryptName].Expires = ...

}
private static string GetEncryptedCookie(string name)
{
//you'll want some checks/exception handling around this
return SomeDecryptionMethod(
Response.Cookies[SomeDecryptionMethod(name)].Value);

}

65


The Bottom Line: Grow ∞

Thank you!
and Keep Performing!

Moshe Kaplan

66


Web systems architecture, Performance and More

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Destaque

Destaque (18)

Semelhante a Web systems architecture, Performance and More

Semelhante a Web systems architecture, Performance and More (20)

Mais de Moshe Kaplan

Mais de Moshe Kaplan (16)

Último

Último (20)

Web systems architecture, Performance and More

Notas do Editor