Building powerful web applications in the AWS Cloud : A Love Story, Design patterns in web-based cloud architecture, Jinesh Varia gave this talk at Cloud Connect and several other places http://aws.typepad.com/aws/2011/03/building-powerful-web-applications-in-the-aws-cloud-a-love-story.html

1. How to Scale Your Next Idea on
AWS: A Love Story
Jinesh Varia
jvaria@amazon.com
Follow me: @jinman
linkedin.com/in/jinman

2. Story

3. Story of Scalability

4. Thursdate.com

5. ThursDate.com
Magical Elastic Dating Every Thursday
An ephemeral website on On-Demand Cloud Infrastructure
Goes Live: Thursday 4:00 PM
Shuts Down: Thursday 7:00 PM
“Black Friday Effect”
Repeats every Thursday of the Week

7. www.myjavawebsite.com
Elastic IP
Apache
Tomcat
Amazon EC2
Instance
MySQL
Availability Zone #1
Backups
Amazon S3
Bucket

8. Pattern #1: Design for failure and nothing will fail

9. www.myjavawebsite.com
Elastic IP
Apache
Tomcat
Amazon EC2
Instance
MySQL
Availability Zone #1
Backups
Amazon S3
Bucket

10. www.myjavawebsite.com
Elastic IP
Route53
Hosted Zone
Apache
Logs
Static Data
Tomcat
MySQL
Amazon EC2
Instance
Root
Amazon S3
Bucket
Backups
Data
Snapshots
Amazon EBS Volume
Availability Zone #1

11. Pattern #2: Edge cache static content

12. www.myjavawebsite.com
Elastic IP
Route53
Hosted Zone
Apache
Logs
Static Data
Tomcat
MySQL
Amazon EC2
Instance
Root
Amazon S3
Bucket
Backups
Data
Snapshots
Amazon EBS Volume
Availability Zone #1

13. media.myjavawebsite.com
(Static and Streaming data)
www.myjavawebsite.com
(Dynamic data)
Elastic IP
Route53
Hosted Zone
Amazon
CloudFront
Distribution
Apache
Logs
Static Data
Tomcat
MySQL
Amazon EC2
Instance
Root
Amazon S3
Bucket
Backups
Data
Snapshots
Amazon EBS Volume
Availability Zone #1

15. media.myjavawebsite.com
(Static and Streaming data)
www.myjavawebsite.com
(Dynamic data)
Elastic IP
Route53
Hosted Zone
Amazon
CloudFront
Distribution
Apache
Logs
Static Data
Tomcat
MySQL
Amazon EC2
Instance
Root
Amazon S3
Bucket
Backups
Data
Snapshots
Amazon EBS Volume
Availability Zone #1

16. www.myjavawebsite.com
(Dynamic data)
Elastic IP
media.myjavawebsite.com
(Static and Streaming data)
Route53
Hosted Zone
Amazon
CloudFront
Distribution
Apache
Tomcat
Logs
Static Data
Amazon S3
Bucket
Amazon EC2
Instance
MySQL
Amazon RDS DB Instance
Availability Zone #1
Backups

17. www.myjavawebsite.com
staging.myjavawebsite.com
Elastic IP
183.2.3.1
Tip:
Treat Cloud
Resources as
Fungible
Resources
Dynamic IP
172.3.1.4
App v1.1
App v1.2
Apache
Apache
Tomcat
Tomcat
Production EC2
Instance
Production EC2
Staging EC2
Instance
MySQL
Amazon RDS
Availability Zone #1

18. www.myjavawebsite.com
(Dynamic data)
Elastic IP
media.myjavawebsite.com
(Static and Streaming data)
Route53
Hosted Zone
Amazon
CloudFront
Distribution
Apache
Tomcat
Logs
Static Data
Amazon S3
Bucket
Amazon EC2
Instance
MySQL
Backups
Amazon RDS DB Instance
Availability Zone #1

19. Slashdot Effect

20. Pattern #3: Implement Elasticity

21. www.myjavawebsite.com
(Dynamic data)
Route53
Hosted Zone
media.myjavawebsite.com
(Static and Streaming data)
Amazon
CloudFront
Distribution
Amazon ELB
Apache
Amazon Machine
Image
Tomcat
Logs
Static Data
Amazon S3
Bucket
Amazon EC2
Instance
Auto Scaling Group
MySQL
Backups
Amazon RDS DB Instance
Availability Zone #1

22. www.myjavawebsite.com
(Dynamic data)
Route53
Hosted Zone
media.myjavawebsite.com
(Static and Streaming data)
Amazon
CloudFront
Distribution
Amazon ELB
Apache
Amazon Machine
Image
Tomcat
Logs
Static Data
Amazon S3
Bucket
Amazon EC2
Instance
Auto Scaling Group
MySQL
Backups
Amazon RDS DB Instance
Availability Zone #1

23. media.myjavawebsite.com
(Static and Streaming data)
www.myjavawebsite.com
(Dynamic data)
Route53
Hosted Zone
Amazon
CloudFront
Distribution
Amazon ELB
Apache
Apache
Tomcat
Tomcat
Logs
Static Data
Amazon S3
Bucket
Auto Scaling Group : Web Tier
Amazon EC2
Instances
MySQL
Amazon RDS DB Instance
Availability Zone #1
Backups

24. DB?

25. www.myjavawebsite.com
(Dynamic data)
Route53
Hosted Zone
media.myjavawebsite.com
(Static and Streaming data)
Amazon
CloudFront
Distribution
Amazon ELB
Apache
Tomcat
Apache
Tomcat
Logs
Static Data
Auto Scaling Group : Web Tier
Amazon RDS DB
Instance
Availability Zone #1
Backups
Amazon S3
Bucket

26. www.myjavawebsite.com
(Dynamic data)
Route53
Hosted Zone
media.myjavawebsite.com
(Static and Streaming data)
Amazon
CloudFront
Distribution
Amazon ELB
Apache
Amazon DynamoDB
(all Key Value data)
Tomcat
Apache
Tomcat
Logs
Static Data
Auto Scaling Group : Web Tier
Amazon RDS DB
Instance
Availability Zone #1
Backups
Amazon S3
Bucket

27. Pattern #4: Leverage Multiple Availability Zones

28. www.myjavawebsite.com
(Dynamic data)
Route53
Hosted Zone
media.myjavawebsite.com
(Static and Streaming data)
Amazon
CloudFront
Distribution
Amazon ELB
Apache
Tomcat
Apache
Tomcat
Logs
Static Data
Auto Scaling Group : Web Tier
Amazon RDS DB
Instance
Availability Zone #1
Backups
Availability Zone #2
RDS Standby
Slave
Amazon S3
Bucket

29. Pattern #5:
Isolate read and write traffic

30. www.myjavawebsite.com
(Dynamic data)
Route53
Hosted Zone
media.myjavawebsite.com
(Static and Streaming data)
Amazon
CloudFront
Distribution
Amazon ELB
Apache
Apache
Tomcat
Tomcat
Logs
Static Data
Amazon S3
Bucket
Auto Scaling Group : Web Tier
Async
RDS Read
Replicas
Availability Zone #1
Backups
Availability Zone #2
RDS Standby
Slave

31. Pattern #6: Cache is King; Cache as much as possible

32. www.myjavawebsite.com
(Dynamic data)
Route53
Hosted Zone
media.myjavawebsite.com
(Static and Streaming data)
Amazon
CloudFront
Distribution
Amazon ELB
Apache
Apache
Tomcat
Tomcat
Logs
Static Data
Amazon S3
Bucket
Auto Scaling Group : Web Tier
Async
RDS Read
Replicas
Availability Zone #1
Backups
Availability Zone #2
RDS Standby
Slave

33. www.myjavawebsite.com
(Dynamic data)
Route53
Hosted Zone
media.myjavawebsite.com
(Static and Streaming data)
Amazon
CloudFront
Distribution
Amazon ELB
Apache
Apache
Tomcat
Tomcat
Logs
Static Data
Amazon S3
Bucket
Auto Scaling Group : Web Tier
ElastiCache
Nodes
Async
RDS Read
Availability Zone #1
Replicas
Backups
Availability Zone #2
RDS Standby
Slave

35. Pattern #7: Leverage application services to increase
your productivity and scale your app

36. www.myjavawebsite.com
(Dynamic data)
Route53
Hosted Zone
media.myjavawebsite.com
(Static and Streaming data)
Amazon
CloudFront
Distribution
Amazon ELB
Apache
Apache
Tomcat
Tomcat
Logs
Static Data
Amazon S3
Bucket
Auto Scaling Group : Web Tier
ElastiCache
Async
RDS Read
Replica
Availability Zone #1
Backups
Availability Zone #2
RDS Standby
Slave

37. www.myjavawebsite.com
(Dynamic data)
Route53
Hosted Zone
media.myjavawebsite.com
(Static and Streaming data)
Amazon
CloudFront
Distribution
Amazon ELB
Apache
Tomcat
Amazon CloudSearch
(Index all your data)
Apache
Tomcat
Logs
Static Data
Amazon S3
Bucket
Auto Scaling Group : Web Tier
Amazon SNS
(notifications)
Amazon CloudWatch
(Monitoring)
ElastiCache
Async
Amazon Simple Email Service
(Send email)
RDS Read
Replica
Availability Zone #1
Backups
Availability Zone #2
RDS Standby
Slave

38. Tip: Loose coupling for other parts of the application
(For example, Image Processing)

39. Loose coupling sets you free
Use Amazon SQS as Buffers
Tight Coupling
Controller A
Q
Loose Coupling
using Queues
Controller B
Q
Controller A
Controller C
Q
Controller B
Controller C

40. CloudFront
Download
Distribution
RRS S3
Bucket to
Serve
content to
CloudFront
S3 Bucket
For Ingest
Instances
User
SQS Queue
Size for Thumbnail
Auto scaling
Group
Instances
SNS Topic
Tip:
Use Queues as
Buffer
SQS Queue
Size Image for
Mobile
SQS Queue
Size Image for Web
Auto scaling
Group
Instances
Auto scaling
Group
S3 Bucket
For originals

41. CloudFront
Download
Distribution
RRS S3
Bucket to
Serve
content to
CloudFront
S3 Bucket
For Ingest
Instances
User
Auto scaling
Group
Instances
Tip:
Automate by
using
workflows
Auto scaling
Group
SWF
Instances
Instance running
decider
Auto scaling
Group
S3 Bucket
For originals

43. Pattern #8: Automate Your software development
lifecycle (Continuous Integration + Deployment)

44. Tip:
Bootstrap your
EC2 Instances
www.myjavawebsite.com
(Dynamic data)
Route53
Hosted Zone
media.myjavawebsite.com
(Static and Streaming data)
Amazon
CloudFront
Distribution
Amazon ELB
Apache
Amazon Machine
Image
Tomcat
Amazon
EC2
Instance
Logs
Static Data
Amazon S3
Bucket
Auto Scaling Group
MySQL
Backups
Amazon RDS DB Instance
CloudFormation
Template
Git
Build
Instance
Bootstrap
Scripts
Artifact
Bucket
Continuous Integration
Availability Zone #1

45. Apache
Your Code
Your Code
Fetch on boot
Fetch on boot
Tomcat
Apache
Struts
Your Code
Struts
Log4J
Spring
Tomcat
Struts
Fetch on boot
Amazon S3
Apache
Struts
Tomcat
Log4J
Hibernate
Spring
Amazon S3
scripts
Chef/puppet
Your Code
Log4J
Spring
Apache
A
p
a
c
h
e
Log4J
A
p
a
c
h
e
T
o
m
c
a
tS
t
r
u
t
s
Y
o
u
r
Spring
Hibernate
Hibernate
C
L
o
d
g
e
4
J
S
p
r
i
n
g
H
i
b
e
r
n
J
a
E
t
E
e
L
i
n
u
x
A
p
a
c
h
e
T
o
m
c
a
tS
t
r
u
t
s
Y
o
u
r
C
L
o
d
g
e
4
J
S
p
r
i
n
g
H
i
b
e
r
n
J
a
E
t
E
e
L
i
n
u
x
T
o
m
c
a
t
Tomcat
A
p
a
c
h
e
T
o
m
c
a
tS
t
r
u
t
s
Y
o
u
r
C
L
o
d
g
e
4
J
S
p
r
i
n
g
H
i
b
e
r
n
J
a
E
t
E
e
L
i
n
u
x
JEE
A
p
a
c
h
e
T
o
m
c
a
tS
t
r
u
t
s
Y
o
u
r
C
L
o
d
g
e
4
J
S
p
r
i
n
g
H
i
b
e
r
n
J
a
E
t
E
e
H
i
b
e
r
n
a
J
t
E
e
E
L
i
n
u
x
Hibernate
A
p
a
c
h
e
T
o
m
c
a
t
H
i
b
e
r
n
a
J
t
E
e
E
L
i
n
u
x
A
p
a
c
h
e
T
o
m
c
a
t
H
i
b
e
r
n
a
J
t
E
e
E
L
i
n
u
x
CHEF
Puppet
JEE
JEE
Linux
JEE
Linux
JEE
L
i
n
u
x
Linux
Linux
JEE
Linux
Java App Stack
Linux
Amazon EC2
Amazon EC2
Java AMI
Java AMI
Inventory of AMIs
Frozen Pizza Model
Golden AMI and
Fetch binaries on boot
Take N Bake Pizza Model
Amazon EC2
JeOS AMI
JeOS AMI and library of recipes
(install scripts)
Made to order Pizza Model

46. Cloud-Powered Software Development Lifecycle
Dev
All in one instance
Test/QA
2-tier app
with small DB
Staging
2-tier app with
production data
AWS CloudFormation + Chef (or Puppet)
Prod
2-tier app with
production data
Multi-AZ and HA

47. "80% of time we are wrong what
the customers wants"

48. Data-driven

49. A/B Testing
A
B
Control
Treatment

50. Blue Green Deployments

51. High Error Rate
Monitoring
Load Balancing
(CloudWatch)
(ELB)
v1.1
v1.1
v1.2
v1.2
v1.1
v1.1
v1.2
v1.2
Web Server Fleet
(Amazon EC2)
Database Fleet
(RDS or DB on EC2)

52. Auto Scaling
Auto Scaling Group (Min, Max # of instances, Availability Zones .. )
Health Check (Maintain Min # active…)
Launch Configuration (AMIID, Instance type, UserData, Security Groups..)
Scaling Trigger (Metric, Upper Threshold, Lower Threshold, Time interval …)
Types of Scaling (Scale by Schedule, Scale by Policy)
Alarm (Notification Email, SMS, SQS, HTTP)
Availability Zones and Regions

53. Load Balancing
(ELB)
Auto scaling
v1.1
v1.1
v1.2
v1.2
v1.1
v1.1
v1.2
v1.2
“Auto scaling”
Web Server Fleet
(Amazon EC2)
Database Fleet
(RDS or DB on EC2)
Max instances
Min instances
Scaling Trigger
Custom Metrics
Upper Threshold
Lower Threshold
Increment by

54. Deploy != Product Launch

55. Feature = ON
request
Load Balancing
(ELB)
Happy
Path v1.1
New feature
Code Path v1.2
v1.1
v1.1
v1.1
v1.1
v1.2
v1.1
v1.1
v1.1
v1.1
v1.2
Web Server Fleet
(Amazon EC2)
Database Fleet
(RDS or DB on EC2)

56. Dialing up
A
B
Control
Treatment

57. Load Balancing
(ELB)
99%
1%
v1.1
v1.1
v1.1
v1.1
v1.1
v1.2
v1.1
v1.1
v1.1
v1.1
v1.1
v1.2
v1.1
v1.1
v1.1
v1.1
v1.1
v1.2
v1.1
v1.1
v1.1
v1.1
v1.1
v1.2
Web Server Fleet
(Amazon EC2)
…..
Database Fleet
(RDS or DB on EC2)
A/B Testing
Service

58. Load Balancing
(ELB)
90%
10%
v1.1
v1.1
v1.1
v1.1
v1.1
v1.2
v1.2
v1.1
v1.1
v1.1
v1.1
v1.1
v1.2
v1.2
v1.1
v1.1
v1.1
v1.1
v1.1
v1.2
v1.1
v1.1
v1.1
v1.1
v1.1
v1.2
Web Server Fleet
(Amazon EC2)
…..
Database Fleet
(RDS or DB on EC2)
A/B Testing
Service

59. Load Balancing
(ELB)
70%
30%
v1.1
v1.1
v1.1
v1.1
v1.1
v1.2
v1.2
v1.2
v1.1
v1.1
v1.1
v1.1
v1.1
v1.2
v1.2
v1.2
v1.1
v1.1
v1.1
v1.1
v1.1
v1.2
v1.2
v1.2
v1.1
v1.1
v1.1
v1.1
v1.2
v1.2
v1.2
Web Server Fleet
(Amazon EC2)
…..
Database Fleet
(RDS or DB on EC2)
A/B Testing
Service

60. Load Balancing
(ELB)
70%
30%
v1.1
v1.1
v1.1
v1.1
v1.2
v1.2
v1.1
v1.1
v1.1
v1.1
v1.2
v1.2
v1.1
v1.1
v1.1
v1.1
v1.2
v1.2
v1.2
v1.1
v1.1
v1.1
v1.2
v1.2
v1.2
Web Server Fleet
(Amazon EC2)
…..
Database Fleet
(RDS or DB on EC2)
A/B Testing
Service
v1.2
High Error Rate
v1.2
Monitoring
(CloudWatch)

61. Load Balancing
(ELB)
Rollback
90%
10%
v1.1
v1.1
v1.1
v1.1
v1.1
v1.2
v1.2
v1.2
v1.1
v1.1
v1.1
v1.1
v1.1
v1.2
v1.2
v1.2
v1.1
v1.1
v1.1
v1.1
v1.1
v1.2
v1.2
v1.2
v1.1
v1.1
v1.1
v1.1
v1.2
v1.2
v1.2
Web Server Fleet
(Amazon EC2)
…..
Database Fleet
(RDS or DB on EC2)
A/B Testing
Service
Dev, Test

62. Load Balancing
(ELB)
70%
30%
v1.1
v1.1
v1.1
v1.1
v1.1
v1.2
v1.2
v1.2
v1.1
v1.1
v1.1
v1.1
v1.1
v1.2
v1.2
v1.2
v1.1
v1.1
v1.1
v1.1
v1.1
v1.2
v1.2
v1.2
v1.1
v1.1
v1.1
v1.1
v1.2
v1.2
v1.2
Web Server Fleet
(Amazon EC2)
…..
Database Fleet
(RDS or DB on EC2)
A/B Testing
Service

63. Load Balancing
(ELB)
50%
50%
A/B Testing
Service
v1.1
v1.1
v1.1
v1.1
v1.2
v1.2
v1.2
v1.2
v1.2
v1.1
v1.1
v1.1
v1.1
v1.2
v1.2
v1.2
v1.2
v1.2
v1.1
v1.1
v1.1
v1.1
v1.2
v1.2
v1.2
v1.2
v1.2
v1.1
v1.1
v1.1
v1.2
v1.2
v1.2
v1.2
v1.2
Web Server Fleet
(Amazon EC2)
…..
Database Fleet
(RDS or DB on EC2)

64. Load Balancing
(ELB)
30%
70%
A/B Testing
Service
v1.1
v1.1
v1.1
v1.2
v1.2
v1.2
v1.2
v1.2
v1.1
v1.1
v1.1
v1.2
v1.2
v1.2
v1.2
v1.2
v1.1
v1.1
v1.2
v1.2
v1.2
v1.2
v1.2
v1.1
v1.1
v1.2
v1.2
v1.2
v1.2
v1.2
Web Server Fleet
(Amazon EC2)
…..
Database Fleet
(RDS or DB on EC2)

65. Load Balancing
(ELB)
5%
95%
A/B Testing
Service
v1.1
v1.1
v1.2
v1.2
v1.2
v1.2
v1.2
v1.2
v1.1
v1.1
v1.2
v1.2
v1.2
v1.2
v1.2
v1.2
v1.1
v1.1
v1.2
v1.2
v1.2
v1.2
v1.2
v1.2
v1.2
v1.2
v1.2
v1.2
v1.2
v1.2
Web Server Fleet
(Amazon EC2)
v1.1
…..
Database Fleet
(RDS or DB on EC2)

66. Data-driven

67. HOST LEVEL
METRICS
AGGREGATE
LEVEL
METRICS
LOG ANALYSIS
EXTERNAL
SITE PERFORMANCE

68. Amazon S3
Via Flume/Fluentd
(Log Aggregator)
Logs from
EC2
Instances
Amazon S3
Task
Node
Amazon Elastic
MapReduce
Code/
Scripts
Mapper
Reducer
HiveQL
Pig Latin
Cascading
Amazon DynamoDB/RDS
Name
Node
Task
Node
Runs multiple
JobFlow Steps
Core
Node
HiveQL
Pig Latin
Query
Tip:
Log analysis
EMR Clusters
Core
Node
HDFS
Amazon Elastic MapReduce
Hadoop Cluster
JDBC/ODBC
BI Apps

69. Tip:
Pick the right “Big Data Stack” for your data
Client
Ingest
Mobile Client
•Kinesis
•Flume
•Kafka
Store
•S3
•DynamoDB
•RDS
Process
•Hadoop/EMR
•Redshift
•Spark/EMR
Visualize
•Tableau
•Datameer
•D3
(“Thing”)
Sensor
Questions:
Hot data vs. Cold data
Size of data & Speed of data ingest
Adhoc query (reports) vs. frequent queries (dashboard)
Batch vs. Stream
Low latency responses (ms) vs. high latency responses (Hours)
Cost tradeoffs
Insights
Reports

70. $$

71. Pattern #9:
Build cost-aware architectures;
Optimize for cost and see savings as early as your next month’s bill

72. On-demand
Instances
• Pay as you go
• Zero commitment
Reserved
Instances
• One time low
upfront fee +
discounted hourly
costs
• Upto 71% savings
over On-Demand
Spot
Instances
• Requested Bid
Price and Pay as
you go
• Price change
every hour based
on unused EC2
capacity
Dedicated Instances
• Standard and
Reserved
• Multi-Tenant
Single Customer
• Ideal for
compliance and
regulatory
workloads
Billing Options

73. Mix and Match Instances
12
10
On-Demand
8
6
Light RI
Light RI
Light RI
Light RI
4
2
Heavy Utilization Reserved Instances
0
1
2
3
4
5
6
7
8
9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28

74. Upload large
datasets or log
files directly
Data
Source
Amazon S3
Amazon S3
Task
Node
Amazon Elastic
MapReduce
Code/
Scripts
Mapper
Reducer
HiveQL
Pig Latin
Cascading
Amazon DynamoDB/RDS
Name
Node
Task
Node
Runs multiple
JobFlow Steps
Core
Node
HiveQL
Pig Latin
Query
Adhoc EMR
Clusters
+
Task Nodes
on Spot
Core
Node
HDFS
Amazon Elastic MapReduce
Hadoop Cluster
JDBC/ODBC
BI Apps

75. ThursDate.com
Magical Elastic Dating Every Thursday
“Not about the past”
Be whatever you want to be:
Doctors
Nerds/Geeks
Philosophers
Mac fans

77. www.myjavawebsite.com
(Dynamic data)
Route53
Hosted Zone
media.myjavawebsite.com
(Static and Streaming data)
Amazon ELB
Amazon
CloudFront
Distribution
Auto Scaling Group
Web Tier
Logs
Static Data
Amazon S3
Bucket
Auto Scaling Group
App Tier
Backups
Availability Zone #2
RDS Standby
Slave
Availability Zone #3

78. www.myjavawebsite.com
(Dynamic data)
Route53
Hosted Zone
media.myjavawebsite.com
(Static and Streaming data)
Amazon ELB
Amazon
CloudFront
Distribution
Auto Scaling Group
Web Tier
Auto Scaling Group
Web Tier
Auto Scaling Group
App Tier
Auto Scaling Group
App Tier
Logs
Static Data
RDS Standby
Slave
Availability Zone #1
Availability Zone #2
Availability Zone #3
Amazon S3
Bucket
Backups

79. Pattern #10: Harden security at every stage

80. www.myjavawebsite.com
(Dynamic data)
Route53
Hosted Zone
media.myjavawebsite.com
(Static and Streaming data)
Amazon ELB
Amazon
CloudFront
Distribution
Auto Scaling Group
Web Tier
Logs
Static Data
Amazon S3
Bucket
Auto Scaling Group
App Tier
Backups
Availability Zone #2
RDS Standby
Slave
Availability Zone #3

81. www.myjavawebsite.com
(Dynamic data)
Route53
Hosted Zone
#Permit HTTP(S) access to Web Layer from
the Entire Internet
ec2auth Web -p 80,443 -s 0.0.0.0/0
Amazon ELB
Amazon
CloudFront
Distribution
Auto Scaling Group
#Permit Web Layer access to App Layer
ec2auth App -p 8000 –o Web
# Permit App Layer access to DB
ec2auth DB -p 3209 –o App
# Permit admin access SSH to all three layers
# First allow connection from office to Web
tier, and from there to the other layers
ec2auth Web -p 22 -s <for example, network
block of your office>
ec2auth App -p 22 -o Web
ec2auth DB -p 22 -o Web
media.myjavawebsite.com
(Static and Streaming data)
Web Security Group
Web Tier
Logs
Static Data
Amazon S3
Bucket
Auto Scaling Group
App Tier
App Security Group
Backups
Availability Zone #2
DB Security Group
RDS Standby
Slave
Availability Zone #3
Amazon VPC Subnet

82. Implement security best practices at
every layer








Protect Your AWS Account
Control Internal Access to AWS Resources
Limit External Access to Your AWS Cloud
Protect Data in Transit and at Rest
Secure your data assets
Secure your compute assets (OS, Instance, App)
Backup and easily recover
Keep Track of Your Cloud Resources (Monitoring)
http://bit.ly/aws-security-best-practices-new

83. Pattern: #11: Go Global Quickly (with single API)

85. US West Traffic
Web
Web
App
Web
App
App
Web
Web
App
Web
App
App
US East Traffic
Web
Web
App
Web
App
App
Europe Traffic
Web
Web
App
Web
App
App
Web
Web
App
Web
App
App
Web
Web
App
Web
App
App
Asia Traffic
Web
Web
App
Web
App
App
Web
Web
App
Web
App
App
Auto Scaling group : Web
App Tier
Auto Scaling group : Web
App Tier
Auto Scaling group : Web
App Tier
Auto Scaling group : Web
App Tier
RDS
Master
RDS
Master
RDS
Master
RDS
Master
US-West
US-West-1b
RDS
Multi-AZ
US-East
US-East-1b
RDS
Multi-AZ
EU-West
EU-West-1b
Software-based Data Replicator
RDS
Multi-AZ
AP-SOUTHEAST
AP-SOUTHEAST-1b
RDS
Multi-AZ

86. Pattern #1: Design for failure and nothing will fail
Pattern #2: Edge cache static content
Pattern #3: Implement Elasticity
Pattern #4: Leverage Multiple Availability Zones
Pattern #5: Isolate read and write traffic; Isolate static and dynamic traffic
Pattern #6: Cache as much as possible; Cache is King
Pattern #7: Leverage app services to increase your productivity and scale your app
Pattern #8: Automate Your software development lifecycle
Pattern #9: Optimize for Cost and See Savings as early as your Next Month’s Bill
Pattern #10: Harden security at every stage
Pattern #11: Go global quickly (with single API)

87. Powerful
Highly scalable, Highly available, Highly
responsive, Fault-tolerant, Cost-effective, globally-deployed
Web application

88. Andy found “cloud” mate – his soul mate

89. And he lives happily ever after….

90. First love is still “the cloud”

91. Thank you!
Jinesh Varia
jvaria@amazon.com Twitter:@jinman
This slide deck is available at
http://slideshare.net/amazonwebservices

92. http://aws.amazon.com/whitepapers