This presentation was delivered 14 times (in various forms) by AWS Evangelist Jeff Barr as part of his 2013 AWS Road Trip.
After introducing AWS, it covers the basics of S3, EC2, RDS, DynamoDB, Elastic Block Storage, Auto Scaling, Elastic Load Balancing, Redshift, the AWS Trusted Advisor, and more.
2. #awsroadtrip @jeffbarr
Introduction
Evangelist = “Enthusiastic technical communicator”
Amazon.com employee since 2002
BS, Computer Science, 1985
Masters of Communication in Digital Media, 2013
AWS Blog
AWS Report – Video podcast
“Host Your Web Site in the Cloud”
3. #awsroadtrip @jeffbarr
I Love User Groups!
Motivated guests
Time to have an in-depth discussion
Ask lots of questions, dive deep, don’t be shy
Tweets, photos, etc - @jeffbarr / #awsroadtrip
AWS credits, stickers, t-shirts, and more
4. #awsroadtrip @jeffbarr
My Road Trip
14/14
User
Groups
Cloud
Powered
Follow my trip at
http://awsroadtrip.com
AWS
Road Trip
Website
Contour
Video
Waze
Map & Nav
MapBox
Map Site
Red Lion
Hotels
20/20
Nights
5550/5550
Miles
foursquare Yelp Dropbox
6. #awsroadtrip @jeffbarr
AWS Mission
Enable businesses and
developers to use web services*
to build scalable, sophisticated
applications.
*What people now call “the cloud”
8. Each day AWS adds the equivalent
server capacity to power Amazon
when it was a global, $5B enterprise
$5.2B retail business
7,800 employees
A whole lot of servers
2003
12. #awsroadtrip @jeffbarr
Free steak
campaign
Facebook
page
Mars exploration
operations
Consumer social app
Gene sequencing Marketing web site Interactive TV apps Financial markets
analytics
Web site &
media sharing
Disaster recovery Media streaming Web and mobile apps
Every Conceivable
Use Case
13. #awsroadtrip @jeffbarr
Creative Cloud
Marketing Cloud
Digital Publishing Suite
PhoneGap
TypeKit
Acrobat.com
EchoSign
Revel
AWS at Adobe
Behind it all: One common platform for shared services
14. Red Lion Hotels
Hospitality & Leisure
Build Hyper-Local
Web & Mobile Apps
on AWS
Build
Scalable Test
Environment
Migrate TicketsWest
Reduced Costs;
Better Scaling
47 Hotels in US &
Canada
Partner Support (2nd Watch)
15. NASA / JPL & AWS
Mission-critical
Projects
Mars Rover Image
processing
Video Streaming
for Landing
Scale up as
needed
Highly Parallel
Processing
Whole World
Watching
One-Time Event
16. #awsroadtrip @jeffbarr
Daily Mars Rover Data Processing Window (2 hours)
Serial Process UploadPlan
Pre-cloud:
Parallel
Process
UploadPlan
Cloud:
Increase available mission planning time from
15 minutes to 105 minutes!
NASA – Mission Data Processing
18. #awsroadtrip @jeffbarr
Learn AWS – Architecture and APIs
Build Applications
Distribute Apps on the AWS Marketplace
Become an AWS ISV or Solution Partner
Become an AWS Certified Solutions Architect
Join the AWS Team
Attend AWS re:Invent in Las Vegas
19. #awsroadtrip @jeffbarr
• First Exam: AWS Certified Solutions Architect -
Associate Level
• More exams coming: Solutions
Architect, Systems Operators and Developers
across proficiency levels
(Associate, Professional, Master)
• Exams delivered at Kryterion testing center
(over 750 locations worldwide)
AWS Certification Program
aws.amazon.com/certification
20. #awsroadtrip @jeffbarr
AWS re:Invent
Coming to Las Vegas
in November
Pre-registration
opening soon
2012 event attracted
more than 6000
attendees
Talks, exhibits, netwo
rking, training
29. #awsroadtrip @jeffbarr
On a Global Footprint
Region
US-WEST (N. California)
EU-WEST (Ireland)
ASIA PAC (Tokyo)
ASIA PAC (Singapore)
US-WEST (Oregon)
SOUTH AMERICA (Sao Paulo)
US-EAST (Virginia)
GOV CLOUD
ASIA PAC (Sydney)
31. #awsroadtrip @jeffbarr
Amazon S3
Storage for the
Internet
99.999999999%
Durability Design
Private or Public
$0.095/ GB / Month
(US East)
Low Latency
Backup, Image
Hosting, Website
Hosting
Redundancy, Encr
yption, Versioning
32. #awsroadtrip @jeffbarr
Host a Static Website
S3 Static Hosting
+ Route 53 DNS
Simple and Very
Scalable
Log Files and
Analytics
33. #awsroadtrip @jeffbarr
Amazon Glacier
Secure & Durable
Storage
Data Archiving &
Backup
For Data That’s
Accessed
Infrequently
$0.01 / GB / Month
(US East)
Retrieve Data In
3-5 Hours
Integrated
With S3
Third Party
Support
34. #awsroadtrip @jeffbarr
Provision and boot new servers in minutes
Boot from AMI (Amazon Machine Image)
Your choice of Linux or Windows
Quickly scale capacity up or down
Deploy across Regions and Availability Zones for
flexibility & reliability
Choose between 18 different instance types
Amazon EC2
35. #awsroadtrip @jeffbarr
256
128
64
32
16
8
4
2
1
1 2 4 8 16 32 64 128 256
High I/O 4XL 60.5 GB
35 EC2 Compute Units
16 virtual cores
2*1024 GB SSD-based local instance storage
EC2 Compute Units
Memory(GB)
Small 1.7 GB,
1 EC2 Compute Unit
1 virtual core
Micro 613 MB
Up to 2 ECUs (for
short bursts)
Large 7.5 GB
4 EC2 Compute Units
2 virtual cores
$0.32/0.46
Hi-Mem XL 17.1 GB
6.5 EC2 Compute Units
2 virtual cores
Hi-Mem 2XL 34.2 GB
13 EC2 Compute Units
4 virtual cores
Hi-Mem 4XL 68.4 GB
26 EC2 Compute Units
8 virtual cores
High-CPU Med 1.7 GB
5 EC2 Compute Units
2 virtual cores
High-CPU XL 7 GB
20 EC2 Compute Units
8 virtual cores
Medium 3.7 GB,
2 EC2 Compute Units
1 virtual core
M3 XL 15 GB
13 EC2 Compute Units
4 virtual cores
EBS storage only
M3 2XL 30 GB
26 EC2 Compute Units
8 virtual cores
EBS storage only
Extra Large 15 GB
8 EC2 Compute Units
4 virtual cores
10 GB
Inter-Instance
Network
Cluster GPU 4XL 22 GB
33.5 EC2 Compute Units,
2 x NVIDIA Tesla “Fermi”
M2050 GPUs
Cluster Compute 4XL 23 GB
33.5 EC2 Compute Units
Cluster Compute 8XL 60.5 GB
88 EC2 Compute Units
High Storage 8XL 117 GB
35 EC2 Compute Units,
24 * 2 TB ephemeral drives
10 GB Ethernet
Hi-Mem Cluster Compute 8XL 244 GB
88 EC2 Compute Units
16 virtual cores
240 GB SSD
36. #awsroadtrip @jeffbarr
EC2 Pricing / Payment Options
AWS Free
Usage Tier
On-
Demand
Pricing
Reserved
Instances
Spot
Market
For new
customers
(one year)
750 hours /
month Linux
750 hours /
month
Windows
And much
more…
Pay published
rates for EC2
By the hour $0.02 / hour
Micro
$4.60 / hour
High Storage 8XL
Make low,
one-time
payment
Receive
significant
discount on
hourly charge
Low, medium,
high
utilization
Reserved
Instance
Marketplace
Place bids for
compute time
One-shot or
recurring
Price changes
based on
supply and
demand
For
distributed, fa
ult-tolerant
tasks
750 hours of Amazon EC2 Linux Micro Instance usage
750 hours of Amazon EC2 Microsoft Windows Server Micro Instance
750 hours of an Elastic Load Balancer
30 GB of Amazon Elastic Block Storage
5 GB of Amazon S3 standard storage
100 MB of storage, 5 units of write capacity, and 10 units of read capacity for Amazon DynamoDB
25 Amazon SimpleDB Machine Hours and 1 GB of Storage
1,000 Amazon SWF workflow executions can be initiated for free
100,000 Requests of Amazon Simple Queue Service
100,000 Requests, 100,000 HTTP notifications and 1,000 email notifications for Amazon Simple Notification Service
10 Amazon Cloudwatch metrics, 10 alarms, and 1,000,000 API requests
15 GB of bandwidth out aggregated across all AWS services*
750 hours of Amazon RDS for SQL Server Micro DB Instance usage
20 GB of database storage
10 million I/Os
20 GB of backup storage for your automated database backups and any user-initiated DB Snapshots
Savings Light Medium Heavy
1 Year <= 30% <= 39% <= 45%
3 Year <= 49% <= 59% <= 65%
Breakeven
Point
Light Medium Heavy
1 Year >= 28% >= 41% >= 56%
3 Year >= 11% >= 19% >= 35%
39. #awsroadtrip @jeffbarr
Fixed IP address
Map to any EC2 instance in a Region
Retain address after switching instances
EC2 Elastic IP Address
40. #awsroadtrip @jeffbarr
Tracks and stores AWS and user-defined metrics
2 week retention period
Detect issues
Raise alerts
Amazon CloudWatch
41. #awsroadtrip @jeffbarr
Distribute traffic to an array of EC2 instances
Part of scaling architecture
Configure ports and health checks
Traffic goes to healthy instances
EC2 Elastic Load Balancer
42. #awsroadtrip @jeffbarr
Control number of running EC2 instances
Scale up or down as needed
Drive decisions based on CloudWatch metrics
• CPU load
• Network traffic
Auto-scaling group
• Instance collection
• Actions (rules)
EC2 Auto Scaling
43. #awsroadtrip @jeffbarr
Virtual disk volumes
1 GB – 1 TB per volume
Create and attach to EC2 instance
Format and write data
Snapshot and restore
Provision desired IOPS (up to 4000 per volume)
EC2 Elastic Block Store
45. #awsroadtrip @jeffbarr
DynamoDB is a fully managed NoSQL database
service that provides extremely fast and
predictable performance with seamless scalability
Amazon DynamoDB
46. #awsroadtrip @jeffbarr
DynamoDB Highlights
Low Latency
Massive &
Seamless
Scalability
Predictable
Performance
SSD- based
storage nodes
Average
reads < 5ms,
writes < 10ms
No table size or
throughput limits
Live repartitioning for
changes to storage and
throughput
Provisioned
throughput model
Durable &
Available
Consistent, disk-
only writes
Alter throughput as
needed
Redundant & self-
healing
48. #awsroadtrip @jeffbarr
AWS Trusted Advisor
Inspects AWS
Environment; Makes
Recommendations Using
Aggregated AWS
Operational History From
Hundreds of Thousands
of Customers
Reduce Costs
Close Security Gaps
Increase Performance
49. #awsroadtrip @jeffbarr
Elastic Transcoding Service
Transcode Video
Files
Scalable and Cost-
Effective
S3 to S3
HTTP Live Streaming
(HLS)
WebM
(VP8 Video, Ogg Audio)
MPEG2-TS
(H.264 Video, AAC Audio)
Multiple Outputs / Job
Bit Rate Optimization
Aspect Ratio & Sizing
Policies
50. #awsroadtrip @jeffbarr
Amazon Redshift
Fully Managed
Petabyte-Scale
Data Warehouse
1/10th the Cost of
Most Existing
Solutions
Use Existing
Business
Intelligence Tools
More than 1000
customers
Adding > 100
customers / week
2 TB & 16 TB Nodes
Up to 100 16 TB
Nodes / Cluster
AES-256 encryption
in hardware
For data, metadata,
S3 backups
http://aws.amazon.com
/redshift/partners
52. #awsroadtrip @jeffbarr
Use MFA
(Optional, highly recommended)
Getting Started With AWS
Create account at aws.amazon.com
You will need a credit card
(even for the free usage tier)
Set a billing alert
(optional, highly recommended)
53. #awsroadtrip @jeffbarr
Host a static website
Host a dynamic website
Launch a Marketplace application
Build a cloud application using the AWS APIs and SDKs
54. #awsroadtrip @jeffbarr
Host a Static Website
S3 Static Hosting
+ Route 53 DNS
Simple and Very
Scalable
Log Files and
Analytics
55. #awsroadtrip @jeffbarr
Host a Dynamic Website
From Simple to
Complex
Load Balancer
and >= 2 EC2
Instances
The Sky is the
Limit!
http://awsofa.info/
57. #awsroadtrip @jeffbarr
Build a Cloud App
Use the AWS
SDKs
Java
Ruby
PHP
.Net
IOS
Android
Node.JS
AWS Toolkit for
Eclipse
Python
AWS Toolkit for
Visual Studio
So in 2006 Amazon Web Services was born. It's mission was clear: to enable businesses and developers to use web services to scalable sophisticated applications. It's interesting to note that what we called Web Services, has now morphed into a common term 'the Cloud'. Amazon Web Services is and always has been a distinct and individual Amazon organisation.
Back in 2006, our first step into the cloud was launched. We called in Amazon S3 – the Simple Storage Service.The launch announcement was very simple – no exaggerated claims, and just simply the facts.Our customers have found S3 to be very useful.We’ve been tracking the growth year over year.From 2.9 billion, to 14, to 40, to 102, to 262, to 762, to 905 billion in early 2012.As of the 3rd quarter of 2012, Amazon S3 now stores 1.3 trillion objects.We process up to 835,000 requests per second for these objects.
Over ten years ago, the technical teams supporting Amazon were moving from providing software and hardware capabilities to a service orientated approach - that is packaging things in an easy to consume way so that deployments by parts of the business were easier, faster and more scalable. As Amazon opened up the it's internal services to third party sellers, and we published simple web services such as our catalog search, it became apparent very quickly that developers were hungry for more, and that Amazon had developed significant technical know-how that could be packaged for others to use. We asked ourselves 'what if we could package everything we do and offer it to others over the web?'. 'What if other businesses could leverage the scale and reach of Amazon.com?'
To help understand why Amazon Web Services and Cloud Computing are changing IT delivery, a nice comparison to make is that of a utility like electricity. When electricity was discovered businesses would generate their own, using steam generators to power factories. When electricity was brought together under a national system of supply, it was no longer necessary for everyone to generate their own and buy and maintain their generators, you could simply tap into the grid and use what you needed, paying only for what you did use, and be assured that the electricity you consumed was consistent and always available.
Utility computing brings those same benefits to the deliver of IT - the factories of many businesses.
By taking the services delivered from traditional data centers and wrapping them all in a consistent programming interface, or API,
services that are normally expensive to manage or difficult to use become available on-demand, in a uniform and available way, and only paid for when used. Just like electricity.This is what AWS does. It takes away the hard work from providing infrastructure IT services and makes them available to anyone on a pay as you go basis.
And just like an electricity grid, where you would not wire every factory to the same power station, the AWS infrastructure is global, with multiple regions around the globe from which services are available. This means you have control over things like where you applications run, where you data is stored, and where best to serve your customers from.
And the whole footprint is supported by many edge locations, places from which content can be served to your customers for the fast possible response times.
Over ten years ago, the technical teams supporting Amazon were moving from providing software and hardware capabilities to a service orientated approach - that is packaging things in an easy to consume way so that deployments by parts of the business were easier, faster and more scalable. As Amazon opened up the it's internal services to third party sellers, and we published simple web services such as our catalog search, it became apparent very quickly that developers were hungry for more, and that Amazon had developed significant technical know-how that could be packaged for others to use. We asked ourselves 'what if we could package everything we do and offer it to others over the web?'. 'What if other businesses could leverage the scale and reach of Amazon.com?'