In this presentation, Jeff Barr will introduce the principal Amazon Web Services from a business and technical point of view. Jeff will review the economics of cloud-based solutions, and will discuss the Elastic Compute Cloud (EC2), the Simple Storage Service (S3), and the Relational Database Service (RDS). Jeff will also discuss the ins and outs of hosting complex applications on AWS.
Presented by Jeff Barr, Senior Web Services Evangelist, Amazon Web Services, at SugarCon 2011.
4. What is Cloud Computing? An analogy: think of electricity services… You simply plug into a vast electrical grid managed by experts to get a low cost, reliable power supply – available to you with much greater efficiency than you could generate on your own. Power is a utility service - available to you on-demand and you pay only for what you use.
5. What is Cloud Computing? Cloud Computing is also a utility service - giving you access to technology resources managed by experts and available on-demand. You simply access these services over the internet, with no up-front costs and you pay only for the resources you use.
6. Attributes of Cloud Computing No capital expenditure Pay as you go and pay only for what you use True elastic capacity; Scale up and down Improves time to market You get to focus your engineering resources on what differentiates you vs. managing the undifferentiated infrastructure resources
7. What is Amazon Web Services? Amazon Web Services is a cloud computing platform that provides flexible, scalable, and cost-effective technology infrastructure for businesses of all sizes around the world… …utilizing the knowledge, expertise, and tools used to run Amazon.com’s global web properties for over a decade.
8. AWS Global Reach AWS Regions US East (Northern Virginia) US West (Northern California) Europe (Dublin) Asia Pacific (Singapore) Asia Pacific (Tokyo) US East (Northern Virginia) Availability Zone A Availability Zone B Availability Zone C Availability Zone D
10. The Dirty Little Secret 70% 30% YourBusiness Managing All of the “Undifferentiated Heavy Lifting” On-PremiseInfrastructure
11. AWS Goal: Flip This Equation 70% 30% Managing All of the “Undifferentiated Heavy Lifting” YourBusiness On-PremiseInfrastructure More Time to Focus onYour Business Configuring Your Cloud Assets AWSCloud-BasedInfrastructure 30% 70%
13. Example: Wall Street App on Amazon EC2 3000 - Number of EC2 Instances 300 CPU’s on weekends 300 - Thursday 4/23/2009 Friday 4/24/2009 Sunday 4/26/2009 Monday 4/27/2009 Tuesday 4/28/2009 Saturday 4/25/2009 Wednesday 4/22/2009
14. Example: Video App on Amazon EC2 Scaled to peak of 5,000 instances in 3 days Number of EC2 Instances Launch of Facebook modification 4/12/2008 4/14/2008 4/15/2008 4/16/2008 4/18/2008 4/19/2008 4/20/2008 4/17/2008 4/13/2008
15. The Bottom Line Benefit The AWS Cloud turns capital expenses into variable costs while preserving flexibility and enhancing the scalability, availability, and security of IT infrastructure resources.
25. Amazon Elastic Compute Cloud Amazon EC2: on-demand compute power Obtain and boot new server instances in minutes Quickly scale capacity up or down Eleven instance types Hourly billing Key features: Support for Windows, Linux, FreeBSD, and OpenSolaris Supports all major web and application platforms Deploy across Availability Zones for reliability
26. Region Availability Zone Amazon EC2 Architecture Amazon Machine Image (AMI) Ephemeral Storage EC2 Instance Elastic Block Storage CloudWatch Security Group(s) Auto Scaling Amazon S3 Elastic IP Address EBS Snapshot EBS Snapshot Load Balancing
27. Amazon EC2 Pricing Options On-DemandInstances ReservedInstances SpotInstances Pay as you go for compute power Pay only for what you use, no up-front commitments or long-term contracts Unix/Linux instances start at $0.02/hour USD in the US East Region Pay a low up-front fee and receive a significant discount on the hourly pricing for that instance 1- or 3-year terms Helps ensure that compute capacity is available when it is needed Enables you to bid on unused Amazon EC2 capacity Spot Price is based on supply/demand and is determined automatically If the Spot Price is below your bid, your instances will start If the Spot Price rises above your bid, your instances will stop
29. Amazon Relational Database Service Provision a new relational database in seconds MySQL (5.1 and 5.5) - Now Oracle (11G) - Soon Offload common administrative tasks to AWS OS upgrades DB upgrades and patches Scaling CPU and storage Backups & Restores Use your existing code and tools Pay only for what you use, no up-front commitments Single and Multi-AZ Read Replicas
34. AWS CloudFormation Stack Creation Define a JSON template of AWS Resources to provision (EC2 instances, AZ lists, AMIs, EIP, RDS, etc) Parameterization supported Use CLI, API, or Management Console to register and create an AWS stack Service automatically determines interdependencies AWS resources get created across tiers and AZs forming a CloudFormation Stack AMAZON CONFIDENTIAL
36. Amazon Virtual Private Cloud - VPC Create an isolated set of EC2 instances in the AWS cloud Divide your IP address range into one or more public or private subnets Control inbound and outbound access to and from individual subnets using stateless Network Access Control Lists Protect your Instances with stateful filters for inbound and outbound traffic using Security Groups Bridge your VPC and your onsite IT infrastructure with an encrypted VPN connection Use Network Addess Translation (NAT)
This is a real usage graph from one of our financial services customers during the last week of April (They have asked to remain anonymous for competitive reasons). Firms on Wall Street are finding EC2 an ideal environment to run many of their dailymission critical grid computing and cpu bound applications for a couple key reasons: 1/ Flexibilitythe ability to instantly access hundreds/thousands of cores increases the amount of data they can process, improving the overall quality of their models. and 2/ Cost efficiencies, as they can complete more of their processing for less total spend (Not paying for infrastructure during times of the day and weekends when its not needed)This wall street firm in particular has a nightly business process where they upload the day’s market trading data into S3, and then run proprietary ‘risk management’ algorithms. This lasts ~10 hours during week nights, where they ramp up to the equivalent 3000 m1.smalls. During the day and on weekends, they maintain a base of roughly 300 cores, to handle their always on work loads.
A couple of nights ago one of our customers—Animoto—saw a monster spike in traffic. Animoto has a product that helps you create web videos with music and graphics. They launched a Facebook app that lets people tell their friends when they’ve uploaded a video that includes that friend. You can see the spike in traffic that this new app caused. The X axis represents time elapsed and the Y axis represents the EC2 instances launched. Because they were using AWS, Animoto didn’t have to do a thing—AWS took care of everything.
Amazon Web Services is a set of primitive building blocks to enable developers to build applications and, ultimately, businesses, on our battle-tested infrastructure. So what kinds of building blocks do developers need? First, you need compute resources. The Elastic Compute Cloud, or EC2, allows developers to rent virtual computers, running in our data centers, and pay for them by the hour. Provision as many as you need – 1, 10, 1000, for as long as you need them, and you pay only for what you use (starting at 10 cents/hour). Next, you probably need somewhere to durably store and retrieve data. The Simple Storage Service, is, well, a simple storage service that allows to store and retrieve objects in the cloud using simple put and get API calls.You might need to index and query for that data, or create other structured data that you want to query, which is what we built SimpleDB.
On the application platforms point, good to mention:Microsoft .NETIBM WebSphereRubyPHPOracle Fusion MiddlewareJBossAlso a good place to mention IBM AMIs (bring your own license or pay by the hour)