Learn more about AWS and how enterprises are using AWS cloud. This is a high level introduction with demos focusing on dashboards, cloud watch etc. You'll learn the main benefits of using AWS and the steps to follow to create your account.
Strategies for Landing an Oracle DBA Job as a Fresher
IP Expo - What is AWS?
1. What is AWS?
Yuri Misnik
Head of Solutions Architecture UK and IR
ymisnik@amazon.co.uk
2. What is AWS?
An overview of what AWS is and why people are adopting it
A 1,000 foot view of the services available in the toolbox
A look at top questions people have when approaching AWS
4. Consumer Business
Tens of millions of
active customer
accounts
Eight countries:
US, UK, Germany,
Japan, France, Canada,
China, Italy
Seller
Business
IT Infrastructure
Business
Sell on Amazon
websites
Cloud computing
infrastructure for
hosting web-scale
solutions
Use Amazon
technology for your
own retail website
Leverage Amazon’s
massive fulfillment
center network
Hundreds of
thousands of
registered customers
in over 190 countries
5. How did Amazon…
About Amazon Web
Services
Deep experience in building
and operating global web
scale systems
?
…get into cloud computing?
6. Over 10 years in the making
Enablement of sellers on Amazon
Internal need for scalable deployment environment
Early forays proved developers were hungry for more
7. AWS Mission
Enable businesses and developers to
use web services* to build scalable,
sophisticated applications.
*What people now call “the cloud”
12. Each day AWS adds the equivalent server
capacity to power Amazon when it was a
global, $5B enterprise
13. Each day AWS adds the equivalent server
capacity to power Amazon when it was a
global, $5B enterprise
2003
$5.2B retail business
7,800 employees
A whole lot of servers
20. On a global footprint
Region
US-WEST (N. California)
EU-WEST (Ireland)
GOV CLOUD
ASIA PAC (Tokyo)
US-EAST (Virginia)
US-WEST (Oregon)
ASIA PAC (Singapore)
SOUTH AMERICA (Sao Paulo)
ASIA PAC (Sydney)
22. On a global footprint
Edge Locations
London(2)
Seattle
New York (2)
South Bend
Amsterdam
Newark
Stockholm
Dublin
Palo Alto
Tokyo
San Jose
Frankfurt(2)
Paris(2)
Ashburn(2)
Los Angeles (2)
Milan
Osaka
Jacksonville
Hong Kong
Dallas(2)
St.Louis
Miami
Singapore(2)
Sao Paulo
Sydney
23. At the end of a web service
ec2-run-instances ami-b232d0db
--instance-count 3
--availability-zone eu-west-1a
--instance-type m1.small
ec2-run-instances ami-b232d0db
--instance-count 5
--availability-zone eu-west-1c
--instance-type m1.medium
24. At the end of a web service
ec2-run-instances ami-b232d0db
--instance-count 2
--availability-zone us-east-1b
--instance-type m1.xlarge
ec2-run-instances ami-b232d0db
--instance-count 2
--availability-zone us-east-1d
--instance-type m1.xlarge
25. At the end of a web service
ec2-authorize default -p 80
elb-create-lb myLoadBalancer
as-create-auto-scaling-group MyGroup
--launch-configuration MyConfig
--availability-zones eu-west-1c
--min-size 2
--max-size 200
28. Why are customers adopting cloud computing?
Variable expense
Replace capital expenditure with variable expense
29. Why are customers adopting cloud computing?
Variable expense
Replace capital expenditure with variable expense
On-premise
Capital investment &
physical installation
vs
$0 to get started
Pay as you go
30. Why are customers adopting cloud computing?
Economies of scale
Lower variable expense than companies can achieve
themselves
31. Why are customers adopting cloud computing?
Economies of scale
Lower variable expense than companies can achieve
themselves
Saved $34m
on SmartHub
application
10’s of millions of $
saved with first 12 apps
migrated to AWS
50% reduction
in analytics
costs
32. Why are customers adopting cloud computing?
Economies of scale
Lower variable expense than companies can achieve
themselves
$3.01M
70% lower 5 year
TCO per app
$0.90M
On-premise
AWS
Source IDC Whitepaper, sponsored by Amazon,
“The Business Value of Amazon Web Services
Accelerates Over Time.” July 2012
33. Why are customers adopting cloud computing?
Elastic capacity
No need to guess capacity requirements and over-provision
34. Why are customers adopting cloud computing?
Elastic capacity
No need to guess capacity requirements and over-provision
Demand
Actual demand
Customer
dissatisfaction
Predicted demand
Waste
Time
35. Why are customers adopting cloud computing?
Elastic capacity
No need to guess capacity requirements and over-provision
Demand
Elastic capacity
Time
36. Why are customers adopting cloud computing?
Speed and agility
Infrastructure in minutes not weeks
37. Why are customers adopting cloud computing?
Speed and agility
Infrastructure in minutes not weeks
“We reduced
application
deployment times
from 2 months to 3
days.”
“Time to deploy
from went weeks
to hours.”
“We can double
server capacity in
20 seconds”
38. Why are customers adopting cloud computing?
Speed and agility
Infrastructure in minutes not weeks
Old World: Infrastructure in Weeks
Infrastructure in Minutes
Add New Dev Environment
aws.amazon.com/managementconsole
Instance Type
M3 Extra Large
1,000
Number of Instances
Availability Zone
US-West-2b
Launch
Add New Production Environment
Add New Environment in Japan
Add 1,000 Servers
Remove 1,000 servers
39. Why are customers adopting cloud computing?
Speed and agility
Infrastructure in minutes not weeks
“On-premise”
Experiment
Infrequently
Experiment Often
Failure is
expensive
Fail quickly at a
low cost
Less Innovation
More Innovation
$00’s
40. Why are customers adopting cloud computing?
Focus on business
Not undifferentiated heavy IT lifting
41. Why are customers adopting cloud computing?
Focus on business
Not undifferentiated heavy IT lifting
We take care of…
…so you don’t have to…
Data centers
Power
Cooling
Cabling
Networking
Racks
Servers
Storage
Labour
Buy and install new hardware
Set up and configure new
software
Build new data centers
42. Why are customers adopting cloud computing?
Global Reach
Go global in minutes and reach a global audience
43. Why are customers adopting cloud computing?
Global Reach
Application
Go global in minutes and reach a global audience
44. Why are customers adopting cloud computing?
Global Reach
Application
Go global in minutes and reach a global audience
45. 40 servers to 5000 in 3 days
Number of EC2 Instances
EC2 scaled to peak of 5000
instances
“Techcrunched”
Launch of Facebook
modification
Steady state of ~40
instances
4/12/2008
4/13/2008
4/14/2008
4/15/2008
4/16/2008
4/17/2008
4/18/2008
4/19/2008
4/20/2008
47. Reference Model
Deployment & Administration
App Services
Compute
Storage
Database
Networking
AWS Global Infrastructure
48. Global infrastructure
Deployment & Administration
App Services
Compute
Storage
Database
Regions
An independent collection of AWS resources in a
Networking
defined geography
A solid foundation for meeting location-dependent
AWS Global Infrastructure
privacy and compliance requirements
49. Global infrastructure
Deployment & Administration
App Services
Compute
Storage
Database
Availability Zones
Designed as independent failure zones
Networking
Physically separated within a typical metropolitan
region
AWS Global Infrastructure
50. Global infrastructure
Deployment & Administration
App Services
Compute
Storage
Database
Edge Locations
To deliver content to end users with lower latency
Networking
A global network of edge locations
Supports global DNS infrastructure (Route53) and
AWS Global Infrastructure
Cloud Front CDN
51. Compute
Elastic Compute Cloud (EC2)
Vertical Scaling
Basic unit of compute capacity
From $0.02/hr
Range of CPU, memory & local disk options
13 Instance types available, from micro to cluster compute
Feature
Details
Flexible
Run windows or Linux distributions
Scalable
Wide range of instance types from micro to cluster
compute
Deployment & Administration
Machine Images
App Services
Full control
Compute
Storage
Database
Secure
Configurations can be saved as machine images
(AMIs) from which new instances can be created
Full root or administrator rights
Full firewall control via Security Groups
Monitoring
Networking
Publishes metrics to Cloud Watch
Inexpensive
On-demand, Reserved and Spot instance types
VM Import/Export
AWS Global Infrastructure
Import and export VM images to transfer
configurations in and out of EC2
52. Compute
Vertical Scaling
From $0.02/hr
GNM measures the savings from using AWS in terms of
reduced lead times.
Deployment & Administration
App Services
Compute
Storage
Networking
AWS Global Infrastructure
Database
“It takes … less than 10 minutes to set up a new
instance in Amazon EC2 and perhaps another 20
minutes to connect to the infrastructure and build the
server type, for a total lead time of half an hour. This
compares to a possible three weeks for hardware to be
delivered and installed plus additional time for budget
approval.”
Mike Bracken
GNM’s Director of Technology Development,
53. Compute
Elastic Load Balancing
Create highly scalable applications
Distribute load across EC2 instances in multiple
availability zones
Deployment & Administration
Feature
Auto-scaling
App Services
Compute
Storage
Networking
AWS Global Infrastructure
Available
Database
Health checks
Session stickiness
Secure sockets layer
Monitoring
Details
Automatically scales to handle request volume
Load balance across instances in multiple availability
zones
Automatically checks health of instances and takes
them in or out of service
Route requests to the same instance
Supports SSL offload from web and application
servers with flexible cipher support
Publishes metrics to Cloud Watch
54. Storage
S3 - Durable storage, any object
99.999999999% durability of objects
Unlimited storage of objects of any type
Up to 5TB size per object
Feature
Flexible object store
Access control
Deployment & Administration
Server-side encryption
Multi-part uploads
App Services
Object versioning
Object expiry
Compute
Storage
Networking
AWS Global Infrastructure
Database
Access logging
Web content hosting
Notifications
Import/Export
Details
Buckets act like drives, folder structures within
Granular control over object permissions
256bit AES encryption of objects
Improved throughput & control
Archive old objects and version new ones
Automatically remove old objects
Full audit log of bucket/object actions
Serve content as web site with built in page handling
Receive notifications on key events
Physical device import/export service
55. Storage
Elastic Block Store
High performance block storage device
1GB to 1TB in size
Mount as drives to instances
Deployment & Administration
App Services
Feature
High performance file
system
Flexible size
Secure
Compute
Storage
Networking
Database
Performance
Available
Backups
AWS Global Infrastructure
Monitoring
Details
Mount EBS as drives and format as required
Volumes from 1GB to 1TB in size
Private to your instances
Use provisioned IOPS to get desired level of IO
performance
Replicated within an Availability Zone
Volumes can be snapshotted for point in time restore
Detailed metrics captured via Cloud Watch
56. Storage
Glacier
Low-cost storage service
Secure and durable storage for backup and archive
For data that is infrequently accessed
Feature
Low cost
Deployment & Administration
Details
$0.01/GB/month with no up-front capital
commitments
Durable
Flexible
App Services
Compute
Storage
Networking
Database
Same 99.999999999% durability as S3
Store any amount of data on-demand. Eliminate the
need for capacity planning
Secure
Leverage AWS’ robust security platform.
Control access to your data.
API
REST-based API to send and receive data
Import/Export
AWS Global Infrastructure
Vault inventory
Optionally use portable storage devices to
import/export mass data
Index for real-time view of the contents of the vault
57. Database
Relational Database Service
Database-as-a-Service
No need to install or manage database instances
Scalable and fault tolerant configurations
Feature
Platform support
Preconfigured
Details
Create MySQL, SQL Server and Oracle RDBMS
Get started instantly with sensible default settings
Deployment & Administration
Automated patching
App Services
Compute
Storage
Backups
Database
Automatic backups and point in time recovery and
full DB backups
Provisioned IOPS
Specify IO throughput depending on requirements
Failover
Networking
Replication
AWS Global Infrastructure
Keep your database platform up to date
automatically
Automated failover to slave hosts in event of a
failure
Easily create read-replicas of your data and
seamlessly replicate data across availability zones
58. Database
DynamoDB
Provisioned throughput NoSQL database
Fast, predictable performance
Fully distributed, fault tolerant architecture
Feature
Provisioned throughput
Deployment & Administration
Predictable
performance
Average single digit millisecond latencies from SSD
backed infrastructure
Be sure you are reading the most up to date values
Fault tolerant
Storage
Networking
Database
Monitoring
Secure
Elastic MapReduce
AWS Global Infrastructure
Dial up or down provisioned read/write capacity
Strong consistency
App Services
Compute
Details
Data replicated across availability zones
Integrated to Cloud Watch
Integrates with AWS Identity and Access Management
(IAM)
Integrates with Elastic MapReduce for complex
analytics on large datasets
59. Networking
Internet
Internet
Deployment & Administration
App Services
Compute
Storage
Database
Direct Connect
Dedicated connection
Networking
between your IT
infrastructure and the AWS
datacenters
AWS Global Infrastructure
VPN Connection
A Hardware VPN connection
connects AWS to your
datacenter
Commonly used hardware
supported
Virtual Private
Cloud
Launch resources in a virtual
network that you define
complete control over your
virtual networking
environment
60. Networking
Route 53
Highly available and scalable Domain Name System
Extremely reliable and cost effective
Feature
Global
Deployment & Administration
Scalable
Details
Supported from AWS global edge locations for
fast and reliable domain name resolution
Automatically scales based upon query volumes
App Services
Latency based
routing
Compute
Integrated
Storage
Supports resolution of endpoints based upon
latency, enabling multi-region application
delivery
Integrates with other AWS services allowing
Route 53 to front load balancers, S3 and EC2
Database
Networking
Secure
AWS Global Infrastructure
Integrates with IAM giving fine grained control
over DNS record access
61. Application Services
CloudFront
3
Served from S3
/images/*
World-wide content distribution network
Easily distribute content to end users with low latency,
high data transfer speeds, and no commitments.
2
London
Served from EC2
*.php
Paris
Deployment & Administration
1
Single CNAME
www.mysite.com
NY
Feature
App Services
Compute
Fast
Details
Multiple world-wide edge locations to serve
content as close to your users as possible
Networking
AWS Global Infrastructure
Database
Integrated with other
services
Works seamlessly with S3 and EC2 origin servers
Dynamic content
Supports static and dynamic content from origin
servers
Streaming
Storage
Supports rtmp from S3 and includes support for
live streaming from Adobe FMS and Microsoft
Media Server
62. Application Services
Elastic MapReduce
Managed, elastic Hadoop cluster
Integrates with S3 & DynamoDB
Leverage Hive & Pig analytics scripts
Integrates with instance types such as spot
Deployment & Administration
Feature
Details
Scalable
Use as many or as few compute instances running
Hadoop as you want. Modify the number of instances
while your job flow is running
App Services
Compute
Storage
Database
Integrated with other
services
Comprehensive
Networking
Cost effective
AWS Global Infrastructure
Monitoring
Works seamlessly with S3 as origin and output.
Integrates with DynamoDB
Supports languages such as Hive and Pig for defining
analytics, and allows complex definitions in
Cascading, Java, Ruby, Perl, Python, PHP, R, or C++
Works with Spot instance types
Monitor job flows from with the management
console
63. Deployment & Admin
Elastic Beanstalk
One-click deployment from Eclipse, Visual Studio and Git
Rapid deployment of applications
All AWS resources automatically created
Deployment & Administration
Feature
Platform support
App Services
Compute
Storage
Networking
AWS Global Infrastructure
Details
Containers for Java, .NET and PHP
Resource creation
Database
Creates load balancer, instances, auto scaling and
monitoring automatically
Monitoring & Logs
Integrated with Cloud Watch and consolidates
server logs
Versioning
Notifications
Full resource access
Manage versions of applications and easily rollback
deployments
Receive alerts on key events
Access all underlying AWS resources as necessary
64. Deployment & Admin
Cloud Formation
Automate creation of ‘stacks’ in a repeatable way
Scripting framework for AWS resource creation
Deployment & Administration
Feature
Platform support
App Services
Resource creation
Compute
Storage
Database
Declarative
Networking
AWS Global Infrastructure
Customizable
Details
Support for AWS resources from EC2 to IAM
Creates AWS resources behind the scenes and
reports on progress
Specify stacks in JSON format and source control
your environments
Drive stack creation with parameters
65. Deployment & Admin
Identity & Access Management
Granular control of user rights with AWS
Automated granting of EC2 service rights
Software Developer Kits
Comprehensive support of programming models for using
Deployment & Administration
App Services
Compute
Storage
Networking
AWS Global Infrastructure
Database
AWS services
66. Easily and rapidly analyze
petabytes of data
Introducing Amazon
Redshift
Data Warehousing the AWS Way
1/10 the cost of traditional data
warehouses
Automated deployment &
administration
Compatible with popular BI tools
67. Internal Testing:
At Least 10X Faster for a Fraction of the Cost
Our Test
On-premises retail
data warehouse
32 nodes, 4.2 TB of
RAM, 1.6 PB of disk
Several million dollars
2 billion row data set
& 6 most complex
queries
Amazon
Redshift
Two 16 TB /
128 GB RAM nodes
$3.65 / hour
68. AWS Data Pipeline
Your Analytics
AWS Data Pipeline
Your analysis
Orchestration service for data-driven workflows
Create automated and scheduled data flows
Pre-integrated with AWS data sources
Easily connect with 3rd party & on-premises sources
72. Why are customers adopting cloud computing?
Variable expense
Economies of scale
Elastic capacity
Replace capital
expenditure with variable
expense
Lower variable expense
than companies can
achieve themselves
No need to guess
capacity requirements
and over-provision
Speed and agility
Focus on business
Global Reach
Infrastructure in minutes
not weeks
Not undifferentiated
heavy IT lifting
Go global in minutes and
reach a global audience
In this webinar I am going to introduce Amazon Web Services, also known as AWS, and some of the fundamental concepts behind the Amazon Cloud.
Amazon Web Services is part of Amazon.com. Most of us at some point in time have used the online amazon retail store to buy books, cd's and gifts for friends and family. There are three parts to the amazon business: Our retail consumer business where amazon stocks and ships many thousands of different products, our seller business that enables retailers to sell through the same world class online store as amazon, and finally amazon web services, our IT infrastructure business.
We are often asked the question: how did Amazon get into cloud computing? Amazon is really good at providing an immense selection of products, and of shipping those products to customers efficiently. But behind that online capability lies years of experience in providing technical services to the business that ensures our online stores are secure, fast, always available and capable of meeting huge seasonal demand.
Over ten years ago, the technical teams supporting Amazon were moving from providing software and hardware capabilities to a service orientated approach - that is packaging things in an easy to consume way so that deployments by parts of the business were easier, faster and more scalable. As Amazon opened up the it's internal services to third party sellers, and we published simple web services such as our catalog search, it became apparent very quickly that developers were hungry for more, and that Amazon had developed significant technical know-how that could be packaged for others to use. We asked ourselves 'what if we could package everything we do and offer it to others over the web?'. 'What if other businesses could leverage the scale and reach of Amazon.com?'
So in 2006 Amazon Web Services was born. It's mission was clear: to enable businesses and developers to use web services to scalable sophisticated applications. It's interesting to note that what we called Web Services, has now morphed into a common term 'the Cloud'. Amazon Web Services is and always has been a distinct and individual Amazon organisation.
As such let's dispel an urban myth
: AWS is not running on excess amazon.com server capacity. Come xmas and when Amazon.com is undergoing a seasonal spike in load, Amazon does not reclaim computing to finalise orders! There are hundreds of thousands of businesses running on Amazon Web Services ranging in size from the smallest startup to multi-national companies. Indeed, Amazon.com also uses AWS. It's a strategic business for Amazon.
And scale is something AWS is used to dealing with. The Amazon Simple Storage Service, S3, recently passed 1 trillion objects in storage, with a peak transaction rate of 750 thousand per second. That's a lot of objects, all stored with 11 9's of durability.
And scale is something AWS is used to dealing with. The Amazon Simple Storage Service, S3, recently passed 1 trillion objects in storage, with a peak transaction rate of 750 thousand per second. That's a lot of objects, all stored with 11 9's of durability.
By taking the services delivered from traditional data centers and wrapping them all in a consistent programming interface, or API,
services that are normally expensive to manage or difficult to use become available on-demand, in a uniform and available way, and only paid for when used. Just like electricity.This is what AWS does. It takes away the hard work from providing infrastructure IT services and makes them available to anyone on a pay as you go basis.
And just like an electricity grid, where you would not wire every factory to the same power station, the AWS infrastructure is global, with multiple regions around the globe from which services are available. This means you have control over things like where you applications run, where you data is stored, and where best to serve your customers from.
Each AWS region is also split into Availability Zones, making highly available applications possible from within a region.
And the whole footprint is supported by many edge locations, places from which content can be served to your customers for the fast possible response times.
Let's take a quick look at what that means with a tangible example. Here, two commands are issued against AWS to create servers, or EC2 instances, in two zones in the EU. We're creating 8 instances of differing sizes, running geopgrahically distinct for availability purposes, all from 2 simple commands. Once booted, in a matter of a minute or two, those server instances are available to you to run your own applications on. Amazon has done the heavy lifting for you, so you can focus on using the compute resources available to you.
Continuing the example, here we have created 4 new large servers in the US,
and lastly, by way of illustration, creating an auto-scaling group that will expand to 200 servers if a spike in load occurs, changing firewall rules and adding load balancing.
And of course, all of this functionality is available through a web console, so whether you want to drive the cloud by the click of a mouse or the call of an API, the power is at your disposal.
Back in 2008, they launched a Facebook application that lets people tell their friends when they've uploaded a video that includes that friend. When people saw the music videos their friends created when the application shared it with them, they wanted to go out and create their own videos. Shortly after launching their social networking modification, they were featured on Techcrunch. As you can imagine, this brought them a lot of unexpected traffic. In the course of 3 days, they went from running on 40 instances to 5,000 instances. Because they were using Amazon Web Services, they were able to handle all of this incoming traffic without having to do a thing. AWS managed it all for them.