Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
ELEKS DevTalks #4: Amazon Web Services Crash Course
1. DevTalks #4
AWS Crash Course
Exploring capabilities of the Cloud
Yuriy Guts
R&D Engineer
yuriy.guts@eleks.com
2. DevTalks #4
What exactly is AWS?
A set of public cloud computing services
that can be used by individuals or organizations.
IaaS = Infrastructure-as-a-Service
PaaS = Platform-as-a-Service
SaaS = Software-as-a-Service
3. DevTalks #4
What can be solved with AWS
• Hosting Web applications
• Running legacy apps
• Massive high-performance computing batch jobs
• Digital asset management
• Data sharing between organizations
• Anywhere access to IT infrastructure
• Handling variable usage patterns
4. DevTalks #4
Key Principles of AWS
• Global Regions & Availability Zones
• Accessible as Web services (HTTP REST, “Query”, SOAP)
• Access credentials: Account ID, Access Key ID, Secret Key.
• Pay-as-you-go: machine hours, IO, free tier.
• High reliability & fault tolerance.
• Eventual consistency.
6. DevTalks #4
Compute
Elastic Compute Cloud (EC2)
Provides scalable virtual private servers
using Xen.
Elastic MapReduce
Allows businesses, researchers, data
analysts, and developers to easily and
cheaply process vast amounts of data.
7. DevTalks #4
Networking
Route 53 Direct Connect
Highly available and scalable Makes it easy to establish a
DNS web service. dedicated network connection
from your premise to AWS.
Elastic Load Balancer Virtual Private Cloud (VPC)
Automatically distributes Creates a logically isolated set of
incoming application traffic across Amazon EC2 instances which can
multiple Amazon EC2 instances. be connected to an existing
network using a VPN connection.
8. DevTalks #4
Storage & Content Delivery
Elastic Block Storage (EBS) Glacier
Persistent block-level storage A low-cost backup storage
volumes for EC2. solution, ideal for archiving.
Simple Storage Service (S3) CloudFront
Key-based replicated two-level A content delivery network (CDN)
storage for any amount of data. for distributing objects to edge
locations near the requester.
9. DevTalks #4
Database
Relational DB Service (RDS) SimpleDB
Scalable DB server with MySQL, Highly available non-relational
Oracle and MSSQL support. storage for small frequent queries.
ElastiCache DynamoDB
In-memory caching for web Non-relational DB service that
applications. provides predictable performance
with seamless scalability.
10. DevTalks #4
Messaging
Simple Queue Service (SQS) Simple Email Service (SES)
Provides a hosted message queue Provides bulk and transactional
for web applications. email sending.
Simple Notification Service (SNS)
Provides a hosted multiprotocol
"push" messaging for web apps.
11. DevTalks #4
Application Services
Simple Workflow (SWF) Flexible Payments Service
Workflow service for building Provides an interface for
scalable, resilient applications. micropayments.
CloudSearch Mechanical Turk
Provides basic full text search and Manages small units of work
indexing of textual content. distributed among many humans.
12. DevTalks #4
Deployment
CloudFormation
Allows creating and updating AWS
resources in a predictable fashion.
Elastic Beanstalk
Provides quick deployment and
management of applications in the cloud.
AWS is unique in the industry for their scale, pace of innovation and rich cross-platform support.Elastic Beanstalk release: July 2011.
•SOAP is deprecated over time as the services evolve.• SDKs are available for multiple languages (Java, Ruby, .NET, PHP). AWS toolkit.•Eventual consistency lets you scale much better than having hard transactions that are the enemy of scalability.•Architecture design guidelines: design for failure, consider eventual consistency, use async communications and stateless services.Example architecture will be analyzed later.
Amazon Elastic MapReduce uses a hosted Hadoop framework running on the web-scale infrastructure of EC2 and Amazon S3.
DynamoDB: instead of specifying instance type, RAM amount and storage capacity we specify the desired number of “read/write units” (1 query x 1 Kb x 1 second) and DynamoDB manages everything behind the scenes.