SlideShare a Scribd company logo
1 of 21
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Auto Scaling in Amazon
DynamoDB
Vijay Natarajan
Principal Product Manager
08/17/2017
Agenda
• Amazon DynamoDB Overview
• Auto Scaling
• Overview
• Console Experience & API Actions
• Under the Cover
• Best Practices
Amazon DynamoDB Overview
Amazon DynamoDB
• NoSQL Database
• Fully-managed
• Massive and seamless scalability
• Response times in microseconds
• Highly available
• Integration with AWS Services
• Pay-as-you-go model
DynamoDB Journey
Dec ‘04:
Suffers
outage
Oct ‘07:
Dynamo paper
published
Jan ‘12:
DynamoDB
General
Availability
Q3 ‘16:
Leader in Gartner
MQ, Forrester
Wave
Today:
• Available in 16 regions
• Millions of tables, several >100TB
• 10’s of PBs of data; Trillions of
requests/month
Tier-0 service powering most of Amazon
Fully Managed NoSQL Database Service
Databases hosted on premise Database hosted on Amazon EC2
Managed by You
Managed by AWS
Amazon DynamoDB
1. Scalability
2. Performance
3. Security & Monitoring
4. Availability & Data Protection
5. Manageability & TCO
6. Dev Platform & Tools
DynamoDB Investment Pillars
• Millions of
reads/sec from
single DAX
cluster
• Unlimited items
and storage
• Auto scale
throughput based
on consumption
• Consistent, single
digit millisecond
latency
• Optimized for
analytics
workloads with
native indexing
• Microsecond
response times
with DynamoDB
Accelerator (DAX)
• Control user
access at items
and attributes
level
• SOC, PCI, ISO,
FedRAMP (Mod &
High), HIPAA
BAA, DoD IL4
• Monitor with
CloudWatch
metrics & logging
with CloudTrail
• Client-side
encryption library
• Secure, private
VPC endpoints
• Designed for
99.99% high
availability (HA)
• Built-in replication
across 3 zones
• Fully-managed
• Perpetual free tier
• Pay-as-you-grow
for capacity and
storage
independently
• Track table level
spending with
Tagging
• Purge data
automatically
(Time To Live)
• Event-driven
programming with
Triggers &
Lambda
• Advanced
analytics with
EMR & Amazon
Redshift
• Full-text query
support with
Amazon
Elasticsearch
Service
• Real-time stream
processing with
Amazon Kinesis
• DMS connector
for MongoDB to
DynamoDB
Scalability Performance Security Availability &
Data Protection
Manageability &
TCO
Dev Platform &
Tools
Key Customer Segments
• Ad-tech
• Gaming
• IoT
• Mobile
• Web
• Storage
• Education
• Media
• E-Commerce
• Telecom
• Financial services
• BioTech
• Healthcare
• Retail
• Networking
Auto Scaling
Overview
• Removes the guesswork out of provisioning
adequate capacity for new workloads
• Reduces operational burden of monitoring and
adjusting capacity as application demands change
• Scales up capacity as application request rates
accelerate ensuring optimal performance
• Scales down capacity as application request rates
slow down reducing costs
• No additional costs for Auto Scaling
• Fully-managed, automatic scaling of
throughput capacity for read and write of
tables and global secondary indexes
• Set only target utilization % (consumed
capacity/provisioned capacity), minimum and
maximum limits
• Configurable from management console,
CLI, and SDK
• Works with existing tables and GSI; Enabled
by default for new tables
• Full visibility into scaling activities from
console
• Powered by Application Auto Scaling which
also supports EC2, ECS, EMR, AppStream
Feature Key Benefits
Console Experience (contd.)
Console Experience (contd.)
Console Experience (contd.)
Console Experience (contd.)
Console Experience
• RegisterScalableTarget: Registers or updates a scalable target (Table or GSI)
• DeregisterScalableTarget: Deregister a scalable target and delete its scaling policies
• PutScalingPolicy: Create new or Update existing policy of scalable target
• DeleteScalingPolicy: Delete a policy
• DescribeScalingPolicies: Get policies description, filtered by table, GSI, read, write
• DescribeScalableTargets: Get information of the table or GSI being scaled
• DescribeScalingActivities: Get 6 weeks’ scaling activities history of a table or GSI
Application AutoScaling API Actions
How Auto Scaling Works
1. User creates Application Auto Scaling policy for a
table
2. DynamoDB publishes consumed capacity metrics to
Amazon CloudWatch.
3. If consumed capacity exceeds target utilization (or
falls below target), Amazon CloudWatch triggers an
alarm
4. The CloudWatch alarm invokes Application Auto
Scaling to evaluate your scaling policy
5. Application Auto Scaling sends UpdateTable
API request to DynamoDB to adjust table's
provisioned throughput
6. DynamoDB processes the UpdateTable request
increasing (or decreasing) table's provisioned
throughput capacity so that it approaches your
target utilization.
• Auto Scaling is best suited for predictable, gradually changing traffic patterns
• Start with default settings for new tables/GSI, and make adjustments over time
• Optimize for the daily scale down limits, currently, nine per day
• For known time window of traffic spikes, disable Auto Scaling and update manual
provisioning programmatically
• Apply same settings to GSI as tables, for optimal query performance
Best Practices
Getting Started with DynamoDB:
https://aws.amazon.com/dynamodb/
http://docs.aws.amazon.com/amazondynamodb/latest/gettingstartedguide/Welcome.html
Getting Started with DynamoDB Auto Scaling:
http://docs.aws.amazon.com/amazondynamodb/latest/developerguide/AutoScaling.html
Additional Resources
Thank you!

More Related Content

What's hot

Scaling the Platform for Your Startup
Scaling the Platform for Your StartupScaling the Platform for Your Startup
Scaling the Platform for Your StartupAmazon Web Services
 
How TrueCar Gains Actionable Insights with Splunk Cloud PPT
How TrueCar Gains Actionable Insights with Splunk Cloud PPTHow TrueCar Gains Actionable Insights with Splunk Cloud PPT
How TrueCar Gains Actionable Insights with Splunk Cloud PPTAmazon Web Services
 
Amazon EC2 and Amazon VPC Hands-on Workshop
Amazon EC2 and Amazon VPC Hands-on WorkshopAmazon EC2 and Amazon VPC Hands-on Workshop
Amazon EC2 and Amazon VPC Hands-on WorkshopAmazon Web Services
 
Seamlessly Extend Your Datacenter to the Cloud with Commvault on AWS
Seamlessly Extend Your Datacenter to the Cloud with Commvault on AWSSeamlessly Extend Your Datacenter to the Cloud with Commvault on AWS
Seamlessly Extend Your Datacenter to the Cloud with Commvault on AWSAmazon Web Services
 
BDA308 Deep Dive: Log Analytics with Amazon Elasticsearch Service
BDA308 Deep Dive: Log Analytics with Amazon Elasticsearch ServiceBDA308 Deep Dive: Log Analytics with Amazon Elasticsearch Service
BDA308 Deep Dive: Log Analytics with Amazon Elasticsearch ServiceAmazon Web Services
 
Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...
Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...
Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...Amazon Web Services
 
ENT204 The AWS Cloud Value Framework
ENT204 The AWS Cloud Value FrameworkENT204 The AWS Cloud Value Framework
ENT204 The AWS Cloud Value FrameworkAmazon Web Services
 
Aws for Startups Building Cloud Enabled Apps
Aws for Startups Building Cloud Enabled AppsAws for Startups Building Cloud Enabled Apps
Aws for Startups Building Cloud Enabled AppsAmazon Web Services
 
Accelerating Life Sciences with HPC on AWS - AWS Online Tech Talks
Accelerating Life Sciences with HPC on AWS - AWS Online Tech TalksAccelerating Life Sciences with HPC on AWS - AWS Online Tech Talks
Accelerating Life Sciences with HPC on AWS - AWS Online Tech TalksAmazon Web Services
 
ABD322_Implementing a Flight Simulator Interface Using AI, Virtual Reality, a...
ABD322_Implementing a Flight Simulator Interface Using AI, Virtual Reality, a...ABD322_Implementing a Flight Simulator Interface Using AI, Virtual Reality, a...
ABD322_Implementing a Flight Simulator Interface Using AI, Virtual Reality, a...Amazon Web Services
 
SRV313 Introduction to Building Web Apps on AWS
 SRV313 Introduction to Building Web Apps on AWS SRV313 Introduction to Building Web Apps on AWS
SRV313 Introduction to Building Web Apps on AWSAmazon Web Services
 
Introduction to GraphQL and AWS Appsync on AWS - iOS
Introduction to GraphQL and AWS Appsync on AWS - iOSIntroduction to GraphQL and AWS Appsync on AWS - iOS
Introduction to GraphQL and AWS Appsync on AWS - iOSAmazon Web Services
 
Create a Serverless Image Processing Platform
Create a Serverless Image Processing PlatformCreate a Serverless Image Processing Platform
Create a Serverless Image Processing PlatformAmazon Web Services
 
SRV320 Deep Dive on VMware Cloud on AWS
 SRV320 Deep Dive on VMware Cloud on AWS SRV320 Deep Dive on VMware Cloud on AWS
SRV320 Deep Dive on VMware Cloud on AWSAmazon Web Services
 
Born in the Cloud, Built like a Startup
Born in the Cloud, Built like a StartupBorn in the Cloud, Built like a Startup
Born in the Cloud, Built like a StartupAmazon Web Services
 
Builders' Day - Building Data Lakes for Analytics On AWS LC
Builders' Day - Building Data Lakes for Analytics On AWS LCBuilders' Day - Building Data Lakes for Analytics On AWS LC
Builders' Day - Building Data Lakes for Analytics On AWS LCAmazon Web Services LATAM
 
SRV301-Optimizing Serverless Application Data Tiers with Amazon DynamoDB
SRV301-Optimizing Serverless Application Data Tiers with Amazon DynamoDBSRV301-Optimizing Serverless Application Data Tiers with Amazon DynamoDB
SRV301-Optimizing Serverless Application Data Tiers with Amazon DynamoDBAmazon Web Services
 
Lighting your Big Data Fire with Apache Spark
Lighting your Big Data Fire with Apache SparkLighting your Big Data Fire with Apache Spark
Lighting your Big Data Fire with Apache SparkAmazon Web Services
 
Modernize and Move your Microsoft Applications on AWS
Modernize and Move your Microsoft Applications on AWSModernize and Move your Microsoft Applications on AWS
Modernize and Move your Microsoft Applications on AWSAmazon Web Services
 

What's hot (20)

Scaling the Platform for Your Startup
Scaling the Platform for Your StartupScaling the Platform for Your Startup
Scaling the Platform for Your Startup
 
How TrueCar Gains Actionable Insights with Splunk Cloud PPT
How TrueCar Gains Actionable Insights with Splunk Cloud PPTHow TrueCar Gains Actionable Insights with Splunk Cloud PPT
How TrueCar Gains Actionable Insights with Splunk Cloud PPT
 
Amazon EC2 and Amazon VPC Hands-on Workshop
Amazon EC2 and Amazon VPC Hands-on WorkshopAmazon EC2 and Amazon VPC Hands-on Workshop
Amazon EC2 and Amazon VPC Hands-on Workshop
 
Seamlessly Extend Your Datacenter to the Cloud with Commvault on AWS
Seamlessly Extend Your Datacenter to the Cloud with Commvault on AWSSeamlessly Extend Your Datacenter to the Cloud with Commvault on AWS
Seamlessly Extend Your Datacenter to the Cloud with Commvault on AWS
 
BDA308 Deep Dive: Log Analytics with Amazon Elasticsearch Service
BDA308 Deep Dive: Log Analytics with Amazon Elasticsearch ServiceBDA308 Deep Dive: Log Analytics with Amazon Elasticsearch Service
BDA308 Deep Dive: Log Analytics with Amazon Elasticsearch Service
 
State of the Union: Storage
State of the Union: StorageState of the Union: Storage
State of the Union: Storage
 
Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...
Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...
Understanding AWS Managed Databases and Analytic Services - AWS Innovate Otta...
 
ENT204 The AWS Cloud Value Framework
ENT204 The AWS Cloud Value FrameworkENT204 The AWS Cloud Value Framework
ENT204 The AWS Cloud Value Framework
 
Aws for Startups Building Cloud Enabled Apps
Aws for Startups Building Cloud Enabled AppsAws for Startups Building Cloud Enabled Apps
Aws for Startups Building Cloud Enabled Apps
 
Accelerating Life Sciences with HPC on AWS - AWS Online Tech Talks
Accelerating Life Sciences with HPC on AWS - AWS Online Tech TalksAccelerating Life Sciences with HPC on AWS - AWS Online Tech Talks
Accelerating Life Sciences with HPC on AWS - AWS Online Tech Talks
 
ABD322_Implementing a Flight Simulator Interface Using AI, Virtual Reality, a...
ABD322_Implementing a Flight Simulator Interface Using AI, Virtual Reality, a...ABD322_Implementing a Flight Simulator Interface Using AI, Virtual Reality, a...
ABD322_Implementing a Flight Simulator Interface Using AI, Virtual Reality, a...
 
SRV313 Introduction to Building Web Apps on AWS
 SRV313 Introduction to Building Web Apps on AWS SRV313 Introduction to Building Web Apps on AWS
SRV313 Introduction to Building Web Apps on AWS
 
Introduction to GraphQL and AWS Appsync on AWS - iOS
Introduction to GraphQL and AWS Appsync on AWS - iOSIntroduction to GraphQL and AWS Appsync on AWS - iOS
Introduction to GraphQL and AWS Appsync on AWS - iOS
 
Create a Serverless Image Processing Platform
Create a Serverless Image Processing PlatformCreate a Serverless Image Processing Platform
Create a Serverless Image Processing Platform
 
SRV320 Deep Dive on VMware Cloud on AWS
 SRV320 Deep Dive on VMware Cloud on AWS SRV320 Deep Dive on VMware Cloud on AWS
SRV320 Deep Dive on VMware Cloud on AWS
 
Born in the Cloud, Built like a Startup
Born in the Cloud, Built like a StartupBorn in the Cloud, Built like a Startup
Born in the Cloud, Built like a Startup
 
Builders' Day - Building Data Lakes for Analytics On AWS LC
Builders' Day - Building Data Lakes for Analytics On AWS LCBuilders' Day - Building Data Lakes for Analytics On AWS LC
Builders' Day - Building Data Lakes for Analytics On AWS LC
 
SRV301-Optimizing Serverless Application Data Tiers with Amazon DynamoDB
SRV301-Optimizing Serverless Application Data Tiers with Amazon DynamoDBSRV301-Optimizing Serverless Application Data Tiers with Amazon DynamoDB
SRV301-Optimizing Serverless Application Data Tiers with Amazon DynamoDB
 
Lighting your Big Data Fire with Apache Spark
Lighting your Big Data Fire with Apache SparkLighting your Big Data Fire with Apache Spark
Lighting your Big Data Fire with Apache Spark
 
Modernize and Move your Microsoft Applications on AWS
Modernize and Move your Microsoft Applications on AWSModernize and Move your Microsoft Applications on AWS
Modernize and Move your Microsoft Applications on AWS
 

Similar to Amazon DynamoDB - Auto Scaling Webinar - v3.pptx

AWS January 2016 Webinar Series - Getting Started with Big Data on AWS
AWS January 2016 Webinar Series - Getting Started with Big Data on AWSAWS January 2016 Webinar Series - Getting Started with Big Data on AWS
AWS January 2016 Webinar Series - Getting Started with Big Data on AWSAmazon Web Services
 
DAT320_Moving a Galaxy into Cloud
DAT320_Moving a Galaxy into CloudDAT320_Moving a Galaxy into Cloud
DAT320_Moving a Galaxy into CloudAmazon Web Services
 
AWS re:Invent 2016: AWS Database State of the Union (DAT320)
AWS re:Invent 2016: AWS Database State of the Union (DAT320)AWS re:Invent 2016: AWS Database State of the Union (DAT320)
AWS re:Invent 2016: AWS Database State of the Union (DAT320)Amazon Web Services
 
Introducing Amazon Kinesis: Real-time Processing of Streaming Big Data (BDT10...
Introducing Amazon Kinesis: Real-time Processing of Streaming Big Data (BDT10...Introducing Amazon Kinesis: Real-time Processing of Streaming Big Data (BDT10...
Introducing Amazon Kinesis: Real-time Processing of Streaming Big Data (BDT10...Amazon Web Services
 
AWS Summit 2013 | Singapore - Big Data Analytics, Presented by AWS, Intel and...
AWS Summit 2013 | Singapore - Big Data Analytics, Presented by AWS, Intel and...AWS Summit 2013 | Singapore - Big Data Analytics, Presented by AWS, Intel and...
AWS Summit 2013 | Singapore - Big Data Analytics, Presented by AWS, Intel and...Amazon Web Services
 
Introduction to AWS Database Services
Introduction to AWS Database ServicesIntroduction to AWS Database Services
Introduction to AWS Database ServicesAmazon Web Services
 
Introduction to AWS Database Services
Introduction to AWS Database ServicesIntroduction to AWS Database Services
Introduction to AWS Database ServicesAmazon Web Services
 
AWS Cloud Kata 2013 | Singapore - Getting to Scale on AWS
AWS Cloud Kata 2013 | Singapore - Getting to Scale on AWSAWS Cloud Kata 2013 | Singapore - Getting to Scale on AWS
AWS Cloud Kata 2013 | Singapore - Getting to Scale on AWSAmazon Web Services
 
AWS re:Invent 2016: Event Handling at Scale: Designing an Auditable Ingestion...
AWS re:Invent 2016: Event Handling at Scale: Designing an Auditable Ingestion...AWS re:Invent 2016: Event Handling at Scale: Designing an Auditable Ingestion...
AWS re:Invent 2016: Event Handling at Scale: Designing an Auditable Ingestion...Amazon Web Services
 
What's New with Amazon DynamoDB - AWS Online Tech Talks
What's New with Amazon DynamoDB - AWS Online Tech TalksWhat's New with Amazon DynamoDB - AWS Online Tech Talks
What's New with Amazon DynamoDB - AWS Online Tech TalksAmazon Web Services
 
Cloud Data Strategy event London
Cloud Data Strategy event LondonCloud Data Strategy event London
Cloud Data Strategy event LondonMongoDB
 
AWSome Day 2016 - Module 4: Databases: Amazon DynamoDB and Amazon RDS
AWSome Day 2016 - Module 4: Databases: Amazon DynamoDB and Amazon RDSAWSome Day 2016 - Module 4: Databases: Amazon DynamoDB and Amazon RDS
AWSome Day 2016 - Module 4: Databases: Amazon DynamoDB and Amazon RDSAmazon Web Services
 
Scaling your Analytics with Amazon Elastic MapReduce (BDT301) | AWS re:Invent...
Scaling your Analytics with Amazon Elastic MapReduce (BDT301) | AWS re:Invent...Scaling your Analytics with Amazon Elastic MapReduce (BDT301) | AWS re:Invent...
Scaling your Analytics with Amazon Elastic MapReduce (BDT301) | AWS re:Invent...Amazon Web Services
 
AWS Partner Webcast - Analyze Big Data for Consumer Applications with Looker ...
AWS Partner Webcast - Analyze Big Data for Consumer Applications with Looker ...AWS Partner Webcast - Analyze Big Data for Consumer Applications with Looker ...
AWS Partner Webcast - Analyze Big Data for Consumer Applications with Looker ...Amazon Web Services
 
AWS Summit 2013 | India - Petabyte Scale Data Warehousing at Low Cost, Abhish...
AWS Summit 2013 | India - Petabyte Scale Data Warehousing at Low Cost, Abhish...AWS Summit 2013 | India - Petabyte Scale Data Warehousing at Low Cost, Abhish...
AWS Summit 2013 | India - Petabyte Scale Data Warehousing at Low Cost, Abhish...Amazon Web Services
 
Introducing Database Offerings on AWS - Technical 101
Introducing Database Offerings on AWS - Technical 101Introducing Database Offerings on AWS - Technical 101
Introducing Database Offerings on AWS - Technical 101Amazon Web Services
 
Data warehousing in the era of Big Data: Deep Dive into Amazon Redshift
Data warehousing in the era of Big Data: Deep Dive into Amazon RedshiftData warehousing in the era of Big Data: Deep Dive into Amazon Redshift
Data warehousing in the era of Big Data: Deep Dive into Amazon RedshiftAmazon Web Services
 
Advanced Design Patterns for Amazon DynamoDB - Workshop (DAT404-R1) - AWS re:...
Advanced Design Patterns for Amazon DynamoDB - Workshop (DAT404-R1) - AWS re:...Advanced Design Patterns for Amazon DynamoDB - Workshop (DAT404-R1) - AWS re:...
Advanced Design Patterns for Amazon DynamoDB - Workshop (DAT404-R1) - AWS re:...Amazon Web Services
 

Similar to Amazon DynamoDB - Auto Scaling Webinar - v3.pptx (20)

AWS January 2016 Webinar Series - Getting Started with Big Data on AWS
AWS January 2016 Webinar Series - Getting Started with Big Data on AWSAWS January 2016 Webinar Series - Getting Started with Big Data on AWS
AWS January 2016 Webinar Series - Getting Started with Big Data on AWS
 
DAT320_Moving a Galaxy into Cloud
DAT320_Moving a Galaxy into CloudDAT320_Moving a Galaxy into Cloud
DAT320_Moving a Galaxy into Cloud
 
What's new in AWS?
What's new in AWS?What's new in AWS?
What's new in AWS?
 
AWS re:Invent 2016: AWS Database State of the Union (DAT320)
AWS re:Invent 2016: AWS Database State of the Union (DAT320)AWS re:Invent 2016: AWS Database State of the Union (DAT320)
AWS re:Invent 2016: AWS Database State of the Union (DAT320)
 
Introducing Amazon Kinesis: Real-time Processing of Streaming Big Data (BDT10...
Introducing Amazon Kinesis: Real-time Processing of Streaming Big Data (BDT10...Introducing Amazon Kinesis: Real-time Processing of Streaming Big Data (BDT10...
Introducing Amazon Kinesis: Real-time Processing of Streaming Big Data (BDT10...
 
AWS Summit 2013 | Singapore - Big Data Analytics, Presented by AWS, Intel and...
AWS Summit 2013 | Singapore - Big Data Analytics, Presented by AWS, Intel and...AWS Summit 2013 | Singapore - Big Data Analytics, Presented by AWS, Intel and...
AWS Summit 2013 | Singapore - Big Data Analytics, Presented by AWS, Intel and...
 
Introduction to AWS Database Services
Introduction to AWS Database ServicesIntroduction to AWS Database Services
Introduction to AWS Database Services
 
Introduction to AWS Database Services
Introduction to AWS Database ServicesIntroduction to AWS Database Services
Introduction to AWS Database Services
 
AWS Cloud Kata 2013 | Singapore - Getting to Scale on AWS
AWS Cloud Kata 2013 | Singapore - Getting to Scale on AWSAWS Cloud Kata 2013 | Singapore - Getting to Scale on AWS
AWS Cloud Kata 2013 | Singapore - Getting to Scale on AWS
 
AWS re:Invent 2016: Event Handling at Scale: Designing an Auditable Ingestion...
AWS re:Invent 2016: Event Handling at Scale: Designing an Auditable Ingestion...AWS re:Invent 2016: Event Handling at Scale: Designing an Auditable Ingestion...
AWS re:Invent 2016: Event Handling at Scale: Designing an Auditable Ingestion...
 
What's New with Amazon DynamoDB - AWS Online Tech Talks
What's New with Amazon DynamoDB - AWS Online Tech TalksWhat's New with Amazon DynamoDB - AWS Online Tech Talks
What's New with Amazon DynamoDB - AWS Online Tech Talks
 
Cloud Data Strategy event London
Cloud Data Strategy event LondonCloud Data Strategy event London
Cloud Data Strategy event London
 
AWSome Day 2016 - Module 4: Databases: Amazon DynamoDB and Amazon RDS
AWSome Day 2016 - Module 4: Databases: Amazon DynamoDB and Amazon RDSAWSome Day 2016 - Module 4: Databases: Amazon DynamoDB and Amazon RDS
AWSome Day 2016 - Module 4: Databases: Amazon DynamoDB and Amazon RDS
 
Scaling your Analytics with Amazon Elastic MapReduce (BDT301) | AWS re:Invent...
Scaling your Analytics with Amazon Elastic MapReduce (BDT301) | AWS re:Invent...Scaling your Analytics with Amazon Elastic MapReduce (BDT301) | AWS re:Invent...
Scaling your Analytics with Amazon Elastic MapReduce (BDT301) | AWS re:Invent...
 
AWS Partner Webcast - Analyze Big Data for Consumer Applications with Looker ...
AWS Partner Webcast - Analyze Big Data for Consumer Applications with Looker ...AWS Partner Webcast - Analyze Big Data for Consumer Applications with Looker ...
AWS Partner Webcast - Analyze Big Data for Consumer Applications with Looker ...
 
AWS Summit 2013 | India - Petabyte Scale Data Warehousing at Low Cost, Abhish...
AWS Summit 2013 | India - Petabyte Scale Data Warehousing at Low Cost, Abhish...AWS Summit 2013 | India - Petabyte Scale Data Warehousing at Low Cost, Abhish...
AWS Summit 2013 | India - Petabyte Scale Data Warehousing at Low Cost, Abhish...
 
Introducing Database Offerings on AWS - Technical 101
Introducing Database Offerings on AWS - Technical 101Introducing Database Offerings on AWS - Technical 101
Introducing Database Offerings on AWS - Technical 101
 
Data warehousing in the era of Big Data: Deep Dive into Amazon Redshift
Data warehousing in the era of Big Data: Deep Dive into Amazon RedshiftData warehousing in the era of Big Data: Deep Dive into Amazon Redshift
Data warehousing in the era of Big Data: Deep Dive into Amazon Redshift
 
Real-Time Streaming Data on AWS
Real-Time Streaming Data on AWSReal-Time Streaming Data on AWS
Real-Time Streaming Data on AWS
 
Advanced Design Patterns for Amazon DynamoDB - Workshop (DAT404-R1) - AWS re:...
Advanced Design Patterns for Amazon DynamoDB - Workshop (DAT404-R1) - AWS re:...Advanced Design Patterns for Amazon DynamoDB - Workshop (DAT404-R1) - AWS re:...
Advanced Design Patterns for Amazon DynamoDB - Workshop (DAT404-R1) - AWS re:...
 

More from Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateAmazon Web Services
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSAmazon Web Services
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareAmazon Web Services
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAmazon Web Services
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWSAmazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckAmazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without serversAmazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceAmazon Web Services
 

More from Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Amazon DynamoDB - Auto Scaling Webinar - v3.pptx

  • 1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Auto Scaling in Amazon DynamoDB Vijay Natarajan Principal Product Manager 08/17/2017
  • 2. Agenda • Amazon DynamoDB Overview • Auto Scaling • Overview • Console Experience & API Actions • Under the Cover • Best Practices
  • 4. Amazon DynamoDB • NoSQL Database • Fully-managed • Massive and seamless scalability • Response times in microseconds • Highly available • Integration with AWS Services • Pay-as-you-go model
  • 5. DynamoDB Journey Dec ‘04: Suffers outage Oct ‘07: Dynamo paper published Jan ‘12: DynamoDB General Availability Q3 ‘16: Leader in Gartner MQ, Forrester Wave Today: • Available in 16 regions • Millions of tables, several >100TB • 10’s of PBs of data; Trillions of requests/month Tier-0 service powering most of Amazon
  • 6. Fully Managed NoSQL Database Service Databases hosted on premise Database hosted on Amazon EC2 Managed by You Managed by AWS Amazon DynamoDB
  • 7. 1. Scalability 2. Performance 3. Security & Monitoring 4. Availability & Data Protection 5. Manageability & TCO 6. Dev Platform & Tools DynamoDB Investment Pillars
  • 8. • Millions of reads/sec from single DAX cluster • Unlimited items and storage • Auto scale throughput based on consumption • Consistent, single digit millisecond latency • Optimized for analytics workloads with native indexing • Microsecond response times with DynamoDB Accelerator (DAX) • Control user access at items and attributes level • SOC, PCI, ISO, FedRAMP (Mod & High), HIPAA BAA, DoD IL4 • Monitor with CloudWatch metrics & logging with CloudTrail • Client-side encryption library • Secure, private VPC endpoints • Designed for 99.99% high availability (HA) • Built-in replication across 3 zones • Fully-managed • Perpetual free tier • Pay-as-you-grow for capacity and storage independently • Track table level spending with Tagging • Purge data automatically (Time To Live) • Event-driven programming with Triggers & Lambda • Advanced analytics with EMR & Amazon Redshift • Full-text query support with Amazon Elasticsearch Service • Real-time stream processing with Amazon Kinesis • DMS connector for MongoDB to DynamoDB Scalability Performance Security Availability & Data Protection Manageability & TCO Dev Platform & Tools
  • 9. Key Customer Segments • Ad-tech • Gaming • IoT • Mobile • Web • Storage • Education • Media • E-Commerce • Telecom • Financial services • BioTech • Healthcare • Retail • Networking
  • 11. Overview • Removes the guesswork out of provisioning adequate capacity for new workloads • Reduces operational burden of monitoring and adjusting capacity as application demands change • Scales up capacity as application request rates accelerate ensuring optimal performance • Scales down capacity as application request rates slow down reducing costs • No additional costs for Auto Scaling • Fully-managed, automatic scaling of throughput capacity for read and write of tables and global secondary indexes • Set only target utilization % (consumed capacity/provisioned capacity), minimum and maximum limits • Configurable from management console, CLI, and SDK • Works with existing tables and GSI; Enabled by default for new tables • Full visibility into scaling activities from console • Powered by Application Auto Scaling which also supports EC2, ECS, EMR, AppStream Feature Key Benefits
  • 17. • RegisterScalableTarget: Registers or updates a scalable target (Table or GSI) • DeregisterScalableTarget: Deregister a scalable target and delete its scaling policies • PutScalingPolicy: Create new or Update existing policy of scalable target • DeleteScalingPolicy: Delete a policy • DescribeScalingPolicies: Get policies description, filtered by table, GSI, read, write • DescribeScalableTargets: Get information of the table or GSI being scaled • DescribeScalingActivities: Get 6 weeks’ scaling activities history of a table or GSI Application AutoScaling API Actions
  • 18. How Auto Scaling Works 1. User creates Application Auto Scaling policy for a table 2. DynamoDB publishes consumed capacity metrics to Amazon CloudWatch. 3. If consumed capacity exceeds target utilization (or falls below target), Amazon CloudWatch triggers an alarm 4. The CloudWatch alarm invokes Application Auto Scaling to evaluate your scaling policy 5. Application Auto Scaling sends UpdateTable API request to DynamoDB to adjust table's provisioned throughput 6. DynamoDB processes the UpdateTable request increasing (or decreasing) table's provisioned throughput capacity so that it approaches your target utilization.
  • 19. • Auto Scaling is best suited for predictable, gradually changing traffic patterns • Start with default settings for new tables/GSI, and make adjustments over time • Optimize for the daily scale down limits, currently, nine per day • For known time window of traffic spikes, disable Auto Scaling and update manual provisioning programmatically • Apply same settings to GSI as tables, for optimal query performance Best Practices
  • 20. Getting Started with DynamoDB: https://aws.amazon.com/dynamodb/ http://docs.aws.amazon.com/amazondynamodb/latest/gettingstartedguide/Welcome.html Getting Started with DynamoDB Auto Scaling: http://docs.aws.amazon.com/amazondynamodb/latest/developerguide/AutoScaling.html Additional Resources

Editor's Notes

  1. Hi, I am Vijay Natarajan, and I am a principal product manager focusing on Auto Scaling, DynamoDB Accelerator and Developer Experience for Amazon DynamoDB in Amazon Web Services
  2. As some of you joining today are new to DynamoDB, we’ll spend some time in getting to know DynamoDB, and then switch to the main topic of the webinar, Auto Scaling in DynamoDB.
  3. DynamoDB DB is a fully-managed key-value/document store NoSQL service, that offers single-digit millisecond response times at any scale. What that means is that you can start with a single table, add attributes and items to the table without being bound to a schema or particular data types, unlike relational databases, grow the table to hundreds of terabtyes, without any degradation in performance, which is guaranteed to be in single-digit microseconds with DAX or milliseconds directly to DynamoDB. DynamoDB data is automatically replicated to two additional Azs in a region for high availability and integrated with other AWS services , like CW for monitoring, CloudTrail for logging, Elasticsearch for free-text search, and stream processing with Kinesis, event driven programming with Lambda, to name a few. DynamoDB allows you to scale your throughput up or down, anytime and you pay only for what you provision, billed hourly. So, with Auto Scaling, which we would cover shortly, only capacity required by your application is provisioned, and you pay only what is provisioned for each hour for reads and writes separately.
  4. December 6, 2004. Amazon.com website had multi-hour outage. Peak time for retail. 2004: still at a time where not everybody was shopping online like do now Root cause – scaled beyond relational database capabilities. Stepped back and considered new way DynamoDB paper, seminal work defining what was dubbed NoSQL movement Now, in addition to Retail Website, Amazon Marketplace, Fulfillment Centers, Alexa. DynamoDB is tier-0 dependency for MOST of Amazon.
  5. This is the easy-to-use database. You get performance without tuning. You get scalability and multi-az replication without designing a distributed system. You get ongoing security upgrades, software improvements, cost reduction efforts, monitoring…without any effort at all. We built Dynamo to just work so you can focus on your app.
  6. Here is how we think about DynamoDB. As all of Amazon now runs on DynamoDB and our customers rely on us for running their mission critical applications, It behooves upon us to think about our investments and roadmap priorities in a balanced manner. These are the six investment pillars that guides our investments, now lets take a look at our generally available features under each of these pillars
  7. We are seeing DynamoDB usage across multiple customer verticals.
  8. The chart shown here is an actual chart from one of our customers. With auto-scaling the customer has reduced TCO by over 50%.
  9. The chart shown here is an actual chart from one of our customers. With auto-scaling the customer has reduced TCO by over 50%.