Keynote 1: AWS re:Invent 2017 Recap - Solutions Overview

2017 AWS re:Invent Recap
D r . X i a Z h a n g , P r i n c i p a l E n t e r p r i s e E v a n g e l i s t
T a i p e i , J a n u a r y 1 6 , 2 0 1 8

B U I L D E R S M U S I C I A N S

“Everything is everything
After winter, must come spring”
Lauryn Hill - Everything Is Everything
https://www.youtube.com/watch?v=i3_dOWYHS7I

First 5 years: 4 regions
2016–2018: 11 regions
Next 5 years: 7 regions
G L O B A L I N F R A S T R U C T U R E
18 regions
49 Availability Zones
108 Points of Presence

CORE SERVICES
Integrated Networking
Rules Engine
Device Shadows
Device SDKs
Device Gateway
Registry
Local Compute
Custom Model
Training & Hosting
Conversational Chatbots
Virtual Desktops
App Streaming
Schema Conversion
Image & Scene
Recognition
Sharing &
Collaboration
Exabyte-Scale
Data Migration
Text to Speech
Corporate Email Application Migration
Database Migration
Regions
Availability Zones
Points of Presence
Data Warehousing
Business Intelligence
Elasticsearch
Hadoop/Spark
Data Pipelines
Streaming Data
Collection
ETL
Streaming Data
Analysis
Interactive SQL
Queries
Queuing & Notifications
Workflow
Email
Transcoding
Deep Learning
(Apache MXNet,
TensorFlow, & others)
Server MigrationCommunications
MARKETPLACE
Business Apps Business Intelligence DevOps Tools Security Networking StorageDatabases
API Gateway
Single Integrated
Console
Identity
Sync
Mobile Analytics
Mobile App Testing
Targeted Push
Notifications
One-click App
Deployment
DevOps Resource
Management
Application Lifecycle
Management
Containers
Triggers
Resource Templates
Build & Test
Analyze & Debug
Identity
Management
Key Management
& Storage
Monitoring &
Logs
Configuration
Compliance
Web Application
Firewall
Assessment
& Reporting
Resource & Usage
Auditing
Access Control
Account
Grouping
DDOS
Protection
TECHNICAL & BUSINESS SUPPORT
Support
Professional
Services
Optimization
Guidance
Partner
Ecosystem
Training &
Certification
Solutions Management Account Management
Security & Billing
Reports
Personalized
Dashboard
Monitoring
Manage
Resources
Data Integration
Integrated Identity &
Access
Integrated Resource &
Deployment Management
Integrated Devices
& Edge Systems
Resource
Templates
Configuration
Tracking
Server
Management
Service
Catalogue
Search
MIGRATIONHYBRID ARCHITECTUREENTERPRISE APPSMACHINE LEARNINGIoTMOBILE SERVICESDEV OPSANALYTICS
APP SERVICES
INFRASTRUCTURE SECURITY & COMPLIANCE MANAGEMENT TOOLS
Compute
VMs, Auto-scaling, Load
Balancing, Containers,
Virtual Private Servers,
Batch Computing, Cloud
Functions, Elastic GPUs,
Edge Computing
Storage
Object, Blocks, File, Archivals,
Import/Export, Exabyte-scale
data transfer
CDN
Databases
Relational, NoSQL,
Caching, Migration,
PostgreSQL compatible
Networking
VPC, DX, DNS
Facial Recognition &
Analysis
Facial Search
Patching
Contact Center
M O S T R O B U S T , F U L L Y F E A T U R E D T E C H N O L O G Y I N F R A S T R U C T U R E P L A T F O R M

516
24 48 61 82
159
280
722
1,017
LAUNCHES
2008 2009 2010 2011 2012 2013 2014 2015 2016
1,430
2017
New capabilities daily
P A C E O F I N N O V A T I O N
A total of 4,339 new features/services since 2006

AWS VENDOR 2 VENDOR 4VENDOR 3
6 RELATI O NAL DATABASE ENG I NES G ENERALLY AVAI LABLE
41 O BJECT AND BLO CK KEY STO RAG E CAPABI LI TI ES 71 INTEGRATIONS WITH PARTNER STORAGE SOLUTIONS
147 KEY SECURI TY, G O VERNANCE AND CO M PLI ANCE CAPABI LI TI ES
18 SERVERLESS EVENT SO URCES
66 KEY M ANAG EM ENT TO O L CAPABI LI TI ES

B R O A D E S T S P E C T R U M O F C O M P U T E I N S T A N C E S
Burstable
T 2
Big Data
Optimized
H 1
Memory
Optimized
R 4
In-
memory
X 1
High
I/O
I 3
Compute
Intensive
C 5
Graphics
Intensive
G 3
General
Purpose
GPU
P 3
Memory
Intensive
X 1 e
General
Purpose
M 5
Virtual
Private
Servers
Bare
Metal
High I/O
I 3 m
Dense
Storage
D 2 F 1
FPGA
Amazon
Lightsail
EC2 Elastic GPUs
Graphics acceleration for
EC2 instances
EC2 Spot Instances
• Hibernation
• No Bid Pricing
N E
W !
NEW! NEW! NEW!
NEW!

Service integrations are
at the container level
Scales to support clusters
and applications of any size
Integration with entire
AWS platform
1 2 3
ALB, Auto Scaling, Batch, Elastic
Beanstalk, CloudFormation, CloudTrail,
CloudWatch Events, CloudWatch Logs,
CloudWatch Metrics, ECR, EC2 Spot, IAM,
NLB, Parameter Store, and VPC
Why customers love ECS
AMAZON ELASTIC CONTAINER SERVICE (ECS)
The easiest way to deploy and manage containers

C U S T O M E R S R U N N I N G C O N T A I N E R S W I T H E C S

A M A Z O N E L A S T I C C O N T A I N E R S E R V I C E
F O R K U B E R N E T E S ( E K S )
Hybrid cloud
compatible
Highly
available
Automated
upgrades and
patches
Integrated with
AWS Services
CloudTrail, CloudWatch,
ELB, IAM, VPC, PrivateLink
NEW!
Managed Kubernetes on AWS
Available in preview

A W S F A R G A T E
No clusters
to manage
Manages underlying
infrastructure
Easy to run,
easy to scale
Run containers on ECS and EKS without managing servers
NEW!
Available for ECS
Available for EKS in 2018

A W S L A M B D A
R u n c o d e w i t h o u t t h i n k i n g a b o u t s e r v e r s
L a n g u a g e s u p p o r t P e r f o r m a n c e
F u n c t i o n
c o n c u r r e n c y
V P C
i n t e g r a t i o n
What are customers asking for?

C U S T O M E R S L O V E L A M B D A

A W S L A M B D A I S E V E R Y W H E R E
Event-driven services Event sources Lambda inside
AWS Lambda Amazon S3 Amazon CloudFormation AWS IoT
Amazon API Gateway Amazon DynamoDB Amazon CloudWatch Logs AWS IoT Button
AWS Step Functions Amazon Kinesis Streams Amazon CloudWatch Events AWS Greengrass
AWS X-Ray Amazon Kinesis Firehose AWS CodeCommit AWS Snowball Edge
Amazon SNS AWS Config AWS Lambda@Edge
Amazon SES Amazon Lex
Amazon Cognito Amazon CloudFront
AWS IoT
AWS Lambda

Discover a collection of
serverless applications
Easily deploy to your AWS
account in a few clicks
Publish your own applications
to share with the community
A W S S E R V E R L E S S
A P P L I C A T I O N R E P O S I T O R Y
Discover, deploy, and publish serverless apps
Available in pre view
NEW!

E V E R Y T H I N G I S E V E R Y T H I N G

E V E R Y T H I N G I S E V E R Y T H I N G
AWS
CodeDeploy
AWS
CloudTrail
AWS Config
and Config
Rules
AWS IAM
AWS
PrivateLink
Managed NAT
Gateway
VMware Cloud
on AWS
Group
Resource
Tagging

“All we have to see
Is that I don’t belong to you
And you don’t belong to me
Freedom! Freedom! Freedom!
You’ve gotta give for what you take”
George Michael - Freedom! ’90
https://www.youtube.com/watch?v=diYAc7gB-0A

E V O L U T I O N O F D A T A B A S E S
Am azon Dynam oDB Am azon Elast iCache
KEY VALUE
DOCUMENT
IN-MEMORY STORE
AURO RA
Am azon RDS
CO M M ERCI AL CO M M UNI TY
R e l a t i o n a l d a t a b a s e s N o n - r e l a t i o n a l d a t a b a s e s
HIGHLY
CONNECTED
DATA

C U S T O M E R S A R E M O V I N G T O O P E N D A T A B A S E S

AMAZON AURORA
MySQL and PostgreSQL compatible
Several times faster than standard MySQL and PostgreSQL
Highly available and durable
1/10th the cost of commercial grade databases
Fastest-growing AWS
service, ever

A U R O R A I S T H E F A S T E S T G R O W I N G S E R V I C E
I N T H E H I S T O R Y O F A W S
Tens of thousands of customers

Application
Read/Write
Master 2
Read/Write
Master 1
Shared Distributed Storage Volume
Availability
Zone 1
Availability
Zone 2
Availability
Zone 3
Read/Write
Master 3
A U R O R A M U L T I - M A S T E R
First relational database service with scale-out
across multiple datacenters for both reads and writes
Zero application downtime from ANY node failure
Zero application downtime from ANY AZ failure
Multi-region coming in 2018
Faster write performance
NEW!
Sign up for the preview

A U R O R A S E R V E R L E S S
Automatically
scales capacity up
and down
Pay per second and
only for the database
capacity you use
Starts up on demand
and shuts down when
not in use
On-demand, auto-scaling serverless database
for applications with unpredictable or cyclical workloads
No need to
provision instances
Sign up for the preview
NEW!

A M A Z O N D Y N A M O D B :
F A S T , F L E X I B L E , N O S Q L D A T A B A S E S E R V I C E

Build high performance, globally
distributed applications
Low latency reads and writes to
locally available tables
Disaster proof with multi-region
redundancy
Easy to setup and no application
re-writes required
DY N A M O DB GLOBAL TABLES
First fully managed, multi-master, multi-region database
NEW!
Generally available

Only cloud database to provide on-demand and continuous backups
NEW!
Backup hundreds of
TB instantaneously
with NO
performance impact
On-Demand Backups
for long term data
archival and
compliance
Point In Time Restore
for short term retention
and protection against
application errors
On-Demand Backup generally available
Point In Time Restore coming early 2018
D Y N A M O D B B A C K U P A N D R E S T O R E

C H A L L E N G E S B U I L D I N G A P P S W I T H H I G H L Y C O N N E C T E D D A T A
Difficult to
maintain
high availability
Difficult to
scale
Relational databases
Existing graph databases
Limited
support for
open standards
Too
expensive
Unnatural for
querying graph
Inefficient
graph
processing
Rigid schema
inflexible for
changing graphs

A M A Z O N N E P T U N E
FA S T A N D S C A L A B L E E A S Y
Build powerful
queries easily with
Gremlin and
SPARQL
6 replicas of your
data across 3 AZs
with full backup and
restore
R E L I A B L E
Supports Apache
TinkerPopTM and
W3C RDF graph
models
O P E N
Fully managed graph database
Store billions of
relationships and
query with milliseconds
latency
NEW!

E V O L U T I O N O F D A T A B A S E S
Am azon Nept une
GRAPH
Am azon Dynam oDB Am azon Elast iCache
KEY VALUE
DOCUMENT
IN-MEMORY STORE
AURO RA
Am azon RDS
CO M M ERCI AL CO M M UNI TY
Relational databases Non-relational databases

“Do you have blind faith? No false hope”
Foo Fighters – Congregation
https://www.youtube.com/watch?v=WMp2PvU2qi8

A M A Z O N S 3 I S T H E M O S T P O P U L A R C H O I C E F O R D A T A L A K E S
Most ways to
bring data in
Best security,
compliance, and
audit capabilities
Object-level
controls
Unmatched
durability,
availability,
and scalability
Twice as
many partner
integrations
Business
insights
into your data

2 0 1 7 G A R T N E R
M A G I C Q U A D R A N T F O R
C L O U D S T O R A G E
“Amazon S3 is the largest public
cloud-based object storage service
as measured by data under
management.”

M A K I N G P E T A B Y T E - S C A L E A N A L Y T I C S A C C E S S I B L E T O
C O M P A N I E S O F A L L S I Z E S
Amazon Redshift
+ Redshif t Spect r um
Amazon
QuickSight
Amazon EMR
Hadoop, Spar k, Pr est o,
Pig, Hive … 19 t ot al
Amazon
Athena
Amazon
Kinesis
Amazon
Elasticsearch Service
AWS Glue
S3 DATA LAKE

M O S T A N A L Y T I C S H A P P E N O N A W S

New API to select and retrieve data
within objects
Accelerate any application that
processes a subset of object data in S3
Improve data access performance by
up to 400%
NEW!
v
Powerful S3 capability to pull out only the object data
you need using standard SQL expressions
S3 SELECT

A N A L Y Z E D A T A F A S T E R W I T H S 3 S E L E C T
8 seconds
Without S3 Select
1.8 seconds
With S3 Select
4.5x faster
3
aggregations
1
table
4
filters
COMPLEX PRESTO QUERY
Against a standard TPC-DS dataset
6 sub-queries with each containing:

GLACIER SELECT
NEW!
Run queries on data stored at rest in Amazon Glacier
Any application can query Glacier data
Retrieve only what you need
Makes Glacier part of your data lake
Generally available
Run queries directly on data stored in Glacier

“Now I know the secret; there is nothing that I lack
If I give my love to you, you’ll surely give it back
Let it rain, let it rain,
Let your love rain down on me
Let it rain, let it rain,
Let it rain, rain, rain”
Eric Clapton - Let It Rain(1970)
https://www.youtube.com/watch?v=y86kDFaJ2h4

Everything is ... a CLOUD!
Everything is … BIG DATA!
Everything is … MACHINE LEARNING!
A L O T O F M L B U Z Z O U T T H E R E T O D A Y

A L O N G H E R I T A G E O F M A C H I N E L E A R N I N G A T A M A Z O N
Personalized
recommendations
Inventing entirely
new customer
experiences
Fulfillment
automation and
inventory
management
Drones Voice driven
interactions

C U S T O M E R S R U N N I N G M A C H I N E L E A R N I N G O N A W S
T O D A Y

Frameworks &
Infrastructure
AWS Deep Learning AMI
GPU
(P3 Instances)
MobileCPU
IoT
(Greengrass)
Vision:
Rekognition Image
Rekognition Video
Speech:
Amazon Polly
Transcribe
Language:
Lex Translate
Comprehend
Apache
MXNet
PyTorch
Cognitive
Toolkit
Keras
Caffe2
& Caffe
TensorFlow Gluon
AW S M L S TA C K
Application
Services
Platform
Services
Amazon Machine
Learning
Mechanical
Turk
Spark &
EMR
Amazon
SageMaker
AWS
DeepLens

B O T T O M L A Y E R : F R A M E W O R K S A N D I N T E R F A C E S
P2
NVIDIA
Tesla V100
GPUs
P3
1 Petaflop of compute
NVLink 2.0
5,120 Tensor cores
128GB of memory
~14X faster than P2
P3 Instance AWS Deep Learning AMI

L I S T E N T O A N D I N V E N T F O R C U S T O M E R S
Frameworks
KERAS
Interfaces

GLUON ( O c t o b e r 2 0 1 7 )
A N E W A P I L I B R A R Y F O R M A C H I N E L E A R N I N G
Flexible, Imperative
Structure
Simple, Easy-to-
Understand Code Dynamic Graphs High Performance
Available in MXNet,
coming soon to CNTK

ML IS STILL TOO COMPLICATED FOR EVERYDAY DEVELOPERS
Collect and
prepare training
data
Choose and
optimize your
ML algorithm
Set up and
manage
environments
for training
Train and tune
model
(trial and error)
Deploy model
in production
Scale and
manage the
production
environment

A M A Z O N S A G E M A K E R
NEW!
Easily build, train, and deploy machine
learning models
Pre-built
notebooks
for common
problems
K-Means Clustering
Principal ComponentAnalysis
Neural Topic Modelling
Factorization Machines
Linear Learner - Regression
XGBoost
Latent DirichletAllocation
Image Classification
Seq2Seq
Linear Learner - Classification
ALGORITHMS
Apache MXNet
TensorFlow
Caffe2, CNTK,
PyTorch, Torch
FRAMEWORKS
Set up and manage
environments for
training
Train and tune
model (trial and
error)
Deploy model
in production
Scale and manage the
production environment
Built-in, high
performance
algorithms
BUILD
Generally available

A M A Z O N S A G E M A K E R
Fully managed
hosting with auto-
scaling
One-click
deployment
Pre-built
notebooks for
common
problems
Built-in, high
performance
algorithms
One-click
training
Hyperparameter
optimization
BUILD TRAIN DEPLOY
NEW!
Generally available
Easily build, train, and deploy machine
learning models

A W S D E E P L E N S
HD video camera
Custom-designed
deep learning
inference engine
Micro-SD
Mini-HDMI
USB
USB
Reset
Audio out
Power
HD video camera
with on-board
compute
optimized for
deep learning
Tutorials, examples,
demos, and pre-built
models
From unboxing
to first inference
in <10 minutes
Integrates with
Amazon SageMaker
and AWS Lambda
10
MIN
NEW!
The world’s first wireless, deep learning
enabled video camera for developers
Available on amazon.com next year

Search, analyze, and organize millions of images
A M A Z O N R E K O G N I T I O N
Objects and scenes
Facial analysis and recognition
Inappropriate content detection
Celebrity recognition
Image in text recognition
A M A Z O N R E K O G N I T I O N I M A G E

A M A Z O N R E K O G N I T I O N V I D E O
Easy to use Batch processing Processes
real-time video
Continually
trained
Low costTimestamp
generation
NEW!
Real-time and batch video analytics
Generally available

A M A Z O N K I N E S I S V I D E O S T R E A M
Securely ingest and store video, audio, and other time-encoded data
NEW!
Generally available
S t r e a m i n g D a t a f r o m C o n n e c t e d D e v i c e s

A M A Z O N T R A N S C R I B E
Support for
telephony audio
Timestamp
generation
Intelligent
punctuation and
formatting
Recognize multiple
speakers
Custom
vocabulary
Multiple
languages
Automatic conversion of speech into
accurate, grammatically correct text
NEW!

A M A Z O N T R A N S L A T E
Real-time
translation
Batch analysis Automatic language recognition Low cost
Automatically translates text between languages
NEW!

Fully managed natural language processing
Discover valuable insights from text
Entities
Key Phrases
Language
Sentiment
Amazon
Comprehend
A M A Z O N C O M P R E H E N D
NEW!
Generally available

Fully managed natural language processing
Discover valuable insights from text
A M A Z O N C O M P R E H E N D
NEW!
Generally available
STORM
WORLD SERIES
STOCK MARKET
WASHINGTON
LIBRARY OF
NEWS ARTICLES
Amazon
Comprehend

“The waiting is the hardest part”
Tom Petty And The Heartbreakers - The Waiting
https://www.youtube.com/watch?v=uMyCa35_mOg

B I L L I O N S O F D E V I C E S W I T H L I M I T E D R E S O U R C E S O N
B O A R D

I o T A r c h i t e c t u r e
AWS AWS IoT Core
Gateway
Endpoints
Greengrass
Things
Sense & Act
Cloud
Storage & Compute
Intelligence
Insights & Logic → Action

L A R G E S T A N D M O S T S U C C E S S F U L I o T D E P L O Y M E N T S R U N O N A W S

A W S I o T 1 - C L I C K
NEW!
One-click creation of an AWS
Lambda trigger for any device
H o w i t W o r k s

A W S I o T D E V I C E M A N A G E M E N T
Provision entire fleet
with one click
Organize
device inventory
Monitor and query
fleet of devices
Remotely
manage devices
NEW!
Securely onboard, organize, monitor and
remotely manage IoT devices at scale

A W S I o T D E V I C E D E F E N D E R
Audit
device
policies
Monitor
device behavior
Identify anomalies
and out of
compliance
behaviors
Generate
alerts
Security management for IoT devices. Define and
enforce security policies for fleets of devices
NEW!
Coming in 2018

A W S I o T A N A L Y T I C S
Integrated
with AWS IoT
Core
Performs ad hoc
queries,
sophisticated
analysis
Stores device
fleet data in
time series data
store
Cleans and
processes data
from device
fleet
Prepares data
for Machine
Learning
NEW!
Fully managed analytics service that cleans,
processes, stores, and analyzes IoT device data

A M A Z O N F R E E R T O S
Send data to AWS
for analysis and
action
Based on
FreeRTOS
Easily connect to
nearby AWS
Greengrass
devices
Libraries to
connect, update,
and secure IoT
devices
Security credentials,
key management
IoT connected operating system for
microcontroller-based edge devices
Generally available
NEW!

Use AWS
Greengrass console
to transfer models to
your devices
Inference on
the device
Devices take
action quickly –
even when
disconnected
Run Machine Learning at the edge
NEW!
GREENGRASS ML INFERENCE
Build and train
models in the
cloud

第二天
Day 2 Partner Summit
Colleen Manaher
Executive Director
Day 3 Andy’s Keynote Day 4 Werner’s Keynote
John Nichols
Director of Enterprise Architecture
Mark Okerstrom
CEO
Roy Joseph
Managing Director
Michelle McKenna-Doyle
SVP and CIO
Dr. Walter Scott
SVP & CTO
Nota Jones
Senior Software Engineer
Mati Kochavi
Founder and CEO
Steve Bashada
EVP and GM
2 0 1 7 r e : I n v e n t C u s t o m e r S p e a k e r s
AWS中国（北京）区域由光环新网运营
AWS中国（宁夏）区域由西云数据运营

第一天第二天
General Available
Preview
Day 1
Amazon Sumerian
AWS Elemental MediaTailor
AWS Elemental MediaConvert
AWS Elemental MediaStore
AWS Elemental Media Package
AWS Elemental MediaLive
Day 2 Tuesday Night Live
AWS AppSync
Amazon GuardDuty
Amazon MQ
AWS PrivateLink
Amazon EC2 Bare Metal Instance
Amazon EC2 M5 Instance
Amazon EC2 H1 Instance
EC2 Spot
Inter-Region VPC Peering
Time Sync
Day 3 Andy’s Keynote
Amazon Neptune
Amazon S3 Select
Amazon Glacier Select
DynamoDB Global Table
DynamoDB Backup-Restore
Amazon Aurora Multi-Master
Amazon Auroa Serverless
EFS File Sync
Amazon Sagemaker
AWS DeepLens
Amazon Rekognition Video
Amazon Kinesis Video Streams
Amazon Ttranslate
Amazon Transcribe
Amazon Comprehend
Day 3 (cont.)
Amazon Container Services
for Kebertenes (EKS)
Amazon Fargate
EC2 System Manager
AWS IoT 1-click
AWS IoT Device Management
AWS IoT Device Defender
AWS IoT Analytics
Amazon FreeRTOS
ML Inference for AWS
Greengrass
Day 4 Werner’s Keynote
Alexa for Business
AWS Cloud9
AWS Serverless Application Repository
2 0 1 7 r e : I n v e n t A n n o u n c e m e n t s
AWS中国（北京）区域由光环新网运营
AWS中国（宁夏）区域由西云数据运营

“Everything is Everything
After winter, must come spring”

Thank you!
http://aws.amazon.com/evangelists/xia-zhang

Keynote 1: AWS re:Invent 2017 Recap - Solutions Overview

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Keynote 1: AWS re:Invent 2017 Recap - Solutions Overview

Similar to Keynote 1: AWS re:Invent 2017 Recap - Solutions Overview (20)

More from Amazon Web Services

More from Amazon Web Services (20)

Keynote 1: AWS re:Invent 2017 Recap - Solutions Overview