2. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

4. The Start of Something New
“Bezos wants
Amazon to run the
messy technical and
logistical parts of
your business using
the same
technologies and
operations that
power his $10 billion
online store”
“Amazon is primed
to lead the
migration of
computing power
from the desktop to
the Net”
This theory will allow small
companies to spend most of
their time developing their
businesses, rather than
occupying themselves with the
‘undifferentiated muck’ of
buying servers, setting up
bandwidth contracts and the
like”

5. The broadest and deepest platform for today’s builders
Technical &
Business Support
AWS Marketplace
7 SERVICES
Analytics
11 SERVICES
IoT
11 SERVICES
Machine
Learning
20 SERVICES
Core
Services
5 SERVICES
Management
Tools
8 SERVICES
DevOps
11 SERVICES
Blockchain
2 SERVICES
Mobile
Services
8 SERVICES
App
Services
5 SERVICES
Infrastructure
7 SERVICES
Enterprise Apps
9 SERVICES
Migration
7 SERVICES
Security &
Compliance
19 SERVICES
9 SERVICES

6. Stockholm
Hong Kong
Announced Regions
AWS Global Infrastructure

7. RELATIONAL
Amazon Aurora MySQL
Amazon Aurora PostgreSQL
P U R P O S E - B U I L T
Key value: Amazon DynamoDB
Document: Amazon DocumentDB
In-memory: Amazon Elasticache
Graph: Amazon Neptune
Time-series: Amazon Timestream
Ledger: Amazon QLDB
Databases
MIGRATION SERVICES
AWS Migration Hub
AWS Database Migration
Service
Amazon RDS for MySQL
Amazon RDS for PostgreSQL
Amazon RDS for MariaDB
Amazon RDS for Oracle
Amazon RDS for SQL Server

8. The most volume options
BLOCK OBJECT
6 storage classes
Best security, compliance,
and audit capabilities
Most object-level controls
Unmatched durability,
availability, and scalability
Unique analytics capabilities
FILE
The most cloud native
file systems (3)
4 performance modes
DATA TRANSFER
11 unique ways to get
data into AWS
Storage
2 storage classes
Resize elastically across all
volume types
Automate EBS volume
snapshots

9. ENCRYPTION & KEY MANAGEMENT
116 encryption enabled services
54 services integrated with key management
service
Global compliance certifications
CERTIFICATIONS
100% AWS services attested and GDPR ready
THREAT DETECTION/APP SECURITY
Threat detection
Machine Learning-
powered security
Web application firewall
DDOS protection
Fine-grained access control
Assessment & reporting
Configuration compliance
Resource & usage
auditing
Security

11. even faster

12. AWS
Direct Connect
AWS
Snowball
AWS
Snowball
Edge
AWS
Snowmobile
AWS Storage
Gateway
Amazon
Kinesis Data
Firehose
Amazon
Kinesis Data
Streams
Amazon
Kinesis Video
Streams
Amazon S3
Transfer
Acceleration
AWS
DataSync
AWS Transfer
for SFTP
DATA TRANSFER
& STORAGE

13. 140,000+ Databases Migrated
Migrate between on-prem and AWS
Migrate between databases
Automated schema conversion
Data replication for zero downtime
DATABASE
MIGRATION

14. APP
MIGRATION

15. Hundreds of thousands of customers running
Windows on AWS

16. H Y B R I D

17. Connect your on-prem
environments with AWS through
network options and services
Use your VMware software and
tools to run workloads on AWS
Run latency-sensitive workloads
on premises in a way that
seamlessly integrates with AWS
Run compute on the edge in locations
with limited or no connectivity
VMware Cloud
on AWS
Snowball Edge
Compute-Optimized
AWS
Outposts
H Y B R I D
AWS
Direct Connect

18. Momentum for VMWare Cloud on AWS

19. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
KKBOX Innovation with SRE
Rianol Jou
Head of Site Reliability Engineering
KKBOX Taiwan Co., Ltd.

20. INTO DARKNESS

21. 2011

22. 2013

23. 2014

24. 2016

25. 2018

26. WHAT WE DID RIGHT

27. GET THE RIGHT PEOPLE
TECHNICAL
SKILL
PERSONALITY
CULTURE FIT
• Recruitment
• Training
• Sharing
• Communication
• Collaboration
• Authorization

28. DO THE RIGHT THINGS
• Business-critical
• Blocking
• Bottleneck
• Wrong direction
POLICY
TECHNOLOGY
BUSINESS
PROCESS

29. IN THE RIGHT WAY
STRATEGY
TECHNOLOGY
STACK
ARCHITECTURE
• Characteristics
• Technical skill
• Resource
• Limitation

30. AT THE RIGHT TIME
TECHNICAL DEBT BARE METAL
VIRTUAL MACHINE
CONTAINER
SERVERLESS
MONOLITH
MICROSERVICES
WORKAROUND
SOLUTION
ON-PREMISE
HYBRID
CLOUD

31. BEYOND

32. WHAT WE DOING NOW
• Architecture review
• Performance tuning
• Refactoring
• Capacity planning
• Cost optimization
• Recruitment
• Training
• Collaboration
• Troubleshooting
• Profiling
• Benchmarking

33. Thank you!
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Rianol Jou
rianoljou@kkbox.com

36. Moving to open source
OPEN SOURCE ENGINES

37. Amazon
Aurora
MySQL and PostgreSQL compatible
5X faster than standard MySQL and 3X PostgreSQL
Highly available and durable
1/10th the cost of commercial grade databases
Scaled-out distributed
architecture

38. Amazon Aurora remains the fastest-growing
service in the history of AWS
T E N S O F T H O U S A N D S O F C U S T O M E R S , 2 X C U S T O M E R G R O W T H F O R L A S T 3 Y E A R S

39. Amazon
ElastiCache
f o r R ed is & M em cac h ed
In-Memory
Amazon
Neptune
Graph Time-Series
Amazon
Timestream
Ledger
Amazon
QLDB
Amazon
DynamoDB
Key Value
Amazon
DocumentDB
Document
wi t h M o n g o DB c o m p a tibil ity
The most complete family of purpose-built databases

40. Global tables
On-demand backups
Point-in-time recover
Read/write capacity on demand
Amazon DynamoDB
Reliable performance at any scale

41. Amazon DynamoDB: reliable performance at any scale

42. How do we think about Blockchain?

43. A fully-managed Ledger database
that provides a transparent,
immutable, cryptographically
verifiable transaction log owned
by a central trusted authority.
LEDGER
Amazon
QLDB
The evolution of databases for all your application needs

44. Amazon Managed
Blockchain
Create and manage scalable blockchain
networks
Choose Hyperledger Fabric (AVAILABLE
TODAY) or Ethereum (COMING SOON)
Create blockchain networks with a few
clicks; manage them with simple API calls
Scales to support thousands of applications
running millions of transactions
Secured by AWS Key Management Service
Improved reliability of Ordering Service
with QLDB technology

48. THE MOST POPULAR CHOICE FOR DATA LAKES
Unmatched durability,
availability, and scalability
Cross
Region
Replication
Best security, compliance,
and audit capabilities
Easiest to use
storage classes
Analyze exabytes of data in S3 with
the analytics service of your choice
Most ways to bring data in
Amazon S3

49. Move, store, catalog, and clean your data
faster with machine learning
Enforce security policies across multiple
services
Gain and manage new insights
AWS Lake
Formation
A secure service that allows you to build
a secure data lake in days
P R E V I E W

50. VISUALIZATION & ML ANALYTICS DATA LAKE DATA MOVEMENT
Amazon
QuickSight
Amazon
SageMaker
Amazon
Redshift
Amazon
EMR
AWS
Glue
Amazon
Athena
Amazon
Elasticsearch
Service
Amazon Kinesis
Data Analytics
Amazon
S3
Amazon Lake
Formation
AWS
Glue
AWS
Snowmobile
AWS
Snowball
Amazon Kinesis
Data Firehose
Amazon Kinesis
Data Streams
Amazon Managed
Streaming for Kafka
AWS
Direct Connect
AWS
Storage Gateway
Amazon Kinesis
Video Streams
Amazon S3
Transfer
Acceleration
AWS Transfer
for SFTP
AWS
Snowball Edge
Broadest and deepest data and analytics portfolio

51. Amazon
Redshift
Petabyte-scale data warehousing for
complex queries and fast performance
Pull together data from different sources
Highly structured
Complex queries across very large databases
10x faster average customer query times

52. What about data at the edge?

53. Sources: McKinsey & Co., Inc., Statista
car lightbulb
bicycle
door lock
camera
factory
cart
coffee pot house
bank
windfarmpolice
equipment
plane utilitymedical
equipment
thermostat
Source: Statista.com
75 billionC O N N E C T E D D E V I C E S
online by:
2025
The source of data is increasing
coming from billions of edge devices

54. AWS IoT Device SDK
Amazon FreeRTOS
AWS IoT Device Tester
AWS IoT Greengrass
AWS IoT Events
AWS IoT Analytics
AWS IoT SiteWise
AWS IoT Device Management
AWS IoT Things Graph
AWS IoT Core
AWS IoT Device Defender
AWS has the most complete platform for IoT

55. AWS IoT customers span all industries

56. AWS IoT customers work across a variety of verticals
Automotive
Manufacturing
Consumer
Electronics
Agriculture &
Food Production
Energy
Management

58. Personalized
recommendations
Inventing new
customer experiences
Fulfillment automation/
inventory management
Drones
Voice driven interactions
Machine Learning at Amazon:
A L O N G H E R I T A G E

59. Put machine learning in the hands of
every developer and data scientist

60. More machine learning is happening on AWS than anywhere else

61. AI Services
R E K O G N I T I O N
I M A G E
P O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D L E XR E K O G N I T I O N
V I D E O
F O R E C A S TT E X T R A C T P E R S O N A L I Z E
VISION SPEECH LANGUAGE CHATBOTS FORECASTING RECOMMENDATIONS
ML Services
A m a z o n
S a g e M a k e r
Ground Truth Notebooks Algorithms + Marketplace RL Training Optimization Deployment Hosting
F R A M E W O RKS I N T E R F A CE S
EC2
C5 FPGAs Greengrass
Elastic
inference Inferentia
EC2
G4
EC2 P3
& P3n
Deep learning
containers
I N F R A S T RU C T U R E
ML Frameworks
+ Infrastructure

62. F R A M E W O RKS I N T E R F A CE S
EC2
C5 FPGAs Greengrass
Elastic
inference Inferentia
EC2
G4
EC2 P3
& P3n
Deep learning
containers
I N F R A S T RU C T U R E
P3dn instances
Scale model training
performance across
multiple instances
P3dn.24xl
3X faster network throughput than any other provider
2X as much GPU memory than any other
GPU instance from other major providers
100+ GB more system memory than the next
largest instance available from other providers
Best price/performance
for model training
P 3 P3dn
EC2 P3
& P3dn
I N F R A S T RU C T U R E
Infrastructure and frameworks for Machine Learning
ML Frameworks
+ Infrastructure

63. F R A M E W O RKS I N T E R F A CE S
EC2
C5 FPGAs Greengrass
Elastic
inference Inferentia
EC2
G4
EC2 P3
& P3n
Deep learning
containers
I N F R A S T RU C T U R E
Best price/performance
for model training
P 3 P3dn
ML Frameworks
+ Infrastructure
FRAMEWORKS INTERFACES
Infrastructure and frameworks for Machine Learning

64. 85% of all
TensorFlow
workloads in the
cloud runs on AWS
AWS is the platform of choice to run TensorFlow

65. 65%
Scaling efficiency
with 256 GPUs
S T OC K T E N S ORFL OW
90%
Scaling efficiency
With 256 GPUS
AW S - OPT IMZ E D T E N S ORFL OW
Train twice as fast with TensorFlow

66. Running inference
in production
Drives the majority of cost
for machine learning
INFERENCE
TRAINING
INFRASTRUCTURE
COSTS

67. COMING LATE 2019
Add GPU acceleration to any Amazon EC2
instance for faster inference at much lower cost
(up to 75% savings)
Amazon
Elastic Inference
Custom high performance machine learning inference
chip that will reduce the cost of inference by 10X
AWS
Inferentia
COMING SOON
Designed for machine learning, training, inference
and video transcoding
Amazon EC2
G4 Instances

68. F R A M E W O RKS I N T E R F A CE S
EC2
C5 FPGAs Greengrass
Elastic
inference Inferentia
EC2
G4
EC2 P3
& P3n
Deep learning
containers
I N F R A S T RU C T U R E
ML Frameworks
+ Infrastructure
AI Services
R E K O G N I T I O N
I M A G E
P O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D L E XR E K O G N I T I O N
V I D E O
F O R E C A S TT E X T R A C T P E R S O N A L I Z E
VISION SPEECH LANGUAGE CHATBOTS FORECASTING RECOMMENDATIONS
ML Services
A m a z o n
S a g e M a k e r
Ground Truth Notebooks Algorithms + Marketplace RL Training Optimization Deployment Hosting

69. Bringing machine
learning to all
developers
Amazon
SageMaker
Built-in, high
performance
algorithms and
frameworks
MORE THAN 200 ADDITIONAL
ALGORITHMS AND MODELS IN AWS
MARKETPLACE
REDUCE DATA LABELING COSTS
BY UP TO 70%
Fully-managed
reinforcement
learning algorithms
with SageMaker RL
TRAIN MODELS WITHOUT LABELED
TRAINING DATA
BUI LD
COLLECT AND PREPARE
TRAINING DATA
Fast and accurate
data labeling with
Ground Truth
Pre-built notebooks
for common problems

70. SET UP AND MANAGE
ENVIRONMENTS FOR TRAINING
HYPERPARAMETER OPTIMIZATION
AND SAGEMAKER NEO
TRAI N
Built-in, high
performance
algorithms and
frameworks
MORE THAN 150 ADDITIONAL
ALGORITHMS AND MODELS IN AWS
MARKETPLACE
REDUCE DATA LABELING COSTS
BY UP TO 70%
Fully-managed
reinforcement
learning algorithms
with SageMaker RL
TRAIN MODELS WITHOUT LABELED
TRAINING DATA
BUI LD
COLLECT AND PREPARE
TRAINING DATA
OptimizationOne-click
training
Fast and accurate
data labeling with
Ground Truth
Pre-built notebooks
for common problems
Bringing machine
learning to all
developers
Amazon
SageMaker

71. SET UP AND MANAGE
ENVIRONMENTS FOR TRAINING
HYPERPARAMETER OPTIMIZATION
AND SAGEMAKER NEO
TRAI N D E P LO Y
SCALE AND MANAGE THE
PRODUCTION ENVIRONMENT
DEPLOY MODEL
IN PRODUCTION
Built-in, high
performance
algorithms and
frameworks
MORE THAN 150 ADDITIONAL
ALGORITHMS AND MODELS IN AWS
MARKETPLACE
REDUCE DATA LABELING COSTS
BY UP TO 70%
Fully-managed
reinforcement
learning algorithms
with SageMaker RL
TRAIN MODELS WITHOUT LABELED
TRAINING DATA
BUI LD
FAST AND ACCURATE DATA LABELING
WITH GROUND TRUTH
OptimizationOne-click
training
One-click
deployment
Fully managed with
auto-scaling, health
checks, automatic
handling of node failure,
and security checks
Fast and accurate
data labeling with
Ground Truth
Pre-built notebooks
for common problems
Bringing machine
learning to all
developers
Amazon
SageMaker

72. More than ten thousand customers using Amazon SageMaker

73. F R A M E W O RKS I N T E R F A CE S
EC2
C5 FPGAs Greengrass
Elastic
inference Inferentia
EC2
G4
EC2 P3
& P3n
Deep learning
containers
I N F R A S T RU C T U R E
ML Frameworks
+ Infrastructure
AI Services
R E K O G N I T I O N
I M A G E
P O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D L E XR E K O G N I T I O N
V I D E O
F O R E C A S TT E X T R A C T P E R S O N A L I Z E
VISION SPEECH LANGUAGE CHATBOTS FORECASTING RECOMMENDATIONS
ML Services
A m a z o n
S a g e M a k e r
Ground Truth Notebooks Algorithms + Marketplace RL Training Optimization Deployment Hosting

74. R E K O G N I T I O N
I M A G E A N D V I D E O
T E X T R A C T
Deep learning based image and
video analysis services
Identify objects, people text,
scenes, activities
Automatically extract text
and data from virtually any
document
Uses ML to go beyond simple
OCR to also identify content
in forms and tables
D O G
9 9 . 3 %
B A L L
8 3 . 0 %
G R A S S
8 9 . 2 %

75. A M A Z O N
P O L L Y
52 Voices across 25 languages
Lip-Syncing & Text Highlighting
Fine-grained Voice Control
A M A Z O N
T R A N S C R I B E
Support for 16KHz and 8KHz
Streaming support
A M A Z O N
T R A N S L A T E
24 language pairs
Neural machine translation
High accuracy
A M A Z O N
C O M P R E H E N D
Sentiment, Entities, Key
phrases, Languages, Topics
A M A Z O N
L E X
Build conversational
apps in minutes
A M A Z O N
C O M P R E H E N D
M E D I C A L
Build conversational
apps in minutes

76. Accurate time-series forecasting
service, based on the same
technology used at Amazon.com
Amazon
Forecast
Real-time personalization and
recommendation service, based on the
same technology used at Amazon.com
Amazon
Personalize
P R E V I E W

77. Ways to get started
Brainstorming
Custom modeling
Training
Work side-by-side with Amazon experts
Practical education on ML for new
& experienced practitioners
Based on the same material used
to train Amazon developers

78. Purpose-built for ML-skills development
Fully programmable & customizable
Build custom Amazon SageMaker models
10-minutes to your first deep learning project
The world’s first deep learning-enabled video camera for developers

79. Build machine learning models
in Amazon SageMaker
Train, test, and iterate on the track using the
AWS DeepRacer 3D racing simulator
Compete in the world’s first global autonomous
racing league, to race for prizes and a chance to
advance to win the coveted AWS DeepRacer Cup
A fully autonomous
1/18th-scale race car
designed to help you
learn about reinforcement
learning through
autonomous driving
AWS DeepRacer

81. Build reinforcement learning model
DeepRacer League Races at AWS Summits
Winners of each DRL Race and top scorers compete
in Championship Cup at re:Invent 2019
World’s first global autonomous racing league

82. ai.aws