Data comes in a variety of forms and in order to gain insight from this data you need to have the right platform in place. AWS has the services to cover all types of data, whether you need databases for structured data, Hadoop for unstructured data or a streaming engine for high-velocity data. In this session we will cover the various data analytics services on AWS and when to use them.

3. Analytics on AWS
Structured, Unstructured and Streaming
Russell Nash
AWS Solutions Architect

4. Ingest Store Process Analyse

5. EC2
Linux
Windows

6. Databases
Database
Data
Log
Data
High Velocity
Data
Analytics
Database
INGEST STORE
Devices
Web Servers
App Servers
Mobile
Amazon
Redshift
Amazon
RDS

7. Traditional Database
Choice of Engines
Low Admin
Amazon
RDS
(Relational
Database
Service)
Amazon Aurora

8. MPP SQL Database
Optimised for Analytics
Scalable
Amazon
Redshift

9. Amazon
Redshift
Amazon
RDS
ScalingVertical Horizontal
WorkloadMixed Analytical
VolumesLow to Medium Medium to High
TypeSQL Relational SQL Relational

11. Database
Data
ETL
INGEST STORE
High Velocity
Data
Devices
Web Servers
App Servers
Mobile
Databases
Log
Data
Amazon
Redshift
Amazon
RDS

12. AWS Database
Migration Service
Amazon
Redshift
Source
Database
ETL
ETL Partners
Amazon
RDS

13. Storage
INGEST STORE
High Velocity
Data
Devices
Web Servers
App Servers
Mobile
Database
Data
Databases
Log
Data
Search
Amazon
Elasticsearch
Amazon
Redshift
Amazon
RDS

14. Amazon
Elasticsearch
Search and Analytics
Scalable
Integrated – Logstash, Kibana

16. Database
Data
Storage
INGEST STORE
High Velocity
Data
Devices
Web Servers
App Servers
Mobile
Databases
Log
Data
Amazon
Elasticsearch
Amazon
S3
Amazon
Redshift
Amazon
RDS

17. Amazon
S3
Object Storage
Low Cost
11 9’s of durability

18. PIG
HDFS

19. PIG
Amazon
EMR
Amazon
S3
EMRFS
EMR

20. CPU
c4 family
c3 family
Memory
x1 family
r3 family
Disk/IO
d2 family
i2 family
General
m4 family
m3 family
Instance Types
Batch Machine Spark and Large
process learning interactive HDFS

21. Cost & Time
# CPUs
Time
# CPUs
Time
Wall clock time: 1 hourWall clock time: 10 hours

23. Spot Price – M3.2XL
On-Demand Spot-Price
$0.08$0.75

25. Database
Data
INGEST STORE
Mobile High Velocity
Data
Devices
Web Servers
App Servers
Mobile
Databases
Log
Data
Amazon
Elasticsearch
Amazon
S3
Stream
Processor
Amazon
Kinesis
NoSQL
Amazon
Redshift
Amazon
RDS

26. Availability
Zone
Availability
Zone
Availability
Zone
Data
Sources
Data
Sources
Data
Sources
Data
Sources
Data
Sources
S3
Redshift
Amazon Kinesis
Stream
AWS Lambda
KCL App
EMR
Elasticsearch

27. Database
Data
INGEST STORE
High Velocity
Data
Devices
Web Servers
App Servers
Mobile
Databases
Log
Data
Amazon
Elasticsearch
Amazon
S3
Amazon
Kinesis
NoSQL
Amazon
DynamoDB
Amazon
Redshift
Amazon
RDS

28. scalability
data complexity
RDBMS
key/value
document
graph
NoSQL

29. NoSQL Database
Key/Value + Document
Very Low Latency
Amazon
DynamoDB

30. Low Latency

32. INGEST STORE PROCESS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Impala
Amazon
Redshift
Amazon
EMR
Database
Data
InteractiveBatchStreaming
Hadoop
Amazon
Elasticsearch
Log
Data
Mobile High Velocity
Data
Devices
Web Servers
App Servers
Mobile
Amazon
DynamoDB

33. INGEST STORE PROCESS
Impala
Amazon
Redshift
Database
Data
InteractiveBatch
PIG
Streaming
Amazon
EMR
Hadoop
Amazon
Kinesis
Amazon
S3
Amazon
Elasticsearch
Mobile High Velocity
Data
Devices
Web Servers
App Servers
Mobile
Amazon
DynamoDB
Databases
Log
Data
Amazon
Redshift

34. FAST
RICH
INDUSTRY
SUPPORT
FLEXIBLE

35. INGEST STORE PROCESS
Impala
Amazon
Redshift
AWS
Lambda
Kinesis
Consumers
Database
Data
InteractiveBatchStreaming
PIG
Amazon
EMR
Hadoop
Amazon
Kinesis
Amazon
S3
Amazon
Elasticsearch
Mobile High Velocity
Data
Devices
Web Servers
App Servers
Mobile
Amazon
DynamoDB
Databases
Log
Data
Amazon
Redshift

36. Comparison of Query Engines
Amazon Redshift Amazon
Elasticsearch
Data Structure
Languages
Semi SemiSemi
Multiple Full Text SearchSQL
Full
SQL
Data Store S3/HDFS LocalS3/HDFS Local
Performance

37. Comparison of Query Engines
Amazon Redshift Amazon
Elasticsearch
General
Purpose
Processing
Engine
SQL Query
Engine for
S3/HDFS
Fully
Featured SQL
Analytics
Database
Full Text search
VisualizationUse Case

38. INGEST STORE PROCESS
Impala
Amazon
Redshift
AWS
Lambda
Kinesis
Consumers
Database
Data
InteractiveBatchStreaming
PIG
Amazon
EMR
Hadoop
Amazon
Kinesis
Amazon
S3
Amazon
Elasticsearch
Mobile High Velocity
Data
Devices
Web Servers
App Servers
Mobile
Amazon
DynamoDB
Databases
Log
Data
Amazon
Redshift
ANALYSE
BI Tools
Amazon
Machine
Learning
ML
Amazon
QuickSight

39. INGEST STORE PROCESS
Impala
Amazon
Redshift
AWS
Lambda
Kinesis
Consumers
Database
Data
InteractiveBatchStreaming
PIG
Amazon
EMR
Hadoop
Amazon
Kinesis
Amazon
S3
Amazon
Elasticsearch
Mobile High Velocity
Data
Devices
Web Servers
App Servers
Mobile
Amazon
DynamoDB
Databases
Log
Data
Amazon
Redshift
ANALYSE
BI Tools
Amazon
Machine
Learning
ML
Amazon
QuickSight

40. Visit bit.ly/aws-tech-chat
or download via SoundCloud or iTunes