Mais conteúdo relacionado Semelhante a Data as an Asset, Not a Cost (20) Mais de Amazon Web Services (20) Data as an Asset, Not a Cost1. © 2019, Amazon Web Services, Inc. or its Affiliates.
Mario Vlachakis, AWS Senior Solutions Architect
SIBOS 2019
Data as an asset, not a cost
Lifecycle management – from ingest to archive
2. © 2019, Amazon Web Services, Inc. or its Affiliates.
Table of contents
• What’s new with data today
• What you need to succeed
• How AWS can help
• Ingestion
• Storage
• Data lakes and processing
• Analytics
• Archiving
3. © 2019, Amazon Web Services, Inc. or its Affiliates.
What’s new with data today?
4. © 2019, Amazon Web Services, Inc. or its Affiliates.
Data is a strategic asset
for every organization
The world’s most valuable
resource is no longer oil,
but data.
5. © 2019, Amazon Web Services, Inc. or its Affiliates.
https://www.networkworld.com/article/3325397/idc-expect-175-zettabytes-of-data-worldwide-by-2025.html
Data is growing at an
exponential rate.
The IDC predicts:*
The collective sum of the world’s 2018 data
was 33 zettabytes.
By 2025, it will grow to 175 zettabytes.
Data types are also diversifying, requiring
storage and analysis of structured AND
unstructured data.
6. © 2019, Amazon Web Services, Inc. or its Affiliates.
What you need to succeed
7. © 2019, Amazon Web Services, Inc. or its Affiliates.
Thinking about data as an asset, not a cost
Stop
throwing
data away.
Make it
available to
more users.
Arm users
with more
data processing
technologies.
8. © 2019, Amazon Web Services, Inc. or its Affiliates.
Storage
Processing
Analytics /
Machine
learning
Archive
Creation /
Ingest
At every stage of your data’s
lifecycle, you need scalable
services that can flex with your
data growth.
9. © 2019, Amazon Web Services, Inc. or its Affiliates.
Governance
& control
There are more
people working
with data than ever
before.
How do I provide democratized access
to data to enable informed decisions
while at the same time enforce data
governance and prevent
mismanagement of the data?
Democratization
of data
10. © 2019, Amazon Web Services, Inc. or its Affiliates.
There are more ways to analyze
data than ever before.
Hadoop Elasticsearch
Years ago
12 9 6 5
Presto Spark
Didn’t exist
11. © 2019, Amazon Web Services, Inc. or its Affiliates.
How AWS can help
12. © 2019, Amazon Web Services, Inc. or its Affiliates.
More Options for Data Transfer
AWS
Direct Connect
Amazon Kinesis
Firehose
AWS
Snowball
AWS Snowmobile
AWS
Storage
Gateway
Amazon S3
Transfer
Acceleration
AWS
DataSync
AWS Transfer
for SFTP
AWS
Snowball Edge
Storage Optimized
Amazon Kinesis
Data Streams
Amazon Kinesis
Video Streams
AWS
Snowball Edge
Compute Optimized
13. © 2019, Amazon Web Services, Inc. or its Affiliates.
More services & storage classes for every use case
Block storage
Amazon Elastic Block Storage (EBS)
• General purpose SSD
• Provisioned IOPS SSD
• Throughput-optimized HDD
• Cold HDD
• Elastic Volumes
File storage
Amazon Elastic File System (EFS)
• EFS Standard
• EFS Infrequent Access (for cost savings)
Object storage
Amazon Simple Storage Service (S3)
• 6 storage classes for various access patterns
• Includes 2 levels or archiving
• Build data lakes for structured and
unstructured data
Amazon EFS AWS Storage
Gateway Family
Amazon S3
Amazon FSx
for Lustre
Amazon FSx
for Windows
File Server
Amazon
EBS
Amazon
EC2
14. © 2019, Amazon Web Services, Inc. or its Affiliates.
S3 Batch Operations
FPO
The most features to cost-effectively store,
manage, audit, secure, and query data
– at virtually any scale.
S3 Standard
S3 Standard-IA
S3 Intelligent-Tiering
S3 One Zone-IA
S3 Glacier
S3 Glacier
Deep Archive
Use S3 Storage Class Analysis to
learn access patterns and S3
Lifecycle policies to move
objects between classes
S3 Storage Classes
Configure access to S3 resources
and define user access. Block all
public access requests with S3 Block
Public Access.
Access management
Replicate objects to a region of your
choice to reduce latency and for
compliance.
Cross-Region Replication
Append up to 10 metadata tags to an
object. Use tags, buckets, and prefixes to
organize data. Audit and report on access
requests and activities.
Data management tools
Execute tasks and invoke AWS Lambda across
billions of objects – with a single API call or a few
clicks in the console.
S3-integrated analytics applications
AWS Lake Formation
S3 Select to query data in place
FSx for Lustre for HPC, ML, and media data
processing
Analytics & file systems integrations
Supported by the most secure, durable, and performant storage infrastructure
Security by design Compliance programs 11 9’s of durability Multi-AZ resiliency Limitless scalability
Amazon Simple Storage Service (S3)
15. © 2019, Amazon Web Services, Inc. or its Affiliates.
Store exabytes of structured and unstructured data
Load, transform, and catalog once
Make data available to many tools
Open formats and interfaces support innovation
Introducing AWS Lake Formation
Snowball
Snowmobile Kinesis
Data Firehose
Kinesis
Data Streams
Amazon S3
Amazon
Redshift
Amazon
EMR
Amazon
Athena
Amazon
Kinesis
Amazon
Elasticsearch
Service
Kinesis
Video Streams
AI Services
Amazon
QuickSight
Have you considered a data lake?
Build and deploy a fully
managed data lake with a
few clicks
Centrally define security,
governance, and auditing
policies
Self-service discovery and
safe access to all data
from a single catalog
16. © 2019, Amazon Web Services, Inc. or its Affiliates.
AWS Marketplace
Amazon Redshift
Data warehousing
Amazon EMR
Hadoop + Spark
Athena
Interactive analytics
Kinesis Analytics
Real-time
Amazon Elasticsearch service
Operational Analytics
RDS
MySQL, PostgreSQL, MariaDB,
Oracle, SQL Server
Aurora
MySQL, PostgreSQL
Amazon
QuickSight
Amazon
SageMaker
DynamoDB
Key value, Document
ElastiCache
Redis, Memcached
Neptune
Graph
Timestream
Time Series
QLDB
Ledger Database
S3/Amazon Glacier
AWS Glue
ETL & Data Catalog
Lake Formation
Data Lakes
Database Migration Service | Snowball | Snowmobile | Kinesis Data Firehose | Kinesis Data Streams | Data Pipeline | Direct Connect
Data Movement
AnalyticsDatabases
Business Intelligence & Machine Learning
Data Lake
Managed
Blockchain
Blockchain
Templates
Blockchain
Amazon
Comprehend
Amazon
Rekognition
Amazon
Lex
Amazon
Transcribe
AWS DeepLens 250+ solutions
730+ Database
solutions
600+ Analytics
solutions
25+ Blockchain
solutions
20+ Data lake
solutions
30+ solutions
RDS on VMWare
Databases and analytics services – built for builders
17. © 2019, Amazon Web Services, Inc. or its Affiliates.
Security & Compliance is a shared responsibility between AWS and the customer.
What about security?