What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG201 - Chicago AWS Summit

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
What’s new with Amazon S3, Amazon EFS,
and other AWS storage services
Robbie Wright
Senior Product Marketing Manger, AWS Storage
Amazon Web Services
S T G 2 0 1

Agenda
Key use cases for AWS Storage Services
What’s New in Amazon S3
What’s New in Amazon EBS
What’s New in Amazon EFS
Amazon FSx
AWS Backup
AWS Hybrid-Edge & Data Transfer

Amazon FSx for
Lustre
More choice for more applications
Object storage
Amazon S3 Standard
Amazon S3 Glacier Deep Archive
Amazon S3 Glacier
Amazon S3 Intelligent-Tiering
Amazon S3 One Zone-IA
Amazon S3 Standard-IA
Block storage
Provisioned IOPS SSD
Cold HDD
Throughput Optimized HDD
File storage
Amazon EFS Standard
Amazon EFS Infrequent Access
Elastic
Amazon EFS AWS Storage
Gateway Family
Amazon S3
Amazon FSx for
Windows File
Server
Amazon EBS
Amazon EC2
Backup
AWS Backup
NEW!
NEW!
NEW!
NEW!
NEW!

New AWS storage features in the last year
Block storage
Data transfer
Object storage
S3 Block Public Access
S3 Select GA (+Parquet, bzip2, JSON Arrays)
S3 Performance Increase to 5,500 reads/ 3,500
writes/sec
CRR based on object tags
S3 Glacier in S. America (Sao Paulo) Region
S3 Glacier CloudWatch Metrics
S3 batch operations
S3 Glacier restore notifications
S3 Glacier restore speed upgrade
S3 object lock
Direct Glacier access through S3 API
File storage
EFS in US West (N. California),
Asia Pacific (Seoul), Asia Pacific
(Tokyo), & Asia Pacific (Singapore)
Regions
EFS Encryption in transit
EFS HIPAA eligibility
EFS provisioned throughput
EFS PCI-DSS compliance
EFS access over AWS VPN
EFS locks per file increase
EFS multi-VPC access
EBS elastic volumes for standard magnetic
EBS-optimized performance increase for c5/m5 to
14gbps
EBS resource-level permissions for Snapshots
Incremental encrypted snapshot copy with
custom CMKs
EBS snapshots tag on create
EBS data lifecycle manager
2x EBS-provisioned IOPs performance
improvement
60% EBS gp2 SSD volumes performance
improvement
Storage Gateway Hardware Appliance
File Gateway SMB support
NEW!
NEW!
NEW!
NEW!
NEW!
NEW!
NEW!
NEW!
Tape Gateway in 2 new regions
Snowball Edge Compute Optimized

AWS has been helping enterprises for 13 years
Increase agility Accelerate
innovation
Strengthen
security
Reduce
cost

What are customers building?
Backup &
restore
Non-disruptive
Easy place to start
Integrated with all
major vendors
Archive &
compliance
Media workflows
Tape replacement
Public Sector,
FinServ,
Healthcare/Life
Sciences
Home
directories
Simple to move
Not sensitive to
latency
Significant cost
savings
Data lakes
Variety of analytics
tools
Built for
streaming data
Data visualization
Business-
critical
applications
Integrated with
major vendors
Fully managed
infrastructure
Lift-and-shift
migrations

Back up, restore, and archive
Back up, restore, & archive
data
Amazon S3
Amazon EFS
AWS Storage Gateway
(optional)

Home directories
Home directories
Amazon EFS
Amazon FSx for
Windows File Server

Business-critical applications
Amazon
EFS
Amazon FSx
for Windows
File Server
Amazon
EBS
Block storage
Windows file
storage
Linux/NFS file
storage

Data lakes

On-premises
data center
Archival
Processing
Amazon S3AWS Storage Gateway
AWS DataSync
AWS Transfer for SFTP
Hybrid cloud storage
Analytics

S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon S3

Amazon
S3
Media master files
DNA sequences
Mobile sync
and storage
Machine learning
training dataMedia assets
IoT sensor data
Data
lakes
Durable backups
Digital record
preservation
Seismic & reservoir
simulation data
Home
recording video
Meteorological and
environmental research
Origin storage
for CDN
Financial
transaction
records Web site
hosting
Surveillance
video/closed
circuit television
Medical imagery
and records
Autonomous
vehicle data
Oil and gas topography
Customer call
center records
Mapping data
Geospatial or lunar imagery
Compliance
records
Pharmaceutical
study data
User-generated
contentLog files
Analytics

Amazon S3 is the best place for data lakes
Most ways to
bring data in
Best security,
compliance,
and audit
capabilities
Object-level
controls
Unmatched
durability,
availability,
and scalability
Query and
process data in
place

S3 batch operations
Amazon S3: Service benefits
FPO
The most features to cost-effectively store,
manage, audit, secure, and query data
– at virtually any scale.
S3 Standard
S3 Standard-IA
S3 Intelligent-Tiering
S3 One Zone-IA
S3 Glacier
S3 Glacier
Deep Archive
Use S3 Storage Class Analysis to
learn access patterns and S3
Lifecycle policies to move objects
between classes
S3 storage classes
Configure access to S3 resources and
define user access. Block all public access
requests with S3 Block Public Access.
Access management
Replicate objects to a region of your choice
to reduce latency and for compliance.
Cross-region replication
Append up to 10 metadata tags to an object.
Use tags, buckets, and prefixes to organize
data. Audit and report on access requests and
activities.
Data management tools
Execute tasks and invoke AWS Lambda across billions of
objects – with a single API call or a few clicks in the
console.
S3-integrated analytics applications
AWS Lake Formation to stand up a data lake in days
S3 Select to query data in place
FSx for Lustre for HPC, ML, and media data processing
Analytics & file systems integrations
Supported by the most secure, durable, and performant storage infrastructure
Security by design Compliance programs 99.999999999% durability Multi-AZ resiliency Limitless scalability
S3 Standard
S3 Standard-IA
S3 One Zone-IA
S3 Glacier
S3 Glacier
Deep Archive

Security is job #1
Free checks with
AWS Trusted
Advisor
S3 default
encryption
S3 bucket permissions checkEncryption status
in S3 inventory

Amazon S3 block public accessS3bucket
AWS account
S3 block public
access

Designed for
99.99%
durability
Two copies on one site
Designed for
99.999%
durability
One copy on two sites
Designed for
99.999999999%
durability
GlacierStandard IA
AWS Region
Understanding durability

How do AWS object storage classes differ in design?
Availability Zone
Availability Zone
Availability Zone
Amazon S3 Standard
Amazon S3 Intelligent-Tiering
Amazon S3 Standard-IA
Availability Zone
Amazon S3 One
Zone-IA
AWS Region AWS Region
Amazon S3 Glacier
Amazon S3 Glacier Deep Archive

Your choice of Amazon S3 storage classes
Access FrequencyFrequent Infrequent
• Active, frequently
accessed data
• Milliseconds access
• > 3 AZ
• $0.0210/GB
• Data with changing access
patterns
• > 3 AZ
• $0.0210 to $0.0125/GB
• Monitoring fee per obj.
• Min. storage duration
• Infrequently accessed
data
• > 3 AZ
• $0.0125/GB
• Retrieval fee per GB
• Min. object size
S3 Standard S3 Standard-IA S3 One Zone-IA S3 Glacier
• Re-creatable, less
accessed data
• 1 AZ
• $0.0100/GB
• Archive data
• Select minutes or hours
• > 3 AZ
• $0.0040/GB
S3 Glacier
Deep Archive
• Archive data
• Select 12 or 48 hours
• > 3 AZ
• $0.00099/GB

Amazon S3 One Zone-IA
An S3 storage class built for easily re-creatable data
Designed on a single Availability Zone
Still 99.999999999% durable but less resilient - for 20% less cost
Use it for:
Mobile or enterprise backup data
Offsite compliance data
Disaster recovery data
Derived analysis data

Automated storage tiering for data
with changing access patterns

S3 Glacier Deep Archive
Lowest cost storage class for long-term
archiving and digital asset preservation
Fully managed
without tape
burden
$0.00099 per GB-
month
Designed for
99.999999999%
durability
Recover
data in 12
hours

S3 Glacier restore speed
upgrade
S3 object lock
S3 batch operations
Manageability
Cross-region replication to
S3 Glacier
Direct PUT to S3 Glacier
S3 Glacier restore
notifications

S3 batch operations
Take large-scale actions on S3 objects

Archival storage through S3 API
Write to S3 Glacier directly via the S3 API—no lifecycle policies necessary
Amazon S3 GlacierS3 storage class
Move via lifecycle policyPUT via S3 API

Archival storage through S3 API
New features
Direct PUT to Glacier
S3 object lock (WORM storage)
S3 Glacier restore speed upgrade
S3 Glacier restore notifications
CRR direct to S3 Glacier
Write to S3 Glacier directly via the S3 API—no lifecycle policies necessary
Amazon S3 Glacier
Direct PUT via S3 API

Amazon EBS: Built for dynamic workloads
2x performance improvement
for PIOPS SSD volumes
60% improvement
in gp2 SSD volumes
performance
High performance Reliable
Back up data on EBS volumes
using point-in-time snapshot
capability
Data Lifecycle Manager
Simple

Amazon EBS is designed for a wide range of workloads
Relational databases
MySQL, PostgreSQL, SQL
Server, Oracle, SAP
Non-relational/NoSQL
databases
Cassandra, MongoDB, CouchDB
Low latency and high IOPS with SSD-backed volumes
Schedule EBS snapshots for consistent backups
Consistent and low, single digit millisecond latency
for NoSQL databases
Flexibility to choose any instance and volume for your
workload requirements

Big data analytics
Kafka, Splunk, Hadoop,
Data Warehousing
Increase capacity, tune performance, and change volume
types with zero disruption
Data persistence allowing you to detach and reattach
volumes to resize clusters
Amazon EBS is designed for a wide range of workloads

Four different volume types for optimal use
General purpose
SSD
gp2
Provisioned IOPS
SSD
Throughput optimized
HDD
Cold
HDD
io1
SSD HDD
st1 sc1

Amazon Elastic File System
Automatically
grows and shrinks
Lower TCO than
DIY or on premises
Fully managed
Highly reliable
regional design
Secure
No re-architecting
required
Consistent IOPS
Consistent throughput
Flexible client
connectivity
Simple Elastic Scalable

EFS Infrequent Access
Lower cost storage for EFS file data
as it becomes less frequently accessed
EFS lifecycle policy
85% savings for files accessed <1
time per month
EFS Standard EFS IA
Frequently
accessed
file system
Infrequently
accessed
file system

Amazon FSx for Windows File Server
Lift and shift your Windows file storage with
fully managed Windows file servers
Handles
patching and
other
maintenance
Fast and flexible
performance
Native
Windows
compatibility
back to
Windows 7
Connect to
Amazon EC2,
Amazon
WorkSpaces,
AppStream 2.0 &
VMware Cloud on
AWS
Ready for
Enterprise Apps
like ERP & CRM

Amazon FSx for Lustre
For compute-intensive data processing
use cases like HPC or machine learning
Raw data stored in S3 is loaded to
FSx for Lustre for processing
Output of processing returned to
S3 for retention

Amazon FSx for Lustre performance
Massively scalable performance
100+ GB/s throughput | Millions of IOPS |
Consistent submillisecond latencies
Parallel file system Supports hundreds of
thousands of cores
SSD-based

AWS Backup
Centrally manage backups across AWS services
Automated backup
scheduling
Centralized
backup
management
Policy and tag-
based backup
solution
Automated retention
and lifecycle
management

More options for data transfer
AWS
Direct Connect
Amazon Kinesis
Data Firehose
AWS
Snowball
AWS Snowmobile
AWS Storage
Gateway
Amazon S3
Transfer
Acceleration
AWS
DataSync
AWS Transfer
for SFTP
AWS
Snowball Edge
Amazon Kinesis
Data Streams
Amazon Kinesis
Video Streams

AWS Storage Gateway
Accelerates data
center
shutdowns
Eliminates new
NAS/SAN
purchases
Incorporates
cloud scale and
durability with
on-premises
operations
Seamless,
nondisruptive
integration
Suitable for a vast
range of use cases
Simple Economical Hybrid

AWS DataSync
Simplifies and accelerates online data transfer –
up to 10X faster than open source tools
AWS Region
Network Attached
Storage
NFS
DataSync
Agent
AWS
DataSync
S3 bucket
EFS file system
Corporate data center
AWS Direct Connect or WAN
Encryption with TLS
Migrate active application
data to AWS
Transfer data for timely in-
cloud analysis
Replicate data to AWS for
business continuity

Your SFTP
end users
Archival
Analytics
Processing
S3AWS Transfer for
SFTP
AWS Transfer for SFTP
Fully managed SFTP servicefor Amazon S3
Integrates with existing
Active Directory or
LDAP
Data available immediately
for archiving and processing
in S3
Highly available, and
elastically scalable

AWS Snow family
• 80 TB capacity/10 G network
• Data encryption end-to-end
• Rugged 8.5-G impact case
• Rain and dust-resistant
• 100 TB capacity/10 Gb network
• Rugged 8.5 G impact case
• Compute and storage for
hybrid/edge workloads
• Rack-mountable, clusterable
• Exabyte-scale 45-ft. container
• Dedicated security personnel
• GPS tracking, alarm monitoring,
24/7 surveillance, and optional
additional security
AWS Snowball
AWS Snowball Edge –
storage-optimized
AWS Snowball Edge –
compute-optimized
AWS Snowmobile
• 52 vCPUs or NVIDIA G100 GPU
• 42 TB capacity/100 Gb/s networking
• Rugged 8.5 G impact case
• Compute and storage for
hybrid/edge workloads
• Rack-mountable, clusterable

Amazon S3 Transfer Acceleration
Rio De Janeiro Warsaw New York Atlanta Madrid Virginia Melbourne Paris Los Angeles Seattle Tokyo Singapore
Time[hrs]
500-GB upload from clients in these locations to a bucket in Singapore
Public internet
Accelerated transfer
Up to 300% faster
171% on average

Key takeaways
• AWS has storage solutions to fit any use case
• AWS storage solutions provide an unmatched feature set to help you tackle
complex problems
• Data security capabilities are stronger in the cloud than they are on premises
• AWS provides the most data transfer options to make cloud migration simple

Thank you!

What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG201 - Chicago AWS Summit

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Semelhante a What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG201 - Chicago AWS Summit

Semelhante a What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG201 - Chicago AWS Summit (20)

Mais de Amazon Web Services

Mais de Amazon Web Services (20)

What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG201 - Chicago AWS Summit