What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG201 - Chicago AWS Summit

1. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T What’s new with Amazon S3, Amazon EFS, and other AWS storage services Robbie Wright Senior Product Marketing Manger, AWS Storage Amazon Web Services S T G 2 0 1

2. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Agenda Key use cases for AWS Storage Services What’s New in Amazon S3 What’s New in Amazon EBS What’s New in Amazon EFS Amazon FSx AWS Backup AWS Hybrid-Edge & Data Transfer

3. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Amazon FSx for Lustre More choice for more applications Object storage Amazon S3 Standard Amazon S3 Glacier Deep Archive Amazon S3 Glacier Amazon S3 Intelligent-Tiering Amazon S3 One Zone-IA Amazon S3 Standard-IA Block storage Provisioned IOPS SSD Cold HDD Throughput Optimized HDD File storage Amazon EFS Standard Amazon EFS Infrequent Access Elastic Amazon EFS AWS Storage Gateway Family Amazon S3 Amazon FSx for Windows File Server Amazon EBS Amazon EC2 Backup AWS Backup NEW! NEW! NEW! NEW! NEW!

4. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T New AWS storage features in the last year Block storage Data transfer Object storage S3 Block Public Access S3 Select GA (+Parquet, bzip2, JSON Arrays) S3 Performance Increase to 5,500 reads/ 3,500 writes/sec CRR based on object tags S3 Glacier in S. America (Sao Paulo) Region S3 Glacier CloudWatch Metrics S3 batch operations S3 Glacier restore notifications S3 Glacier restore speed upgrade S3 object lock Direct Glacier access through S3 API File storage EFS in US West (N. California), Asia Pacific (Seoul), Asia Pacific (Tokyo), & Asia Pacific (Singapore) Regions EFS Encryption in transit EFS HIPAA eligibility EFS provisioned throughput EFS PCI-DSS compliance EFS access over AWS VPN EFS locks per file increase EFS multi-VPC access EBS elastic volumes for standard magnetic EBS-optimized performance increase for c5/m5 to 14gbps EBS resource-level permissions for Snapshots Incremental encrypted snapshot copy with custom CMKs EBS snapshots tag on create EBS data lifecycle manager 2x EBS-provisioned IOPs performance improvement 60% EBS gp2 SSD volumes performance improvement Storage Gateway Hardware Appliance File Gateway SMB support NEW! NEW! NEW! NEW! NEW! NEW! NEW! NEW! Tape Gateway in 2 new regions Snowball Edge Compute Optimized

5. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T AWS has been helping enterprises for 13 years Increase agility Accelerate innovation Strengthen security Reduce cost

6. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T What are customers building? Backup & restore Non-disruptive Easy place to start Integrated with all major vendors Archive & compliance Media workflows Tape replacement Public Sector, FinServ, Healthcare/Life Sciences Home directories Simple to move Not sensitive to latency Significant cost savings Data lakes Variety of analytics tools Built for streaming data Data visualization Business- critical applications Integrated with major vendors Fully managed infrastructure Lift-and-shift migrations

7. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Back up, restore, and archive Back up, restore, & archive data Amazon S3 Amazon EFS AWS Storage Gateway (optional)

9. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Business-critical applications Amazon EFS Amazon FSx for Windows File Server Amazon EBS Block storage Windows file storage Linux/NFS file storage

11. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T On-premises data center Archival Processing Amazon S3AWS Storage Gateway AWS DataSync AWS Transfer for SFTP Hybrid cloud storage Analytics

13. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Amazon S3 Media master files DNA sequences Mobile sync and storage Machine learning training dataMedia assets IoT sensor data Data lakes Durable backups Digital record preservation Seismic & reservoir simulation data Home recording video Meteorological and environmental research Origin storage for CDN Financial transaction records Web site hosting Surveillance video/closed circuit television Medical imagery and records Autonomous vehicle data Oil and gas topography Customer call center records Mapping data Geospatial or lunar imagery Compliance records Pharmaceutical study data User-generated contentLog files Analytics

14. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Amazon S3 is the best place for data lakes Most ways to bring data in Best security, compliance, and audit capabilities Object-level controls Unmatched durability, availability, and scalability Query and process data in place

15. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T S3 batch operations Amazon S3: Service benefits FPO The most features to cost-effectively store, manage, audit, secure, and query data – at virtually any scale. S3 Standard S3 Standard-IA S3 Intelligent-Tiering S3 One Zone-IA S3 Glacier S3 Glacier Deep Archive Use S3 Storage Class Analysis to learn access patterns and S3 Lifecycle policies to move objects between classes S3 storage classes Configure access to S3 resources and define user access. Block all public access requests with S3 Block Public Access. Access management Replicate objects to a region of your choice to reduce latency and for compliance. Cross-region replication Append up to 10 metadata tags to an object. Use tags, buckets, and prefixes to organize data. Audit and report on access requests and activities. Data management tools Execute tasks and invoke AWS Lambda across billions of objects – with a single API call or a few clicks in the console. S3-integrated analytics applications AWS Lake Formation to stand up a data lake in days S3 Select to query data in place FSx for Lustre for HPC, ML, and media data processing Analytics & file systems integrations Supported by the most secure, durable, and performant storage infrastructure Security by design Compliance programs 99.999999999% durability Multi-AZ resiliency Limitless scalability S3 Standard S3 Standard-IA S3 Intelligent-Tiering S3 One Zone-IA S3 Glacier S3 Glacier Deep Archive

16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Security is job #1 Free checks with AWS Trusted Advisor S3 default encryption S3 bucket permissions checkEncryption status in S3 inventory

18. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Designed for 99.99% durability Two copies on one site Designed for 99.999% durability One copy on two sites Designed for 99.999999999% durability GlacierStandard IA AWS Region Understanding durability

19. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T How do AWS object storage classes differ in design? Availability Zone Availability Zone Availability Zone Amazon S3 Standard Amazon S3 Intelligent-Tiering Amazon S3 Standard-IA Availability Zone Amazon S3 One Zone-IA AWS Region AWS Region Amazon S3 Glacier Amazon S3 Glacier Deep Archive

20. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Your choice of Amazon S3 storage classes Access FrequencyFrequent Infrequent • Active, frequently accessed data • Milliseconds access • > 3 AZ • $0.0210/GB • Data with changing access patterns • Milliseconds access • > 3 AZ • $0.0210 to $0.0125/GB • Monitoring fee per obj. • Min. storage duration • Infrequently accessed data • Milliseconds access • > 3 AZ • $0.0125/GB • Retrieval fee per GB • Min. storage duration • Min. object size S3 Standard S3 Standard-IA S3 One Zone-IA S3 Glacier • Re-creatable, less accessed data • Milliseconds access • 1 AZ • $0.0100/GB • Retrieval fee per GB • Min. storage duration • Min. object size • Archive data • Select minutes or hours • > 3 AZ • $0.0040/GB • Retrieval fee per GB • Min. storage duration • Min. object size S3 Intelligent-Tiering S3 Glacier Deep Archive • Archive data • Select 12 or 48 hours • > 3 AZ • $0.00099/GB • Retrieval fee per GB • Min. storage duration • Min. object size

21. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Amazon S3 One Zone-IA An S3 storage class built for easily re-creatable data Designed on a single Availability Zone Still 99.999999999% durable but less resilient - for 20% less cost Use it for: Mobile or enterprise backup data Offsite compliance data Disaster recovery data Derived analysis data

23. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T S3 Glacier Deep Archive Lowest cost storage class for long-term archiving and digital asset preservation Fully managed without tape burden $0.00099 per GB- month Designed for 99.999999999% durability Recover data in 12 hours

24. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T S3 Glacier restore speed upgrade S3 object lock S3 batch operations Manageability Cross-region replication to S3 Glacier Direct PUT to S3 Glacier S3 Glacier restore notifications

27. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Archival storage through S3 API Write to S3 Glacier directly via the S3 API—no lifecycle policies necessary Amazon S3 GlacierS3 storage class Move via lifecycle policyPUT via S3 API

28. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Archival storage through S3 API New features Direct PUT to Glacier S3 object lock (WORM storage) S3 Glacier restore speed upgrade S3 Glacier restore notifications CRR direct to S3 Glacier Write to S3 Glacier directly via the S3 API—no lifecycle policies necessary Amazon S3 Glacier Direct PUT via S3 API

30. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Amazon EBS: Built for dynamic workloads 2x performance improvement for PIOPS SSD volumes 60% improvement in gp2 SSD volumes performance High performance Reliable Back up data on EBS volumes using point-in-time snapshot capability Data Lifecycle Manager Simple

31. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Amazon EBS is designed for a wide range of workloads Relational databases MySQL, PostgreSQL, SQL Server, Oracle, SAP Non-relational/NoSQL databases Cassandra, MongoDB, CouchDB Low latency and high IOPS with SSD-backed volumes Schedule EBS snapshots for consistent backups Consistent and low, single digit millisecond latency for NoSQL databases Flexibility to choose any instance and volume for your workload requirements

32. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Big data analytics Kafka, Splunk, Hadoop, Data Warehousing Increase capacity, tune performance, and change volume types with zero disruption Data persistence allowing you to detach and reattach volumes to resize clusters Amazon EBS is designed for a wide range of workloads

33. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Four different volume types for optimal use General purpose SSD gp2 Provisioned IOPS SSD Throughput optimized HDD Cold HDD io1 SSD HDD st1 sc1

35. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Amazon Elastic File System Automatically grows and shrinks Lower TCO than DIY or on premises Fully managed Highly reliable regional design Secure No re-architecting required Consistent IOPS Consistent throughput Flexible client connectivity Simple Elastic Scalable

36. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T EFS Infrequent Access Lower cost storage for EFS file data as it becomes less frequently accessed EFS lifecycle policy 85% savings for files accessed <1 time per month EFS Standard EFS IA Frequently accessed file system Infrequently accessed file system

38. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Amazon FSx for Windows File Server Lift and shift your Windows file storage with fully managed Windows file servers Handles patching and other maintenance Fast and flexible performance Native Windows compatibility back to Windows 7 Connect to Amazon EC2, Amazon WorkSpaces, AppStream 2.0 & VMware Cloud on AWS Ready for Enterprise Apps like ERP & CRM

39. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Amazon FSx for Lustre For compute-intensive data processing use cases like HPC or machine learning Raw data stored in S3 is loaded to FSx for Lustre for processing Output of processing returned to S3 for retention

40. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Amazon FSx for Lustre performance Massively scalable performance 100+ GB/s throughput | Millions of IOPS | Consistent submillisecond latencies Parallel file system Supports hundreds of thousands of cores SSD-based

42. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T AWS Backup Centrally manage backups across AWS services Automated backup scheduling Centralized backup management Policy and tag- based backup solution Automated retention and lifecycle management

44. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T More options for data transfer AWS Direct Connect Amazon Kinesis Data Firehose AWS Snowball AWS Snowmobile AWS Storage Gateway Amazon S3 Transfer Acceleration AWS DataSync AWS Transfer for SFTP AWS Snowball Edge Amazon Kinesis Data Streams Amazon Kinesis Video Streams

45. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T AWS Storage Gateway Accelerates data center shutdowns Eliminates new NAS/SAN purchases Incorporates cloud scale and durability with on-premises operations Seamless, nondisruptive integration Suitable for a vast range of use cases Simple Economical Hybrid

46. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T AWS DataSync Simplifies and accelerates online data transfer – up to 10X faster than open source tools AWS Region Network Attached Storage NFS DataSync Agent AWS DataSync S3 bucket EFS file system Corporate data center AWS Direct Connect or WAN Encryption with TLS Migrate active application data to AWS Transfer data for timely in- cloud analysis Replicate data to AWS for business continuity

47. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Your SFTP end users Archival Analytics Processing S3AWS Transfer for SFTP AWS Transfer for SFTP Fully managed SFTP servicefor Amazon S3 Integrates with existing Active Directory or LDAP Data available immediately for archiving and processing in S3 Highly available, and elastically scalable

48. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T AWS Snow family • 80 TB capacity/10 G network • Data encryption end-to-end • Rugged 8.5-G impact case • Rain and dust-resistant • 100 TB capacity/10 Gb network • Data encryption end-to-end • Rugged 8.5 G impact case • Rain and dust-resistant • Compute and storage for hybrid/edge workloads • Rack-mountable, clusterable • Exabyte-scale 45-ft. container • Data encryption end-to-end • Dedicated security personnel • GPS tracking, alarm monitoring, 24/7 surveillance, and optional additional security AWS Snowball AWS Snowball Edge – storage-optimized AWS Snowball Edge – compute-optimized AWS Snowmobile • 52 vCPUs or NVIDIA G100 GPU • 42 TB capacity/100 Gb/s networking • Data encryption end-to-end • Rugged 8.5 G impact case • Rain and dust-resistant • Compute and storage for hybrid/edge workloads • Rack-mountable, clusterable

49. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Amazon S3 Transfer Acceleration Rio De Janeiro Warsaw New York Atlanta Madrid Virginia Melbourne Paris Los Angeles Seattle Tokyo Singapore Time[hrs] 500-GB upload from clients in these locations to a bucket in Singapore Public internet Accelerated transfer Up to 300% faster 171% on average

50. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Key takeaways • AWS has storage solutions to fit any use case • AWS storage solutions provide an unmatched feature set to help you tackle complex problems • Data security capabilities are stronger in the cloud than they are on premises • AWS provides the most data transfer options to make cloud migration simple

What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG201 - Chicago AWS Summit

Esté a ler uma amostra.

Confira estes a seguir

What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG201 - Chicago AWS Summit

Mais Conteúdo rRelacionado

Diapositivos para si (20)

Semelhante a What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG201 - Chicago AWS Summit (20)

Mais de Amazon Web Services (20)