1) The document discusses how to analyze Amazon S3 storage usage and costs using Amazon QuickSight and S3 storage analytics. 2) It provides an example of visualizing S3 storage class usage and age of objects over time in QuickSight to determine when to transition objects to cheaper storage classes. 3) The document recommends setting up automated S3 lifecycle policies based on storage analytics to transition and expire objects, reducing storage costs.

1. Visualizing Amazon S3 Storage
Management with Amazon QuickSight
Lex Crosett
crosettl@amazon.com
Lee Kear
leke@amazon.com

2. Featured APN Partner
• Object storage overview
• How to save time and money with storage
analytics and lifecycle policies
• Amazon QuickSight S3 storage analysis demo
• Time for questions

3. AWS Storage Platform – Focus on Objects
AWS Direct
Connect
AWS
Snowball
ISV
Connectors
Amazon
Kinesis
Firehose
Storage
Gateway
S3 Transfer
Acceleration
Data Transfer
Amazon EFS
File
Amazon EBS
Amazon EC2
Instance Store
Block
Amazon S3 Amazon Glacier
Object

4. Designed for 11 9s
of durability
Designed for
99.99% availability
Durable Available
• Multipart upload
• Range GET
• Parallelize List
• Store as much as you need
• Scale storage and compute
independently
• No minimum usage
commitments
Scalable
• AWS Elastic MapReduce
• Amazon Redshift
• Amazon DynamoDB
• And more
Integrated
• Simple REST API
• IPv6 support
• Event Notification
• Lifecycle policies
Easy to use
Why Amazon S3?
High Performance

5. Standard
Active data Archive dataInfrequently accessed data
Standard - Infrequent Access Amazon Glacier
Choice of S3 storage classes

6. Poll – Are you using S3 – Infrequent Access Now?
 Yes
 Thinking About it
 No

7. Designed for 11 9s
of durability
Designed for
99.99% availability
Durable Available
• Multipart upload
• Range GET
• Parallelize List
• Store as much as you need
• Scale storage and compute
independently
• No minimum usage
commitments
Scalable
• AWS Elastic MapReduce
• Amazon Redshift
• Amazon DynamoDB
• And more
Integrated
• Simple REST API
• IPv6 support
• Event Notification
• Lifecycle policies
Easy to use
High Performance
Standard - Infrequent Access storage

8. Standard Retrieval
• Original model
• 3-5 hours
• $0.01/GB
Bulk Retrieval
• Batch/Bulk access
• 5-12 hours
• $0.0025/GB
Expedited Retrieval
• Rare urgent access
• 1-5 minutes
• $0.03/GB
On-site tape replacement Off-site tape replacement
Glacier Flexible Data Retrieval
AllofyourGlacierdataisaccessiblewithanyofthreeretrievaloptions.

9. Example Storage Pricing by Class
• US East example pricing below
• Last reduced 12/1/2016 in range of 20-24% depending on region

10. How to get started lowering object storage costs
Tag S3 Content
Use S3 Storage
Analytics
Visualize using
QuickSight
Build Lifecycle
Rules

11. Easily manage and control access for Amazon S3 objects
• Classify your data
• Tag your objects with key-value pairs
• Write access and lifecycle policies once based on the type of data
• Use tags to filter objects for Analytics and Metrics
AnalysisLifecycle PoliciesAccess Control
Storage Management- S3 Object Tags

12. Poll – Do you use S3 Tagging now?
 Yes
 No

13. How to get started lowering object storage costs
Tag S3 Content
Use S3 Storage
Analytics
Visualize using
QuickSight
Build Lifecycle
Rules

14. Q: When should you move to SIA?
• Visualize the access pattern of your data over time.
• Measure the object age where data is infrequently accessed
• You can easily create a lifecycle transition policy based on the data
• Dive deep by bucket, prefixes, or tag

15. Poll – If using S3 Tagging, at what level?
 Bucket
 Object
 Not Sure

17. Poll – Have you turned on S3 Storage Analytics?
 Yes
 No

18. S3 Analytics – Storage Class Analysis

19. S3 Analytics – Storage Class Analysis

20. How to get started lowering object storage costs
Tag S3 Content
Use S3 Storage
Analytics
Visualize using
QuickSight
Build Lifecycle
Rules

21. Amazon QuickSight is a Business Analytics Service that lets business users
quickly and easily visualize, explore, and share insights from their data.

22. You can quickly and easily gain deeper insights and cost benefits by analyzing and
visualizing S3 analytics data in Amazon QuickSight. With a single click from the S3 console,
without the need for manual exports or additional data preparation.
Amazon QuickSight + Amazon S3 Analytics

23. Amazon QuickSight Demo

24. How to get started lowering object storage costs
Tag S3 Content
Use S3 Storage
Analytics
Visualize using
QuickSight
Build Lifecycle
Rules

25. Automate data management using Lifecycle policies
• Automatic tiering and cost controls
• Includes two possible actions:
– Transition: archives to Standard - IA or Amazon
Glacier based on object age you specified
– Expiration: deletes objects after specified time
• Actions can be combined
• Set policies by bucket, prefix, or tags
• Set policies for current version or non-
current versions
Lifecycle policies

26. Easily recover from unintended delete
Tip:Createarecyclebinforyourstorage
Versioning
Lifecycle policy
Non-current
expiration
Recycle bin
Automatic
cleaning

27. Set up a lifecycle policy on the AWS Management
Console

30. Q&A Time
Additional Resources:
 Storage Analytics with Amazon QuickSight Blog Post
 Storage Analytics Blog Post
 Amazon S3 Pricing
 Amazon S3 Storage Classes
 Amazon S3 Storage Class Analysis
 Amazon QuickSight
 Well Architected Cost Optimization White Paper