The document discusses building hybrid cloud storage architectures with AWS. It provides an overview of AWS storage services including Amazon S3, Glacier, EBS, and EFS. It also describes the AWS Storage Gateway family of on-premises appliances that enable hybrid storage between on-premises and AWS cloud storage. Specifically, it covers the File Gateway for accessing S3 storage as files, Volume Gateway for iSCSI volumes, and Tape Gateway for migrating tape backups to S3.

1. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Paul Reed, Principal Product Manager
Scott Franks, WWPS Solution Architect – Storage Lead
Amazon Web Services
Session 194320
Building Hybrid Cloud Storage
Architectures with AWS @Scale

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
• Introduction to AWS Storage
• Hybrid Cloud Storage
• The AWS Storage Gateway Family
• File Gateway
• Hybrid cloud data processing workflows with Amazon S3
• Demo - Backing up Microsoft SQL Server to Amazon S3 with SQL
tools
• Volume Gateway
• Flexible hybrid backup & recovery options with Amazon EBS
Snapshots
• Tape Gateway
• Migrating tape archives to Amazon S3 & Amazon Glacier

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Data movement
OnlineOffline
Data security
and management
Complete Set of Data Building Blocks
Amazon
EFS
Amazon
EBS
AWS Snow family
AWS Storage
Gateway family
AWS Direct Connect
Amazon EFS File Sync
Amazon S3
Transfer Acceleration
Storage Partners
Amazon Kinesis
Data Streams
Amazon Kinesis
Video Streams
Amazon
S3
Amazon
Glacier
AWS KMS
AWS IAM
Amazon CloudWatch
AWS CloudTrail
AWS CloudFormation
AWS Lambda
Amazon Macie
Amazon QuickSight

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Common Storage Workloads on AWS
Compliance
Industry
certifications
Lockable with audit
trails
Secure
Enterprise
Applications
Easier lift-and-shift
migrations
Integrated with
major vendors
Fully managed
infrastructure
Active
Archive
Media workflows
Tape replacement
Public Sector,
FinServ,
Healthcare/Life
Sciences
Databases &
Analytics
Tailored database
or Hadoop
workloads
Bespoke database
lift-and-shift
projects
Backup and
Restore
Non-disruptive
Easy place to start
Integrated with all
major vendors
Data Lakes
& IoT
400% faster queries
Built for
streaming data
Optional data
visualization

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Data Movement & Hybrid Storage Capabilities
AWS
Direct
Connect
A private
connection
between your data
center, office, or
colocation
environment and
AWS
AWS Snow
Family
(Snowball, Snowball
Edge, Snowmobile)
Secure, physical
transport
appliances that
move up to
Exabytes of data
into and out of
AWS
AWS
Storage
Gateways
Hybrid storage that
seamlessly
connects on-
premises
applications to AWS
storage. Ideal for
backup, DR,
bursting, tiering or
migration
Amazon
Kinesis Data
Firehose
Capture, trans-
form, & load
streaming data
into S3 for use
with Amazon
business
intelligence and
analytics tools
Amazon
EFS File
Sync
Up to 5x faster file
transfers than
open source tools.
Ideal for migrating
data into EFS or
moving between
cloud file systems
Amazon
S3 Transfer
Acceleration
Up tp 300%
faster transfers
into and out of
S3. Ideal when
working with
long geographic
distances
APN
Competency
Partners
Integrations
between 3rd party
vendors and AWS
services. Ideal for
leveraging
existing software
licenses and skills

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Simple Storage Service (S3)
Analyze
Store
Collect
Built for:
backup and restore, data lakes, analytics, cloud-native applications
• Over a decade of experience and continuous innovation
• The most durable, scalable place to keep any kind of data
• Data management and cost optimization across tiers
• Simpler migration through data movement options for any use case
• Automated security with discovery, encryption, audit and alerting
• Storage classes to fit price and performance use cases
• Query-in-place can accelerate application performance up to 400%
• Reporting and visualization across entire datasets
• Supports queries across both structured and unstructured data

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Glacier
Cost-effective
Secure
Durable
Built for:
Active archive, tape replacement, regulatory compliance
• Certifications supporting nearly any regulatory compliance program
• Locking, encryption, audit, and alerting tools to prevent tampering
• Built on the most reliable global infrastructure
• Withstands multiple facility failures
• Replication options across global regions
• Designed for archives and backup
• Expedited retrievals in minutes, bulk retrievals in hours
• Provides analytics applications access to archives

8. Object Storage Classes
Amazon
Glacier
S3 Standard
S3 Standard -
Infrequent Access
Automated Lifecycle Policies
S3 One Zone -
Infrequent Access
Active data
Millisecond access
Min 3 AZs
$0.023
Archive data
Minutes to Hours
Min 3 AZs
$0.004
30 day min duration
Millisecond access
Min 3 AZs
$0.0125
30 day min duration
Millisecond access
1 AZ
$0.01
Pricing is per GB per month in the US East (N. Virginia) region

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Elastic Block Store (EBS)
Performant
Persistent
Reliable
Built for:
Hadoop/Amazon EMR, relational and NoSQL databases, log processing,
and data warehousing
• Dedicated, detachable volumes for EC2 instances
• Helps customers manage compute and storage separately
• Highly secure multi-AZ design
• Built-in backup options
• Performance options to fit most workloads
• Optimized for latency, throughput, or cost
• Elastic volumes expand capacity on the fly

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Elastic File System (EFS)
Scalable
Simple
Elastic
Built for:
Web serving, content management, media and entertainment workflows, home
directories, container storage, big data, and analytics
• Share files between EC2 instances in minutes
• True file system interface with file system semantics
• Fully managed – no capacity planning surprises
• Pay-as-you-go consumption and pricing
• Automatically grows and shrinks
• Much lower TCO than DIY or 3rd party workarounds
• Consistent performance even as data grows

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Hybrid Cloud Storage Architectures

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Two Cloud Deployment Options
“All-In” Cloud
Fully deployed in
the cloud
Hybrid
Deployed on-premises
and in the cloud

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
So, How Can You Make Storage
Hybrid?
Gateways

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Storage Gateway Enables a Spectrum of Hybrid Use Cases
Backup | DR | Archive
Enterprise data centers
Amazon
EBS
Amazon
S3
Amazon
Glacier
App. serversFile servers
Research sites
AWS Storage Gateway
DevicesDatabasesMultimedia content
Analytics | File Services | Production Tiering | Data Processing
Data Distribution | Backup | DR | Archive | Migration
Amazon
EC2
AWS
Lambda
Amazon
CloudFront
Amazon
Athena
Amazon
EMR
Backup serversUsers
Remote offices Small to medium businesses

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Storage Gateway Family
File Gateway
Store and access objects in Amazon S3 from file-based
applications with local caching
Volume Gateway
Cloud-backed block storage volumes presented on-premises with
EBS snapshots and clones
Tape Gateway
Cloud storage for backups through a drop-in replacement for
physical tape infrastructure

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Storage Gateway Family
Native storage in AWS
• Objects in S3 (file)
• Snapshots in EBS (volume)
• Archival in Glacier (tape)
Gateway provides applications
• Protocol conversion and device emulation
• Caching (read-through / write-back)
• Optimized data transfer
Amazon EC2
AWS Identity and Access
Management (IAM)
Amazon
CloudWatch
AWS Key ManagementService
(AWS KMS)
AWS CloudTrail
Files
(NFS or SMB)
Volumes
(iSCSI)
Tapes
(iSCSI VTL)
Amazon S3
Amazon Glacier
Amazon EBS
snapshots
Your Data Center
AWS Storage Gateway
HTTPS
Gateway Service

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What’s New for AWS Storage Gateway?
• 12 feature launches
• Available in all commercial Regions
• HIPAA-eligible
• File Gateway refresh cache for multi-
site file sharing
• Volume Gateway cloning volumes for
faster DR
• Tape Gateway support for
Commvault and Arcserve, improved
performance (pre-fetch and faster
retrievals)
Last year
• Available in AWS GovCloud (US)
• AWS CloudWatch Events for automation,
support for Requester Pays and S3 One
Zone - IA storage class
• Support for EMC NetWorker v9,
NovaStor DataCenter
• KMS encryption for files, volumes, and
tapes
So far this year

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
And That’s Not All …

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Today We Added SMB to File Gateway
Store and access objects in Amazon S3 buckets
from file-based Windows applications
File Gateway
appliance
Objects in your
Amazon S3 bucket
Microsoft Windows
client
Reduce on-premises
storage infrastructure
Fully managed local
cache for low latency
access
Durability, scalability,
and reliability of
Amazon S3 storage

20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Store and access objects in Amazon S3 buckets
from file-based Windows applications
• Hybrid workloads, such as
machine learning and big
data analytics,
• Backup and archival in
Amazon S3
Target Use Cases
• Supports SMB v2 & v3
• Control access to SMB
shares using Active
Directory (AD)
• Control access to objects
using POSIX ACLs
(compatible with NTFS)
Details

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Hybrid Cloud Data Processing
with File Gateway

22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File Gateway
Store and access objects in Amazon S3 from file-based applications with local
local caching
• Uses your S3 buckets with 1:1 mapping from files-to-objects
• File metadata stored in object metadata
• Full control over how your data is stored and accessed
Common uses: Hybrid cloud data processing (big data/data lakes),
data distribution, e.g., for content or media, backup, & recovery, etc.
Customer Premises
Amazon
Glacier
HTTPS
NFS or
SMB
Application
Server
Objects in your
S3 bucket
Storage Gateway
appliance

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Linux NFS
client
s3://{Bucket2}/{Prefix}/{Object1}
s3://{Bucket2}/{Prefix}/{Object2}
s3://{Bucket2}/{Prefix}/{Object3}
File Gateway – Mapping Files to Objects
nfs://{IP}/{Bucket2}/{Folder}/{File1}
nfs://{IP}/{Bucket2}/{Folder}/{File2}
nfs://{IP}/{Bucket2}/{Folder}/{File3}
File Gateway
appliance
Windows SMB
client
Objects in
your S3 bucket
{IP}{Bucket1}{Folder}{File1}
{IP}{Bucket1}{Folder}{File2}
{IP}{Bucket1}{Folder}{File3}
s3://{Bucket1}/{Prefix}/{Object1}
s3://{Bucket1}/{Prefix}/{Object2}
s3://{Bucket1}/{Prefix}/{Object3}
Bucket1
Bucket2

24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File Gateway – Control Over Data Storage and Access
NFS or SMB file share options
• IAM role for access
• Storage class
• Object encryption with AWS KMS
• Guess MIME type
Amazon S3 options per bucket
• Restrict access by IP (NFS) or AD (SMB)
• Read-only/read-write
• Default ownership and permissions
• User squashing (NFS)
File Gateway
appliance
NFS or SMB
client
Objects in your
S3 bucket

25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File Gateway – Local Cache for Reads and Writes
Customer Premises
File Gateway
VM
Region
Share
Storage
Gateway
service
File stored
as objects
Index
Cache
NFS or
SMB client

26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File Gateway – Data is Read Through the Cache
File Gateway
VM
Region
Share
Storage
Gateway
service
File stored
as objects
Ranged read operations if
required bytes are not in cache
Read operation from cache
Index
Cache
Customer Premises
NFS or
SMB client

27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File Gateway – Data is Uploaded Asynchronously
File Gateway
VM
Share
Storage
Gateway
service
File stored
as objects
Parallel multi-part upload of
just the changed data
Write to cache first
Index
Cache
Customer Premises Region
NFS or
SMB client

28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
C:> dir D:foo
File Gateway – Metadata and Object Index
Metadata
and object
index
Data
cache
File
share
File Gateway
Objects in your
S3 bucket
$ ls /foo/*
NFS or SMB
client
s3:ListBucket /foo/*

29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon
Athena
Amazon
QuickSight
Amazon
EMR
AWS
Lambda
Amazon
Rekognition
File Gateway – Upload Notifications for Automation
Metadata
and object
index
Data
cache
File
share
File Gateway
Amazon
CloudWatch
Events
Objects in your
S3 bucket
NotifyWhenUploaded
API
NFS or SMB
client

30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
File Gateway – Updating the Metadata and Object Inventory
Metadata
and object
index
Data
cache
File
share
File Gateway
RefreshCache
API
Amazon
CloudWatch
Events
Objects in your
S3 bucket
NFS or SMB
client
New object
s3:ListBucket

31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Demonstration: Backing Up SQL
Server with Native SQL Tools and File
Gateway

32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Hybrid Volumes for Recovery &
Migration
with Volume Gateway and EBS
Snapshots

33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Application
server
Amazon EBS
snapshots
AWS Storage
Gateway
Volume
Gateway
appliance
Volume
Stored in
Amazon S3
HTTPSiSCSI
Customer Premises Region
Volume Gateway
Cloud-backed block storage presented on-premises
• Tier snapshots or whole volumes to the cloud to reduce SAN/NAS
mgt.
• Flexible recoveries in-cloud or on-premises with snapshots and
clones
Common uses: backup and restore, disaster recovery, data migrations

34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Application
server
Amazon EBS
snapshots
AWS Storage
Gateway
Volume
Gateway
appliance
Volume
Stored in
Amazon S3
HTTPSiSCSI
Customer Premises Region
100% of volume stored
in AWS & on-premises
Volume Gateway – Stored Mode
Low-latency access to all your data with point-in-time backup
to the cloud through EBS snapshots

35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EBS
snapshots
AWS Storage
Gateway
Volume
Stored in
Amazon S3
HTTPSiSCSI
Customer Premises Region
100% of volume
stored in AWS
Volume Gateway VM
Virtual
volume
Fully-managed cache of
frequently used data
Application
server
Volume Gateway – Cached Mode
Reduce on-premises storage, caching frequently used data local to
your application, with 100% of your data in the cloud

36. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway + Amazon EBS
Snapshots

37. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Volume Gateway – Amazon EBS Snapshots
EBS snapshots are point-in-time backups of a volume
Created on-demand or on a configurable schedule
Can be used to create an Amazon EBS or Storage Gateway volume
Application
server Amazon EBS
snapshots
AWS Storage
Gateway
Volume
Gateway
appliance
Volume
Stored in
Amazon S3
HTTPSiSCSI
Customer Premises Region

38. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Snapshot Creation
AWS Storage Gateway
Customer Premises Region
Storage Gateway
appliance
Volume
iSCSI
Volume
A B
A B
A B
C
C
C
D
D
D
Snap1 Snap2 Snap3
Application
server

39. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Restore, Recover, and Migrate
Volumes with EBS Snapshots and
Volume Clones

40. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
1. Restore to
your data center
Flexible Data Recovery with Volume Gateway
AWS Storage
Gateway
3. Recovery to a
2nd DR site
EC2EBSGateway
Volume
1
2
3
2. Migrate to AWS

41. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Flexible Data Recovery with Volume Gateway
Application
Server
AWS Storage Gateway
Customer Premises Region
Storage Gateway
appliance
iSCS
I VolumeA B
A B
C
C
volume
A B C D
D
D
Snap1 Snap2 Snap3

42. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
1. Restore with Amazon EBS Snapshots
AWS Storage Gateway
Customer Premises Region
Storage Gateway
appliance
iSCSI VolumeA B
A B
C
C
volume
A B C D
D
D
Snap1 Snap2 Snap3
A B C
VolumeA B C
Restore a volume
from a past point
in time
Application
Server

43. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
2. Migrate to AWS with EBS Snapshots
AWS Storage Gateway
Customer Premises Region
iSCSI VolumeA B
A B
C
C
volume
A B C D
D
D
Snap1 Snap2 Snap3
EBS
EC2A B
C D
Restore EBS Snapshot as EBS
Volume for recovery in Amazon EC2
Application
Server
Storage Gateway
appliance

44. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
3. Disaster Recovery With Volume Cloning
AWS Storage Gateway
Customer Premises Region
Gateway
volume
A B C D
volumeA B C D
clone1A B C D
App Server
Recovery Site
Gateway
iSCS
I
clone1
A B C D
• Disaster recovery
• Cloning test data
• Same site recovery
App Server
iSCS
I

45. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Hybrid Cloud Virtual Tape Backups
to Amazon S3 & Amazon Glacier
with Tape Gateway

46. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Tape Gateway: Drop-in Replacement for Tape Backups
• Emulates a tape library - virtual tapes on Amazon S3 and Amazon Glacier
• Works with common backup apps, to support existing backup workflows
• Low-cost: predictable costs and reduced management

47. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Tape Gateway – Cost Comparison, a Customer example
Every month, 100 TB written and 1 tape retrieval; 1-year retention
Tape Gateway
Data written via
Gateway
Data transfer out
and tape retrieval
On-premises Tape
$34.5 K / year
Virtual tapes
archived in Glacier
Admin time
Admin time
Tape library
maintenance
Robotic tape library
Tape media costs
Off-site archive
service
$56.8K / year

48. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Tape Gateway: How the VTL works
Customer Premises
Region
AWS Storage Gateway
Backup
Server
Upload Buffer
Cache
Media
Changer
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Drive
Tape Library
(Amazon S3))
Tape Shelf
(Glacier)
• Emulates a physical tape device with a media changer and tape drives
• Scalable: Virtually unlimited tape storage in AWS
• Virtual tapes are written to S3 – data is in S3 when tape is in virtual library drive or slot
• ‘Ejected’ virtual tapes are marked read-only and moved to ‘Tape Shelf’ on Amazon Glacier
• Recovery: Retrieve tapes to library (3-5 hours) and read data to same or different gateway
Tape Gateway VM
Tape Drive

49. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Your Tape Archive Today
Backup
Server
Customer Premises
Tape
Library
Offsite Vault
Backup
Disk
Appliance

50. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Move Your Tape Archive to AWS
Media Changer
Virtual Tapes
stored in
Amazon S3
Archived Tapes
stored in
Amazon Glacier
iSCSI
AWS Storage
Gateway
Tape Gateway VM
Tape Drive
HTTPS
Region
Backup
Server
Customer Premises
Tape
Library
Offsite Vault
• Deploy Tape Gateway VTL as an archive target
• Old archives can expire, or be recalled and written to SGW
• Decommission old physical Tape Library when all tapes are
expired
Backup
Disk
Appliance

51. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Summary

52. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Hybrid Storage Architectures with AWS
• When you need data and access on-premises with storage in-cloud
• AWS Cloud Storage
• Most reliable, secure, compliant, and largest scale
• Most partners and most comprehensive support & consulting to help you
• AWS Storage Gateway - Seamlessly connect on-premises applications
with AWS Cloud storage; no changes to existing applications
• Storage Gateway supports use cases throughout your cloud journey:
Backups, tiered file & block storage, hybrid processing, migration

53. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Questions?
Don’t forget to complete your session
evaluation!

54. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Native SQL Backup to Amazon S3 via SMB
corporate data center
Storage Gateway VM
SQL Server
(native SQL agent)
Domain
Controller
us-west-1
Amazon
SQS
Amazon
CloudWatch
AWS
Storage
Gateway
Amazon Glacier
Amazon S3 - Infrequent
Access
Backup
bucket
Expire / delete backup after x years
Share
(SMB)
Local
Cache
Lifecycle after 30 days

55. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Native SQL Backup to Amazon S3 via SMB
corporate data center
Storage Gateway VM
SQL Server
(native SQL agent)
Domain
Controller
us-west-1
Amazon
SQS
Amazon
CloudWatch
AWS
Storage
Gateway
Amazon Glacier
Amazon S3 - Infrequent
Access
Backup
bucket Expire / delete backup after x years
Share
(SMB)
Local
Cache
Lifecycle after 30 days

56. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Native SQL Backup to Amazon S3 via SMB
corporate data center
Storage Gateway VM
SQL Server
(native SQL agent)
Domain
Controller
us-west-1
Amazon
SQS
Amazon
CloudWatch
AWS
Storage
Gateway
Amazon Glacier
Amazon S3 - Infrequent
Access
Backup
bucket Expire / delete backup after x years
Share
(SMB)
Local
Cache
Lifecycle after 30 days

57. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Native SQL Backup to Amazon S3 via SMB
corporate data center
Storage Gateway VM
SQL Server
(native SQL agent)
Domain
Controller
us-west-1
Amazon
SQS
Amazon
CloudWatch
AWS
Storage
Gateway
Amazon Glacier
Amazon S3 - Infrequent
Access
Backup
bucket
Expire / delete backup after x years
Share
(SMB)
Local
Cache
Lifecycle after 30 days

58. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Native SQL Backup to Amazon S3 via SMB
corporate data center
Storage Gateway VM
SQL Server
(native SQL agent)
Domain
Controller
us-west-1
Amazon
SQS
Amazon
CloudWatch
AWS
Storage
Gateway
Amazon Glacier
Amazon S3 - Infrequent
Access
Backup
bucket Expire / delete backup after x years
Share
(SMB)
Local
Cache
Lifecycle after 30 days

59. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Native SQL Backup to Amazon S3 via SMB
corporate data center
Storage Gateway VM
SQL Server
(native SQL agent)
Domain
Controller
us-west-1
Amazon
SQS
Amazon
CloudWatch
AWS
Storage
Gateway
Amazon Glacier
Amazon S3 - Infrequent
Access
Backup
bucket Expire / delete backup after x years
Share
(SMB)
Local
Cache
Lifecycle after 30 days

60. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Native SQL Backup to Amazon S3 via SMB
corporate data center
Storage Gateway VM
SQL Server
(native SQL agent)
Domain
Controller
us-west-1
Amazon
SQS
Amazon
CloudWatch
AWS
Storage
Gateway
Amazon Glacier
Amazon S3 - Infrequent
Access
Backup
bucket Expire / delete backup after x years
Share
(SMB)
Local
Cache
Lifecycle after 30 days

61. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Native SQL Backup to Amazon S3 via SMB
corporate data center
Storage Gateway VM
SQL Server
(native SQL agent)
Domain
Controller
us-west-1
Amazon
SQS
Amazon
CloudWatch
AWS
Storage
Gateway
Amazon Glacier
Amazon S3 - Infrequent
Access
Backup
bucket Expire / delete backup after x years
Share
(SMB)
Local
Cache
Lifecycle after 30 days

62. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Native SQL Backup to Amazon S3 via SMB
corporate data center
Storage Gateway VM
SQL Server
(native SQL agent)
Domain
Controller
us-west-1
Amazon
SQS
Amazon
CloudWatch
AWS
Storage
Gateway
Amazon Glacier
Amazon S3 - Infrequent
Access
Backup
bucket Expire / delete backup after x years
Share
(SMB)
Local
Cache
Lifecycle after 30 days

63. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Native SQL Backup to Amazon S3 via SMB
corporate data center
Storage Gateway VM
SQL Server
(native SQL agent)
Domain
Controller
us-west-1
Amazon
SQS
Amazon
CloudWatch
AWS
Storage
Gateway
Amazon Glacier
Amazon S3 - Infrequent
Access
Backup
bucket Expire / delete backup after x years
Share
(SMB)
Local
Cache
Lifecycle after 30 days

64. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Native SQL Backup to Amazon S3 via SMB
corporate data center
Storage Gateway VM
SQL Server
(native SQL agent)
Domain
Controller
us-west-1
Amazon
SQS
Amazon
CloudWatch
AWS
Storage
Gateway
Amazon Glacier
Amazon S3 - Infrequent
Access
Backup
bucket Expire / delete backup after x years
Share
(SMB)
Local
Cache
Lifecycle after 30 days

65. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Restoring SQL Backups
corporate data center
SQL Server
(native SQL agent)
Domain
Controller
us-west-1
AWS
Storage
Gateway
Backup
bucket
Storage Gateway VM
Share
(SMB)
Local
Cache

66. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Restoring SQL Backups
corporate data center
SQL Server
(native SQL agent)
Domain
Controller
us-west-1
AWS
Storage
Gateway
Backup
bucket
Storage Gateway VM
Share
(SMB)
Local
Cache

67. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Restoring SQL Backups
corporate data center
SQL Server
(native SQL agent)
Domain
Controller
us-west-1
AWS
Storage
Gateway
Backup
bucket
Storage Gateway VM
Share
(SMB)
Local
Cache

68. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Restoring SQL Backups
corporate data center
SQL Server
(native SQL agent)
Domain
Controller
us-west-1
AWS
Storage
Gateway
Backup
bucket
Storage Gateway VM
Share
(SMB)
Local
Cache
Storage Gateway VM
Share
(SMB)
Local
Cache
Availability Zone
SQL
instance

69. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Restoring SQL Backups
corporate data center
SQL Server
(native SQL agent)
Domain
Controller
us-west-1
AWS
Storage
Gateway
Backup
bucket
Storage Gateway VM
Share
(SMB)
Local
Cache
Storage Gateway VM
Share
(SMB)
Local
Cache
Availability Zone
SQL
instance

70. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Restoring SQL Backups
corporate data center
SQL Server
(native SQL agent)
Domain
Controller
us-west-1
AWS
Storage
Gateway
Backup
bucket
Storage Gateway VM
Share
(SMB)
Local
Cache
Storage Gateway VM
Share
(SMB)
Local
Cache
Availability Zone
SQL
instance
SQL instance

71. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Restoring SQL Backups
corporate data center
SQL Server
(native SQL agent)
Domain
Controller
us-west-1
AWS
Storage
Gateway
Backup
bucket
Storage Gateway VM
Share
(SMB)
Local
Cache
Storage Gateway VM
Share
(SMB)
Local
Cache
Availability Zone
SQL
instance
SQL instance
S3 Request