Migrating large media archives can be challenging. In this session, learn how the combination of AWS transfer services, including AWS DataSync and AWS Snowball Edge, and the AWS asset management migration solutions help accelerate this process. This match-up simplifies challenges around DAM/MAM integration, speeds up LTO archive retirement, transcodes video, and adds value through metadata analysis and storage by leveraging AI/ML.

1. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Architecting digital media archive
migrations with AWS
Chris Rogers
Global Storage BD
AWS
S T G 3 0 1
Christopher Kuthan
Global Media Solutions BD
AWS

2. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Agenda
• Data migration challenges
• AWS data transfer
• Media asset migration architecture
• Demo
• Customer Q&A

3. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
What are customers saying?
• Retire on-premises archives and legacy
middleware
• Bring value and discoverability to existing
assets
• Standardize mezzanine and proxy video
formats and containers
• Synchronize multiple sites, silos, asset
managers, and archives

4. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

5. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AWS data transfer and hybrid storage
Online
data transfer
Hybrid
storage
Offline
data transfer
Edge locations
for Amazon S3–
enabled
applications
Online transfer
of active data
AWS
DataSync
Managed file
transfers into
Amazon S3
AWS Transfer
for SFTP
Load streaming
data into
Amazon S3
Amazon
Kinesis Data
Firehose
Ship static data
into and out of
Amazon S3
AWS
Snowball
Storage and
compute in
disconnected
environments
AWS
Snowball
Edge
Access AWS
storage from
on-premises
AWS Storage
Gateway
S3 Transfer
Acceleration

6. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AWS Snowball AWS Snowball Edge AWS Snowmobile
• 50- or 80-TB storage capacity
• 10GE networking
• Data encryption, end to end
• Rugged 8.5 G impact case
• Rain and dust resistant
• 42/100-TB storage capacity (S3)
• 10/25/40GE networking
• Data encryption, end to end
• Rugged 8.5 G impact case
• Rain and dust resistant
• Clustering
• AWS Greengrass for local compute, messaging
and caching
• Amazon EC2/AMI support
• GPU options
• Exabyte-scale storage in a 45-ft container
(90-PB S3/Glacier/EBS)
• Data encryption, end to end
• Dedicated security personnel
• GPS tracking, alarm monitoring, 24/7
surveillance, and optional additional
security
AWS Snow family
Data transfer only Data transfer and edge compute 20+ PB data transfer

7. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Snowball Edge: Beyond bulk data migration
• Capture, store, and process data from variable sources at the edge or in traditional
datacenters
• Embedded compute enables mix of workloads for processing at the edge
Collect and process dataCreate job Ship to AWS Moved to S3

8. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
What is AWS DataSync?
Fast data
transfer
Cost effective
Combines the speed and reliability of network acceleration software
with the cost-effectiveness of open-source tools
Easy to use Secure and
reliable
Cloud
integrated
AWS
Online transfer service that simplifies, automates, and
accelerates moving data between on-premises storage and AWS

9. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Shared
file system
NFS TLS
How AWS DataSync works
On premises
Amazon S3
bucket
AWS Storage resources
Agent deployed
on-premises for
fast access to local
storage
Region
Amazon EFS
file system
AWS DataSync
agent
Data transfer over
the WAN via
efficient purpose-
built protocol
Managed from
AWS Console or
AWS Command
Line Interface
(AWS CLI)
Service in AWS
writes or reads
data from AWS
storage services
AWS DataSync
service

10. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
DataSync features
Simple to use
• Setup and manage via the AWS
Console, CLI, or SDK
• Agent updates and patches are
automated and fully managed
• Supports Terraform
Management and compliance
• Monitor with Amazon CloudWatch
• Control and audit usage with AWS Identity
and Access Management (IAM) and AWS
CloudTrail
• PCI-DSS compliant and HIPAA eligible
Fast data transfer
• Transfer speeds up to 10 Gbps per agent
• Incremental transfers, parallelization,
compression, and sparse file detection
• Configurable throughput limits
Secure data transfer
• Encryption in-transit with TLS1.2
• Supports AWS KMS encryption at rest
• Data validation in-transit and at-rest
• Auto-recover from failures

11. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

12. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Trademark
Benefits of archive migration to AWS
Content Agility Intelligence Access
Build, iterate, scale to
capture new business
opportunities
Utilize analytics & ML
to enhance context &
metadata
Build global footprint
with flexible access
Focus on content and
not infrastructure
Legacy systems
Tackle legacy problems

13. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AWS Media2Cloud Solution
Offline tape migration
Egress optimization
Proprietary conversion
Metadata export
Proxy generation
Media asset
registry
Media analytics
MAM modernization
Metadata import
Security and DR
Lifecycle & cost optimization
Three-phased project template: Export assets with metadata, process/analysis, and import to MAM
Flexible to accommodate different workflows, content types, and partner components
AWS Professional Services to provide optional assessment, project management, and offline tape migration
Drain
existing archive
Generate
content value
Import
into a modern MAM

14. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AWS Media2Cloud Solution benefits
Source video
media analysis workflow
Media Analysis
Solution
Ingest workflow
Amazon S3
bucket
(ingest)
Amazon S3
Glacier
AWS Step
Functions
AWS Step
Functions
AWS Elemental
MediaConvert
Amazon Simple
Notification Service
Amazon Simple
Notification Service
Amazon S3
bucket
(ingest)
Amazon
DynamoDB
Amazon
API Gateway
AWS Lambda
Amazon Elasticsearch
• DataSync transfers assets to S3 bucket or
EFS. Data can be lifecycled to Amazon S3
Glacier.
• Reduces the risks associated with large-
scale migrations through tested
approach.
• Accelerates the project through ready-to-
deploy and proven technology
templates.
• Minimizes costs and adds automation
through serverless architecture.
• Leverages the collective experience of
AWS, our partners, and customers.
• Adds machine-learning-generated
metadata for better content
discoverability and utilization.
AWS DataSync
Meta Data
LTO
NFS

15. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Ingest workflow
User uploads video file (through the web interface
or directly to S3 bucket)
S3 event triggers Step Functions to start the ingest
process
New asset gets registered (UUID and MD5) to
Amazon DynamoDB tables
Proxies are generated with AWS Elemental
MediaConvert
Users are notified
Ingest bucket
(lifecycle policy)
Subscribers
Source video
Ingest workflow
Lambda
function
AWS Step
Functions
AWS Elemental MediaConvert
Amazon Simple
Notification Service
Amazon
DynamoDB
Proxy bucket
1
1 2
2
3
3
4
4
5
5

16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Media analysis workflow
Lambda
function
Lambda
function
Media analysis workflow
Amazon
API Gateway
AWS Step
Functions
Media Analysis
Solution
(state machine)
Amazon
Elasticsearch Service
Amazon S3
bucket
(proxy)
Creation of metadata is triggered by web interface
or programmatically
Step Functions starts and monitors Media Analysis
state machine
AI & ML metadata is indexed in Amazon
Elasticsearch cluster
When media analysis completes, post-process
starts to convert metadata to WebVTT tracks, such
as subtitle
1
1
2
2
3
3
4
4

17. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Web interface
Amazon Cognito Amazon API Gateway Amazon Elasticsearch
Service
Client Amazon CloudFront
AWS IoT Core
Web bucket
User accesses web app through Amazon
CloudFront (web bucket is protected by
OAID)
User authenticates through Amazon Cognito
Web app automatically subscribes to AWS
IoT Core to receive messages from backend
processes
User can search metadata through Amazon
API Gateway/Amazon Elasticsearch Service
1
1
2
2
3
3
4
4

18. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AWS media solutions benefits
One-click launch
Launch a fully-
tested solution
starter kit in your
AWS account with
one click
Accelerate
revenue
Get started with
your project
quickly, and start
monetizing your
content
Well-architected
Rely on the
architecture that
reflect AWS best
practices
Agility
Save the resources
of developing a
solution from the
beginning
Expand and add
Use the
framework and
available guides to
expand the
solution starter kit
based on your
needs
The media analysis starter kit provides customers with a pre-built solution for common media use
cases, which includes a step-by-step implementation guide for automated deployment

19. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

20. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Getting started
Learn more about AWS for Media & Entertainment https://aws.amazon.com/media/ | https://aws.amazon.com/blogs/media/
Have a conversation with your AWS account team or kuthan@amazon.com
Go to AWS Solutions: aws.amazon.com/media/solutions

21. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Questions?

22. Thank you!
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Chris Rogers
Global Storage BD
AWS
Christopher Kuthan
Global Media Solutions BD
AWS