This session walks through approaches for large-scale media processing scenarios. We cover hybrid and cloud-based transcoding, file transfer, media preparation, and media management. We expect attendees to come away with an understanding of best practices for architecting and deploying hybrid and cloud-based systems for media processing.

1. tweet #reinvent

2. Possibilities for Media Processing Workloads on AWS
Hybrid
or
100% cloud environment

3. Problem: Timeline overruns to support PS3 launch
Solution: AWS’s Scale, 1200 virtual machines on-demand
Benefits: 17,000 titles (80 TB of data) transcoded in days,
able to support launch

5. Workflow
Controller
RTMP
Live Stream
Media
Files Content Delivery
Physical
Media
Transcoders
Camera
HD-SDI Store input
streams
Store output
profile and file
Corporate Data center

6. You start streaming
Capacity
Deficit Hourly Peaks
Steady
State
3:00 am 4:00 am 5:00 am 6:00 am 7:00 am 8:00 am 9:00 am 10:00 am 11:00 am 12:00 pm 1:00 pm 2:00 pm 3:00 pm 4:00 pm 5:00 pm 6:00 pm 7:00 pm 8:00 pm

7. You start streaming
Capacity
Deficit Hourly Peaks
Inadequate
Wasted
Capacity
Capacity
Steady
State
3:00 am 4:00 am 5:00 am 6:00 am 7:00 am 8:00 am 9:00 am 10:00 am 11:00 am 12:00 pm 1:00 pm 2:00 pm 3:00 pm 4:00 pm 5:00 pm 6:00 pm 7:00 pm 8:00 pm

9. CloudWatch Cloudformation
SQS SNS CloudSearch
SWF
SES EMR API
EC2 RDS Your Applications
EBS CloudFront
S3
9 Regions
Multiple Availability Zones per region

11. Workflow Controller
Amazon Machine Image (AMI)
Transcoders
Store output
profile and file
EC2
(Transcoders)
Store input Elastic Block Store
streams
Corporate Data Center AWS Cloud

12. Vanilla OS > Deploy your code > Create a Custom AMI
on Linux or Windows EC2
Use pre-built AMIs from AWS Marketplace or the vendor

13. Ephemeral Storage
Instance store
Sequential I/O
Limited storage
Can be used as temporary storage at processing node
EBS (Elastic Block Store)
Persistent store
1 TB volumes
Provisioned IOPs EBS volumes
EBS optimized Instances
Multiple EBS volumes stripe

14. Workflow Controller
AMI
Transcoders
AWS Direct
Connect
Store output
profile and file EC2
EBS (Transcoders)
Store input
streams
Corporate Data Center AWS Cloud

15. Aspera On-demand Direct to S3

17. Workflow Controller
AMI
Auto Scaling
Transcoders
AWS Direct
Connect
Store output
profile and file Reserved/Spot
Instance
EBS Instances
Store input
streams
Corporate Data Center
AWS Cloud

19. SNS SQS SWF
Workflow Controller
Auto Scaling
AMI
AWS Direct
Connect
Transcoders
Store output
profile and file
Store input Reserved/Spot Transcode
streams Instances Queue
Corporate Data Center AWS Cloud

20. Amazon SWF
Transcode Worker
Transcode Worker
Transcode Worker (Spot)
Transcode
Queue
Transcode Worker (Spot)
Input files in S3

21. Amazon SWF
Slicer
Transcode Worker
CMS
Transcode Worker
Transcode Worker (Spot)
Transcode
Queue
Transcode Worker (Spot)
Input files in S3

23. compute
network memory
local storage
I/O

24. SNS SQS SWF
Workflow Controller
Auto Scaling
AMI
Transcode
Reserved/Spot Queue
Instances
EBS
Transcoders
S3 for input
files
Corporate Data Center AWS Direct
Connect AWS Cloud

25. S3 API Object
Lifecycle
Amazon S3 Amazon Glacier

26. S3FS

27. Processing Node
s3sync
Processing Node
Amazon S3
Gluster
Processing Node

29. Amazon CloudFront SNS SQS SWF
Workflow Controller
Delivery
Auto Scaling
AMI
Transcode
Queue
Reserved/Spot
Instances
EBS
Transcoders
S3 for input
files
Corporate Data Center AWS Direct
AWS Cloud
Connect

31. YOU
Account Management
Network Configuration
OS Firewalls
Security Groups
Application
Operating System
Virtualization Infrastructure
Network Infrastructure
Physical Infrastructure
Physical Security
Facilities

32. AWS Certifications
SOC 1
ISO 27001 Certification
PCI Level 1 Service Provider
FedRAMP (FISMA moderate & low)
GovCloud
MPAA Best Practices Compliance
Customer are running Sarbanes-Oxley (SOX), HIPAA (healthcare),
FISMA (US Federal Government), DIACAP MAC III Sensitive ATO,
International Traffic in Arms Regulations (ITAR)

34. Transcoding
Media Servers
DRM

35. New
Awesome
Device!

36. SNS SQS SWF
Workflow Controller
Auto Scaling
AMI
Transcode
Reserved/Spot Queue
Instances
EBS
Transcoders
AWS Direct S3
Corporate Data Center
AWS Cloud
Connect

39. re:Invent Sessions
Documentation

40. We are sincerely eager to tweet #reinvent
hear your feedback on this
presentation and on re:Invent.
Please fill out an evaluation
form when you have a
chance.