2. Topics Covered
• Motivation to move to the cloud
• Challenges we faced
• Lessons Learned
• Efficiency Gains
2
3. Background
• Large investment in Hardware/Software
• Long term agreements
• Production environment
– Failure not an option!
• And We STILL wanted to go to the cloud
because of other technical and business
challenges.
3
4. VMIX Business Challenge
• Business Growth
– Ingesting 40,000+ new video files every day
– Video file sizes continue to grow
– Number of video file formats continues to grow
• Encoding for adaptive-bit rate
• Encoding for mobile screen sizes
• Geographic storage diversity
4
8. 2009 Architecture (Before AWS)
Management Account Administration Media Management Reporting and Analytics
Utilities
Objective C Java HTML/HTML5 Flash Javascript
Developer
Tools Public REST-Based API’s
Monitoring and Usage System
Upload Encode Store Manage Analyze Monetize Distribute
Core
In-House Web Media Organize Analytics Ad Server Direct
Platform
UGC Mobile Meta Data Search Reporting Ad Network Syndicate
VMIX Data Center
Cloud Services CDN
8
9. 2009: Data Flow (Before AWS)
Application Delivery
Processes
Ingestion
Local Storage
9
10. Analysis of Options
• Total Cost of Ownership Analysis
– Equipment and Maintenance Contracts
– Inbound/outbound data transfer
– Datacenter costs (power, usage, space, …)
– Storage management personnel
• Auditing Cloud Services
– Functionality, APIs, monitoring, reputation
• Architecture/Design Review
10
11. First Stage: AWS S3 Solution
• Development of ‘Storage Router’ (1 week)
– Routes requests to retrieve or store from either local
or S3 storage
– Moves files from local storage to S3 based on
configurable business rules (age of data, frequency of
access, …)
– Configurable timeline for redundant storage in both
local storage and S3
• Deployment
– Storage router regulated velocity of files stored in S3.
– 5 Terabytes data moved to S3 in first month
deployment
11
12. Today: Hybrid Architecture
Management Account Administration Media Management Reporting and Analytics
Utilities
Objective C Java HTML/HTML5 Flash Javascript
Developer
Tools Public REST-Based API’s
Monitoring and Usage System
Upload Encode Store Manage Analyze Monetize Distribute
Core
In-House Web Media Organize Analytics Ad Server Direct
Platform
UGC Mobile Meta Data Search Reporting Ad Network Syndicate
VMIX Data Center
AWSCloud Services
S3 CDN
12
13. Today: Hybrid Data Flow
Application Delivery
Processes
Ingestion Storage Router
Business Rules
Local AWS
Storage S3
13
14. Today on S3: 16 Million Objects
18000000
16000000
14000000
12000000
10000000
8000000
6000000 Objects
4000000
2000000
0
14
15. Today on S3: 4.5 Million Files
Accessed/Month
5000000
4500000
4000000
3500000
3000000
2500000
2000000
Put/Copy/Post/List
1500000 Get
1000000
500000
0
15
16. Results
• 23% reduction in storage costs in first year
– Cost savings continue to grow as usage scales
– Reduced time & effort to manage enabling greater
scalability of team
• Additional Benefits
– Focus on core business
– Improved Business Agility
• Less need to maintain excess capacity as buffer for business
growth.
• Ability to grow on demand
– Flexibility
• Hybrid approach enabling planned migration
16
17. Next Steps (Underway)
• 100% Pure Cloud Implementation
– Architecture underway
– Roll-out in Q4
17
18. Q410: Cloud Architecture
Management Account Administration Media Management Reporting and Analytics
Utilities
Objective C Java HTML/HTML5 Flash Javascript
Developer
Tools Public REST-Based API’s
Monitoring and Usage System
Upload Encode Store Manage Analyze Monetize Distribute
Core
In-House Web Media Organize Analytics Ad Server Direct
Platform
UGC Mobile Meta Data Search Reporting Ad Network Syndicate
EC2 SQS S3 RDS Cloud Front
18
