20. ● Docker helped generalize use cases
● Advanced scheduling required
● Initially ignored failures (with retries)
● Time sensitive batch came later
Lessons Learned from Batch
21. Current Container Usage - Batch
● 100 containers / hour
● Peaks of 1000’s per hour
● Large spikes of CI testing and Digital Watermarking
A random day’s worth of containers
25. “Why is Apache and Tomcat running on
my NodeJS server”
Problem:
BaseAMI optimized for Java, not
easily customizable
26. “Why do I need java, gradle, ospackage
after my non-Java build?”
27. “Why do I need java, gradle, ospackage
after my non-Java build?”
Problem:
Reuse of Java-centric AMI tooling
28. “I want an instance with a single core to
run my lightweight server”
29. “I want an instance with a single core to
run my lightweight server”
Problem:
Small instances are not reliable
30. Enter Docker
● Have a new language?
● Have a build tool you like?
● Want to resource isolate easily?
Come one, come all
31. Services are just long running batch?
Services
Job Management
Resource Management & Optimization
Container Execution
Integration
Service Apps
Batch
32. Services more complex
● Services resize constantly and run forever
○ Autoscaling
○ Hard to upgrade underlying hosts
33. Services more complex
● Services resize constantly and run forever
○ Autoscaling
○ Hard to upgrade underlying hosts
● Have more state
○ Ready for traffic vs. just started/stopped
○ Even harder to upgrade
34. Services more complex
● Services resize constantly and run forever
○ Autoscaling
○ Hard to upgrade underlying hosts
● Have more state
○ Ready for traffic vs. just started/stopped
○ Even harder to upgrade
● Existing well defined dev, deploy, runtime & ops tools
46. Current Container Usage - Service
● Still small - 100’s of containers
● NodeJS Device UI Scripts Apps
● Stream Processing Jobs - Flink
● Various Internal Dashboards
64. Future of containers @ Netflix
● More scale!
● Guaranteed capacity (service)
● Fair scheduling (batch)
● Local integration test env (devex)
● Next generation CI (devex)
● Internal RI spot market of trough