Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/2p9iu6d.
Eugene Kirpichov describes the theory and practice behind Cloud Dataflow's approach to straggler elimination, as well as the associated non-obvious challenges, benefits, and implications of the technique. Filmed at qconlondon.com.
Eugene Kirpichov is a Senior Software Engineer on the Cloud Dataflow team at Google, working primarily on the autoscaling and work rebalancing secret sauce as well as the Apache Beam programming model. He is also very interested in functional programming languages, data visualization (especially visualization of behavior of parallel/distributed systems), and machine learning.