Video and slides synchronized, mp3 and slide download available at URL https://bit.ly/2HH6DpK. Matt Ranney breaks down the software components that come together to make a self-driving Uber drive itself. He talks about how they thoroughly test new software before it is deployed to the fleet. Filmed at qconlondon.com. Matt Ranney works on Uber ATG's simulation systems to exercise autonomy software before it gets onto the road. Before that, he worked on distributed systems, architecture, and performance at Uber.

1. Inside a
Self-Driving Uber
Matt Ranney
March 6, 2018

2. InfoQ.com: News & Community Site
Watch the video with slide
synchronization on InfoQ.com!
https://www.infoq.com/presentations/
uber-self-drive
• Over 1,000,000 software developers, architects and CTOs read the site world-
wide every month
• 250,000 senior developers subscribe to our weekly newsletter
• Published in 4 languages (English, Chinese, Japanese and Brazilian
Portuguese)
• Post content from our QCon conferences
• 2 dedicated podcast channels: The InfoQ Podcast, with a focus on
Architecture and The Engineering Culture Podcast, with a focus on building
• 96 deep dives on innovative topics packed as downloadable emags and
minibooks
• Over 40 new content items per week

3. Purpose of QCon
- to empower software development by facilitating the spread of
knowledge and innovation
Strategy
- practitioner-driven conference designed for YOU: influencers of
change and innovation in your teams
- speakers and topics driving the evolution and innovation
- connecting and catalyzing the influencers and innovators
Highlights
- attended by more than 12,000 delegates since 2007
- held in 9 cities worldwide
Presented at QCon London
www.qconlondon.com

5. 1.3 million people die
in car crashes every year.

6. source: https://crashstats.nhtsa.dot.gov/Api/Public/ViewPublication/812499

7. source: US National Highway Traffic Safety Administration
US only statistics for crash event causes

8. source: US National Highway Traffic Safety Administration
US only statistics for crash event causes

10. •
Americans average 293 hours driving every year.

11. •
Americans average 293 hours driving every year.
•
There are over 1 Billion cars in the world, but they
sit idle 96% of the time.

12. •
Americans average 293 hours driving every year.
•
There are over 1 Billion cars in the world, but they
sit idle 96% of the time.
•
In many cities, up to 20% of the land is devoted
to parking.

13. •
Americans average 293 hours driving every year.
•
There are over 1 Billion cars in the world, but they
sit idle 96% of the time.
•
In many cities, up to 20% of the land is devoted
to parking.
Houston, TX Little Rock, AR
Source: Old Urbanist and photoLith

14. Self-driving cars will make
our roads safer.

15. Self-driving cars will give us
our time and space back.

21. Source: https://medium.com/@UberATG/the-future-of-trucking-b3d2ea0d2db9

23. Hardware

25. Top mounted 360° Lidar

26. Top mounted 360° Lidar
Forward facing cameras

27. Side and rear facing cameras
Top mounted 360° Lidar
Forward facing cameras

28. Side and rear facing cameras
Top mounted 360° Lidar
Forward facing cameras
RadarRadar

29. Compute, storage and cooling
Side and rear facing cameras
Top mounted 360° Lidar
Forward facing cameras
RadarRadar

33. Sensors Compute Vehicle

34. Sensors Compute Vehicle
Uber Rider
App
Tablet

35. Software

38. Rider Input

39. Navigation
Rider Input

41. Navigation
Rider Input

42. Sensors
Navigation
Rider Input

43. Sensors
Navigation
Rider Input
Localization

44. Sensors
Navigation
Rider Input
Localization

45. Sensors Perception
Navigation
Rider Input
Localization

54. Sensors Perception
Navigation
Rider Input
Localization

55. Sensors Perception Prediction
Navigation
Rider Input
Localization

58. Sensors Perception Prediction
Navigation
Rider Input
Localization

59. Sensors Perception Prediction Planning
Navigation
Rider Input
Localization

62. Sensors Perception Prediction Planning
Navigation
Rider Input
Localization

63. Sensors Perception Prediction Planning Controls
Navigation
Rider Input
Localization

64. Sensors VehiclePerception Prediction Planning Controls
Navigation
Rider Input
Localization

65. Testing

73. Online Testing with real vehicles

74. Online Testing with real vehicles
• Slow

75. Online Testing with real vehicles
• Slow
• Expensive

76. Online Testing with real vehicles
• Slow
• Expensive
• Inconsistent

77. Online Testing with real vehicles
• Slow
• Expensive
• Inconsistent
• Poor Coverage

78. Online Testing with real vehicles
• Slow
• Expensive
• Inconsistent
• Poor Coverage
• Absolutely Necessary

80. Offline Testing with simulation

81. Offline Testing with simulation
• Fast

82. Offline Testing with simulation
• Fast
• Cheaper

83. Offline Testing with simulation
• Fast
• Cheaper
• Consistent

84. Offline Testing with simulation
• Fast
• Cheaper
• Consistent
• Full Coverage

85. Offline Testing with simulation
• Fast
• Cheaper
• Consistent
• Full Coverage
• Absolutely Necessary

86. Sensors VehiclePerception Prediction Planning Controls
Navigation
Rider Input
Localization

87. Logged
Sensors
Vehicle
Model
Perception Prediction Planning Controls
Navigation
Logged
Rider Input
Localization Vehicle Pose
Log Sim

90. Vehicle
Model
Prediction Planning Controls
Navigation
Logged
Rider Input
Vehicle Pose
Virtual Sim
Game
Engine
Perception Output

101. Write New Software
Update ML Models

102. Write New Software
Update ML Models
Test with Simulation suite

103. Write New Software
Update ML Models
Test with Simulation suite Test on track

104. Write New Software
Update ML Models
Test with Simulation suite Test on track
Deploy to Test Fleet

105. Write New Software
Update ML Models
Test with Simulation suite Test on track
Deploy to Test Fleet
Deploy to Full Fleet

106. Extract Logged Data
Write New Software
Update ML Models
Test with Simulation suite Test on track
Deploy to Test Fleet
Deploy to Full Fleet

107. Extract Logged Data
Identify Interesting Events
Write New Software
Update ML Models
Test with Simulation suite Test on track
Deploy to Test Fleet
Deploy to Full Fleet

108. Extract Logged Data
Identify Interesting Events
Write New Software
Update ML Models
Test with Simulation suite Test on track
Deploy to Test Fleet
Deploy to Full Fleet

111. Please Help

113. Thanks

115. Sensors VehiclePerception Prediction Planning Controls
Navigation
Rider Input
Localization

116. Watch the video with slide
synchronization on InfoQ.com!
https://www.infoq.com/presentations/
uber-self-drive