9. 9
THE ERA OF AI
The Defining Technology of Our Generation
Siri, Alexa, Facebook,
Twitter
WEB SERVICES
Radiology, Pathology,
Genomics
HEALTHCAREINTELLIGENT MACHINES
Self-Driving Cars,
Robotics
SECURITY
Cybersecurity, Public
Safety
FINANCE
Fraud Detection,
Trading
15. 15
“After finishing this book, you will have a deep understanding of how to set
technical direction for a machine learning project.”
www.mlyearning.org
16. 16
Programmability, Latency, Accuracy, Size of Model,
Throughput, Energy Efficiency, Rate of Learning
https://images.nvidia.com/content/pdf/plaster-deep-learning-framework.pdf
26. 26
Holodeck: photorealistic, collaborative VR
environment
Real-world experience through sight, sound, and
haptics
Explore high-fidelity, full-resolution models
THE DESIGN LAB OF THE
FUTURE
IMMERSIVE AI
28. 28
END TO END SYSTEM FOR AV
Sources: NVIDIA, RAND Corporation
SIMULATETRAIN MODELSCOLLECT DATA RE-SIMULATE
Lanes Lights
Path
Signs
PedestriansCars
Up to 2 petabytes per
car per year
20 DNNs
1+ million images
per DNN
10B+ miles to
ensure safe driving
Validate and verify
for self-driving cars
by 2020
MAPPING
5 + DNNs
Create and update
HD maps
30. 30
COMPUTATIONAL SCALE REQUIRED
3 million labeled images
1 DGX-1 trains 300k labeled images on 1 DNN in 1 day
10 DNNs required for self-driving
10 parallel experiments at all times
100 DGX-1 per car
32. 32
Xavier (ASIL-D rated)
“Our in-depth technical assessment confirms the Xavier SoC
architecture is suitable for use in autonomous driving applications and
highlights NVIDIA’s commitment to enable safe autonomous driving”;
TÜV SÜD, Germany
33. 33
XAVIER DLA
NOW OPEN SOURCE
Command Interface
Tensor Execution Micro-controller
Memory Interface
Input DMA
(Activations
and Weights)
Unified
512KB
Input
Buffer
Activations
and
Weights
Sparse Weight
Decompression
Native
Winograd
Input
Transform
MAC
Array
2048 Int8
or
1024 Int16
or
1024 FP16
Output
Accumulators
Output
Postprocess
or
(Activation
Function,
Pooling
etc.)
Output
DMA
WWW.NVDLA.ORG
35. “PEGASUS”
ROBOTAXI DRIVE PX
320 TOPS CUDA TensorCore | 16x GMSL | 4x 10G | 8x 1G | 16x 100M | Auto-grade | ASIL D
500W | Late Q1 Early Access Partners
Supercomputing Data Center in your Trunk
37. 37
TensorRT SUPPORTS Xavier
Deploy deep learning inference on Xavier
platforms through NVIDIA DRIVE AI Platforms
Import models in any framework (including TensorFlow,
Caffe and Torch) through ONNX, Universal Framework
Format or custom C/C++ API
Optimize CNN, RNN and novel neural network layers and
deploy reduced precision on Tensor Cores
Download for development or host environment today
Optimized Inference on the World’s Most
Powerful SoC
developer.nvidia.com/tensorrt
Lidar
Localization
Surround Perception
RADAR LIDAR
Egomotion Path
Planning
Camera
Localization
Lanes Signs Lights
Path
Perception
LIDAR
Localization
38. 38
NVIDIA TensorRT 4
Recommender,
Speech & Machine
Translation
RNN and MLP Layers ⚫ ONNX Import ⚫ NVIDIA DRIVE Support
Free download to members of NVIDIA Developer Program soon at
developer.nvidia.com/tensorrt
50x Faster Inference
for ONNX Models
Easily import and accelerate
inference for ONNX frameworks
with native ONNX parser in
TensorRT
Accelerate inference of
recommenders, speech and
machine translation apps with
new layers and optimizations
Deploy optimized deep learning
inference models NVIDIA DRIVE
Xavier
Support for NVIDIA
DRIVE Xavier
1
45x
0X
10X
20X
30X
40X
50X
CPU TensorRT
46. 46
NEXT-GENERATION NVIDIA NVLINK FOR V100
300 GB/sec per GPU, 10x Faster than PCIe Gen3
P100 P100
P100P100
P100 P100
P100P100
NVLink for Tesla Pascal NVLink for Tesla Volta
2 Rings 3 Rings
53. Fundamentals
Accelerated Computing
Game Development &
Digital Content
Finance
NVIDIA DEEP LEARNING
INSTITUTE
Online self-paced labs and instructor-led
workshops on deep learning and
accelerated computing
Take self-paced labs at
www.nvidia.co.uk/dlilabs
View upcoming workshops and request a
workshop onsite at www.nvidia.co.uk/dli
Educators can join the University
Ambassador Program to teach DLI courses
on campus and access resources. Learn
more at www.nvidia.com/dli
Intelligent Video
Analytics
Healthcare
Robotics
Autonomous Vehicles
Virtual Reality
54. 54
NVIDIA
INCEPTION
PROGRAM
Accelerates AI startups with a boost of
GPU tools, tech and deep learning expertise
Startup Qualifications
Driving advances in the field of AI
Business plan
Incorporated
Web presence
Technology
DL startup kit*
Pascal Titan X
Deep Learning Institute (DLI) credit
Connect with a DL tech expert
DGX-1 ISV discount*
Software release notification
Live webinar and office hours
*By application
Marketing
Inclusion in NVIDIA marketing efforts
GPU Technology Conference (GTC)
discount
Emerging Company Summit (ECS)
participation+
Marketing kit
One-page story template
eBook template
Inception web badge and banners
Social promotion request form
Event opportunities list
Promotion at industry events
GPU ventures+
+By invitation
www.nvidia.com/inception
55. 55
NEXT STEPS
NVIDIA Deep Learning Institute
www.nvidia.com/en-us/deep-learning-ai/education
GTC Munich | October 9-11 2018
www.nvidia.com/en-us/gtc
NGC
www.nvidia.com/en-us/gpu-cloud