5. 5
Exploding Model Size
Driving Accuracy
2017 2018 2019 2020 2021
GPT-3
175 Bn
2017 2018 2019 2020
Turing-NLG
17 Bn
BERT
340 M
Transformer
65 M
GPT-2 8B
8.3 Bn
#Parameters(Logscale)
2010 2015 2020 2025
175
Zettabytes
58
Zettabytes
Big Data Growth
90% of the World’s Data in last 2 Years
EXPLODING DATA AND MODEL SIZE
Growth In Scientific Data
Fueled by Accurate Sensors & Simulations
287 TB/day
ECMWF
393 TB
COVID-19 Graph Analytics
16 TB/sec
SKA
550 TB
NASA Mars Landing Sim.
Source for Big Data Growth chart: IDC – The Digitization of the World (May, 2020)
6. 6
TODAY’S AI
DATA CENTRE
50 DGX-1 systems for AI training
600 CPU systems for AI inference
$11M
25 racks
630 kW
7. 7
5 DGX A100 systems for AI training
and inference
$1M
1 rack
28 kW
1/10th
COST
1/20th
POWER
$1M 28 kW
DGX A100
DATA CENTER
8. 8
NVIDIA SELENE
Now Featuring NVIDIA DGX A100 640GB
4,480 A100 GPUs
560 DGX A100 system
850 Mellanox 200G HDR switches
14 PB of high-performance storage
2.8 EFLOPS of AI peak performance
63 PFLOPS HPL @ 24GF/W
9. 9
EARTH-SYSTEM MODELS
Long-wave and short-wave radiation
Cloud macro and micro-physics
Deep and shallow convection
Planetary boundary layer
Turbulent mountain stress
Gravity wave drag
Surface fluxes
Aerosols
Chemistry
Simulating the Earth
LARGE SCALE
DYNAMICS
SMALL SCALE
PHYSICS
Rotational Fluid Dynamics,
Confined to Sphere
Compressible Atmosphere
Chaotic Internal Variability
22. 22
AI TOOLKITS & SDKsCONTAINERS TRAINED MODELS HELM CHARTS
100+ 30+ ML, InferenceEnd-to-End AI Workflows
NGC Catalog
ON-PREMCLOUD EDGEHYBRID CLOUD
x86 | ARM | POWER
NGC – ACCELERATING TIME TO SOLUTION
https://ngc.nvidia.com
INDUSTRY APP FRAMEWORKS
Curated Software Assets
COLLECTIONS
32. 32
RICH
CONTENT
PORTFOLIO
Fundamentals and advanced
hands-on training in key
technologies and application
domains
AI for
Digital Content Creation
Deep Learning
Fundamentals
AI for HealthcareAI for Autonomous Vehicles
AI for
Intelligent Video Analytics
Accelerated Computing
Fundamentals
AI for Robotics
AI for
Predictive Maintenance
Accelerated Data Science
Fundamentals
Intro to AI in the Data
Center
AI for Anomaly Detection
AI for Industrial Inspection