How to Get Started in Social Media for Art League City
SOLVE THE CHALLENGE OF DATA HARVESTING WITH A SMART RECORDING TOOLCHAIN
1. www.b-plus.com
Autonomous Vehicles Europe | 24.11.2022 | Page 1
b-plus technologies | Dipl.-Ing. (FH) Adrian Bertl | Strategic Product Manager | 24.11.2022
SOLVE THE CHALLENGE
OF DATA HARVESTING
WITH A SMART
RECORDING
TOOLCHAIN
2. www.b-plus.com
Autonomous Vehicles Europe | 24.11.2022 | Page 2
+ 1996
Founded by Prof. Dr. Jörg Böttcher as an Engineering Office and
Solution Provider for Network-Metrology and Automation Systems
+ 2022
Internationally networked development partner for autonomous driving
technologies, driver assistance systems and automation of mobile machines.
Specialized in
▪ development tools
▪ automotive software
▪ mobile automation
DEVELOPMENT - HISTORY
Deggendorf ITC (HQ) | Deggendorf DEGG´S | Regensburg | Lindau | Cham
3. www.b-plus.com
Autonomous Vehicles Europe | 24.11.2022 | Page 3
Plattform (AI)
HW
Sensor Set
System- & Datamanagement
Analytics
SW
Data
Processing
DL
DATA DRIVEN DEVELOPMENT & VALIDATION
AI
Data Sets
HiL & H-Repro
SiL & S-Repro
Data Ingestion
In-Vehicle
Dataharvesting
Vehicle
Dataharvesting
4. www.b-plus.com
Autonomous Vehicles Europe | 24.11.2022 | Page 4
Feature
Collect
Select
Train
Validate
and Test
SELECTION OF TYPICAL CHALLENGES
Is my recording synchronous?
Data Sets
Is my data correctly acquired?
5. www.b-plus.com
Autonomous Vehicles Europe | 24.11.2022 | Page 5
SYNCHRONITY
Aspects of data quality - Synchronity
„CLOCKS ON SOURCES HAVE TO BE SYNCHRONIZED“
camera 1 camera 2
Same Time Base for fusion
6. www.b-plus.com
Autonomous Vehicles Europe | 24.11.2022 | Page 6
BRICK UPS
STORE
RECORD
DISTRIBUTE
CONVERT
SENSE Gig E Vision
Cam
FPD Leopard
Cam 1 - 8
Cepton Lidar
(Front View)
Lidar Ouster
(Panorama View)
MDILink 1 - 4
MDSwitch
BRICKplus
MDLake
GPS
BRICKplus
3 2 2
4
MANAGE
POWER
LVD
1G Ethernet
10G Ethernet
100G Backbone
(Ethernet)
TYPICAL ADAS/AD RECORDING SETUP CLOCK DISTRIBUTION TIME DOMAINS
Global Time TAI
Working Clock Domain
Hardware
Synchronization
IEEE 1588 PTP IEEE 802.1AS gPTP
7. www.b-plus.com
Autonomous Vehicles Europe | 24.11.2022 | Page 7
SYNCHRONITY OF DATA
Aspects of data quality – Triggering Sensors for even higher accuracy
time
Asynchronous Triggers
Synchronized
Clocks
time
Synchronized Triggers
Processing Node Trigger the sensors
8. www.b-plus.com
Autonomous Vehicles Europe | 24.11.2022 | Page 8
TRANSPORT CHECK - INTEGRITY
Aspects of data quality – Integrity with CRC and frame counters
„DETECTING FRAME LOSSES“
SW
HW
adapter
FPGA
CRC UDP
10 GbE
Ethernet Switch Data Logger
9. www.b-plus.com
Autonomous Vehicles Europe | 24.11.2022 | Page 9
Feature
Collect
Select
Train
Validate
and Test
SELECTION OF TYPICAL CHALLENGES
How do I monitor my progress?
Data Sets
Is this scenario what I am searching
for? (Relevance)
What is in my recording?
15. www.b-plus.com
Autonomous Vehicles Europe | 24.11.2022 | Page 15
CHALLENGES
DURING THE TYPICAL
RECORDING PROCESS
time to analysis
duplicate data collected
corner cases
regulations
moving data globally
18. www.b-plus.com
Autonomous Vehicles Europe | 24.11.2022 | Page 18
DATA RECORDING
test fleets collecting real
environment test data
DATA PROCESSING
„SMART RECORDING“
DATA INGEST
„INTELLIGENT INGEST“
upload into data center
PREPROCESSING
DATA IN THE VEHICLE AND THE EDGE DURING INGEST
Store Detect Learn Loop Label Filter
DATA CENTER
SMART RECORDING & INGEST
SHIFTING BLOCKS TO THE EDGE
19. www.b-plus.com
Autonomous Vehicles Europe | 24.11.2022 | Page 19
COLLECTION INGEST DATA CENTER HiL/SiL
RAW
Sensor Data
Multi
-
Gbit/s
Kbit/s
META Data
Vehicle Bus
ECU & Algo
Insights
CLASSIFY &
SEPARATE
VALUABLE DATA
22. www.b-plus.com
Autonomous Vehicles Europe | 24.11.2022 | Page 23
ADDING NEW LAYERS
+ In vehicle processing unit for raw data streams for multi purposes has to be
integrated.
+ Data streams have to be redirected out to this machine.
+ Having now a complex measurement setup , Fleet Management is the next
step for efficient operation:
+ Roll out driving tasks from the operator
+ Roll out measurement configuration
+ Monitor status of detections
ADDING COMPUTE AND FLEET MANAGEMENT
Panorama
View
Front
View
27. www.b-plus.com
Autonomous Vehicles Europe | 24.11.2022 | Page 29
DATA RECORDING
test fleets collecting real
environment test data
DATA PROCESSING
„SMART RECORDING“
DATA INGEST
„INTELLIGENT INGEST“
upload into data center
PREPROCESSING
DATA IN THE VEHICLE AND THE EDGE DURING INGEST
Store Detect Learn Loop Label Filter
DATA CENTER
SMART RECORDING & INGEST
Data Conversion
Data Preparation
Data prioritation (Hot, Cold, Glacier)
28. www.b-plus.com
Autonomous Vehicles Europe | 24.11.2022 | Page 30
CONCLUSION FOR HANDLING PETABYTES OF DATA
+ Keep integrity of data for temporal correlation
+ Monitor integrity of the transport – Is a bit lost?
+ Gain early visibility on data content and generate meta data
+ Enable data processing as a generic step in your vehicle along data logging
+ Keep the vehicle monitored and updated over the air for the test fleet
+ Enable a smooth transition from the vehicle to the data center
Separate the valuable wheat from the chaff
SMART DATA HARVESTING WITH A DATA PIPELINE
Data Sets
