This document discusses a new approach to industrial data logistics called the data logistics approach. It aims to overcome proprietary data ecosystems by keeping data raw, integrating it at the source, and allowing for scalability. This is done through an open source approach using tools like Elasticsearch for search and analytics, connectors for data linking, and ZeroMQ for data transfer. The goals are to connect stakeholders to various data sources in a way that provides tailored access without information loss or performance issues. The traditional approach of custom data storage tools and standardized schemas can lead to proprietary access, data loss, and broken systems. The data logistics approach is argued to satisfy all stakeholder needs and allow for adding new data sources.
FIWARE Tech Summit - Data Ahead - the New Data Logistic Approach
1. // 0
THE NEW MASS DATA LOGISTICS APPROACH
MARKUS IGEL & IAN KNOX
OVERCOMING PROPRIETARY ECO-SYSTEMS IN MANUFACTURING
INDUSTRIES
2. www.industrialdataspace.org // 1
WHO WE ARE…
We are a systems supplier for measurement and test technology. We provide
hardware, software, and data management solutions as well as comprehensive
consulting and services in diverse sectors.
3. www.industrialdataspace.org // 2
….. AND WHAT OUR COSTUMER DOES
Qorvo is an American semiconductor manufacturer for radio-frequency (RF)
systems with more than 8,000 employees in 17 different countries. They are a
market leader in this industry.
8. www.industrialdataspace.org // 7
THE GOAL:
CONNECTING STAKEHOLDERS TO DATA SOURCES
The Stakeholders for Data Access:
• Executives
• Floor Workers
• Management
Requirements:
• Tailored Data Access
• No Information Loss
• Scalability
• Condition Monitoring
9. www.industrialdataspace.org // 8
ISSUES WITH TRADITIONAL APPROACHES
The Traditional Approach:
• Custom tools for data storage and use
• Standardized data schemes
• Relational databases
The Issues:
• Proprietary data access
• Data loss
• Performance Issues
This WILL lead to a broken system!
10. www.industrialdataspace.org // 9
THE DATA LOGISTICS APPROACH
Focus on Organization Rather than Standardization
• Keep data raw
• Integrate the data at the source
• Scale with new data sources
• Data flow instead of huge data graves!
Use An “Open Source” Approach to Access Data
• Break proprietary data access
17. www.industrialdataspace.org // 16
ELASTIC GEAR
Data Available with Elasticsearch – A Search and Analytics Engine
• Open source
• Fast index updates
– Data is immediately searchable
• Combines many types of searches
• Automatic load balancing
18. www.industrialdataspace.org // 17
ELASTIC GEAR
▪ Link Data with Connectors
• Soft- and Hard Connectors
▪ Data Transfer with ZeroMQ
• Bidirectional communication
• CurveZMQ for security
19. www.industrialdataspace.org // 18
ELASTIC GEAR
Open Source Data Visualization Tools
• Many Solutions Are Already Available
– Kibana, Grafana
• Dashboards Provide Visualization for Every Need
– Time Series
– Status Overviews
– Pie Charts
– …
20. www.industrialdataspace.org // 19
WHAT DID WE ACHIEVE?
• All stakeholders’ needs are satisfied
• Circumstances like system down times can
be determined exactly
• Data is treated equally
• Possibility to add data sources
21. www.industrialdataspace.org // 20
FORECAST
WHAT SHOULD WE EXPECT?
• Architecture can be expanded to multiple industries
• Satisfying data curiosity leads to innovations
and improvements
• Retrofit of existing data environments