SlideShare a Scribd company logo
1 of 22
Agenda
• Motivation
• Preliminaries: data streaming in a nutshell
• Contribution: translation of Spatio-Temporal Logics to
Streaming-Based Monitoring Applications
• Evaluation
• Conclusion / Future work
2
95
95
95
• Monitoring rules are essential to detect anomalies /
dangerous situations / broken agents...
• Challenges: the # of devices, their heterogeneity,
their complex interactions...
• Wishlist:
• easy-to-express rules  “for the masses”
• efficient analysis  for timely detection
UAVs should never get
closer than 10 meters to cars
easy-to-express rules + efficient analysis
• Ingredients:
• High-level language  Spatio-temporal logics
• Continuous analysis paradigm  Data streaming
• Distributed / Parallel analysis framework  Stream Processing Engines
How do we take his knowledge...
... and transfer it here?
Agenda
• Motivation
• Preliminaries: data streaming in a nutshell
• Contribution: translation of Spatio-Temporal Logics to
Streaming-Based Monitoring Applications
• Evaluation
• Conclusion / Future work
5
7
data stream: unbounded sequence of tuples sharing the same schema
95
A 8:00 20
Ff Ff Ff
A 8:03 15
Ff Ff Ff
<UAV id, ts, speed, dest>
8
95
A 8:00 20
Ff Ff Ff
A 8:03 15
Ff Ff Ff
Join
Aggregate
stateful
continuous query: Directed Acyclic Graph of streams and operators Map
Filter
Union
Multiplex
stateless
Compute the average speed
in the last 10 minutes
(group by UAV)
Add to each UAV report
its average speed in the
last 10 minutes
Report UAVs close to
the destination that are
not decelerating
Stream Processing Engine (SPE)
Agenda
• Motivation
• Preliminaries: data streaming in a nutshell
• Contribution: translation of Spatio-Temporal Logics to
Streaming-Based Monitoring Applications
• Evaluation
• Conclusion / Future work
9
ifo
A
d
REET
pg
FEI
f
if a
o
A
d
REET
FEI
f
if a
o
A
d
REET
pg
FEI
f
if a
o
A
FEI
f
if a
o
A
d
REET
STREL
(Spatio-Temporal Reach and Escape Logic)
• Spatio-temporal modal logic
• Allows expressing properties over
attributes which vary over space and
time
𝕊2
-Operators
(streaming-STREL operators)
can be ported to the streaming
paradigm by means of
Base streaming operator
whose semantics can be
enforced composing
FEI
f
if a
o
A
FEI
f
if a
o
A
d
REET
= 𝑓( ) = 𝑔( )
STREL
(Spatio-Temporal Reach and Escape Logic)
• Spatio-temporal modal logic
• Allows expressing properties over
attributes which vary over space and
time
𝕊2
-Operators
(streaming-STREL operators)
can be ported to the streaming
paradigm by means of
Base streaming operators
whose semantics can be
enforced composing
What’s the novelty?
Can be automated!(1)
Any of the existing
SPEs can be used
(2)
Their distribution / parallelization
/ adaptiveness / fault-tolerance
solutions can be leveraged!
(3)
FEI
f
if a
o
A
d
REET
pg
FEI
f
if a
o
A
d
REET
pg
FEI
f
if a
o
A
d
REET
pg
FEI
f
if a
o
A
d
REET
pg
STREL
(Spatio-Temporal Reach and Escape Logic)
• Atomic propositions
(True/False/Undefined)
• Logical operations
(AND/OR/NOT)
• Temporal operators:
• Since
• Sometimes in the past
• Always in the past
• Spatial operators:
• Somewhere
• Everywhere
Join
Aggregate
stateful
Map
Filter
Union
Multiplex
stateless
d
REET
pg
= 𝑔( )
Base streaming operators
𝕊2
-MAP
𝕊2
-MERGE
𝕊2
-TAGGR (𝕊2
-time-aggregate)
𝕊2-LAGGR (𝕊2-location-aggregate)
𝕊2-Operators
(streaming-STREL operators)
FEI
f
if a
o
A
d
REET
pg
FEI
f
if a
o
A
d
REET
pg
= 𝑓( )
FEI
f
if a
o
A
d
REET
pg
FEI
f
if a
o
A
d
REET
pg
FEI
f
if a
o
A
d
REET
pg
FEI
f
if a
o
A
d
REET
pg
FEI
f
if a
o
A
d
REET
pg
FEI
f
if a
o
A
d
REET
pg
= 𝑓( )
d
REET
pg
= 𝑔( )
STREL
(Spatio-Temporal Reach and Escape Logic)
Any combination of STREL
operators...
Base streaming operators
𝕊2
-Operators
(streaming-STREL operators)
A tree of 𝕊2
-Operators
Each node of a tree
of 𝕊2
-Operators...
A DAG of base operators
FEI
f
if a
o
A
d
REET
pg
FEI
f
if a
o
A
d
REET
pg
FEI
f
if a
o
A
d
REET
pg
FEI
f
if a
o
A
d
REET
pg
FEI
f
if a
o
A
d
REET
pg
FEI
f
if a
o
A
d
REET
pg
= 𝑓( )
d
REET
pg
= 𝑔( )
STREL
(Spatio-Temporal Reach
and Escape Logic)
Base streaming operators
𝕊2
-Operators
(streaming-STREL operators)
the UAV should not have remained farther than 20 meters from its destination for longer than 10
minutes
95
Agenda
• Motivation
• Preliminaries: data streaming in a nutshell
• Contribution: translation of Spatio-Temporal Logics to
Streaming-Based Monitoring Applications
• Evaluation
• Conclusion / Future work
15
Evaluation
• Performance evaluation of the monitoring query:
• Implemented using Apache Flink
• Testbed: Odroid-XU4
• Synthetic data, discretized over
• Time: sampling frequency f (Hz)
• 2D space: number of cells c
the UAV should not have remained farther than 20
meters from its destination for longer than 10 minutes
95
Throughput,
latency and CPU
consumption for
increasing f values
and fixed c values
Evaluation
Evaluation
Throughput,
latency and CPU
consumption for
increasing c values
and fixed f values
Evaluation
For small to medium
spatial resolution,
throughput ~ 1000 t/s
(max f = 8), for high
spatial resolution,
throughput ~ 500 t/s
0
Evaluation
If the system is not
overloaded,
sub-millisecond latency
Agenda
• Motivation
• Preliminaries: data streaming in a nutshell
• Contribution: translation of Spatio-Temporal Logics to
Streaming-Based Monitoring Applications
• Evaluation
• Conclusion / Future work
21
Conclusions / future work
What’s next?
• Extended experimental evaluation
• Future temporal operators
• Spatial analysis based on paths
• Compilation optimizations
STREL
(Spatio-Temporal Reach and Escape Logic)
• Spatio-temporal modal logic
• Allows expressing properties over
attributes which vary over space and
time
𝕊2
-Operators
(streaming-STREL operators)
can be ported to the streaming
paradigm by means of
Base streaming operator
whose semantics can be
enforced composing
Strel streaming

More Related Content

What's hot

Presentazione L.M. Rinaldi Ivan
Presentazione L.M. Rinaldi IvanPresentazione L.M. Rinaldi Ivan
Presentazione L.M. Rinaldi Ivan
Ivan Rinaldi
 
Requirements in Cyber-Physical Systems: Specifications and Applications
Requirements in Cyber-Physical Systems: Specifications and ApplicationsRequirements in Cyber-Physical Systems: Specifications and Applications
Requirements in Cyber-Physical Systems: Specifications and Applications
Lionel Briand
 
Processing Real-Time Volcano Seismic Measurements Through Redis: David Chaves
Processing Real-Time Volcano Seismic Measurements Through Redis: David ChavesProcessing Real-Time Volcano Seismic Measurements Through Redis: David Chaves
Processing Real-Time Volcano Seismic Measurements Through Redis: David Chaves
Redis Labs
 
Object Detection Classification, tracking and Counting
Object Detection Classification, tracking and CountingObject Detection Classification, tracking and Counting
Object Detection Classification, tracking and Counting
Shounak Mitra
 

What's hot (20)

On the Necessity of Time-based Updates in SDN
On the Necessity of Time-based Updates in SDNOn the Necessity of Time-based Updates in SDN
On the Necessity of Time-based Updates in SDN
 
Presentazione L.M. Rinaldi Ivan
Presentazione L.M. Rinaldi IvanPresentazione L.M. Rinaldi Ivan
Presentazione L.M. Rinaldi Ivan
 
Trace-Checking CPS Properties: Bridging the Cyber-Physical Gap
Trace-Checking CPS Properties: Bridging the Cyber-Physical GapTrace-Checking CPS Properties: Bridging the Cyber-Physical Gap
Trace-Checking CPS Properties: Bridging the Cyber-Physical Gap
 
Requirements in Cyber-Physical Systems: Specifications and Applications
Requirements in Cyber-Physical Systems: Specifications and ApplicationsRequirements in Cyber-Physical Systems: Specifications and Applications
Requirements in Cyber-Physical Systems: Specifications and Applications
 
IEEE P2P 2013 - Bootstrapping Skynet: Calibration and Autonomic Self-Control ...
IEEE P2P 2013 - Bootstrapping Skynet: Calibration and Autonomic Self-Control ...IEEE P2P 2013 - Bootstrapping Skynet: Calibration and Autonomic Self-Control ...
IEEE P2P 2013 - Bootstrapping Skynet: Calibration and Autonomic Self-Control ...
 
Application Fault Tolerance (AFT)
Application Fault Tolerance (AFT)Application Fault Tolerance (AFT)
Application Fault Tolerance (AFT)
 
ScaRR
ScaRRScaRR
ScaRR
 
Programmable Logic Controls training day 2
Programmable Logic Controls training day 2Programmable Logic Controls training day 2
Programmable Logic Controls training day 2
 
Programmable Logic Controls training day 1
Programmable Logic Controls training day 1Programmable Logic Controls training day 1
Programmable Logic Controls training day 1
 
Classical and Modern Control Theory
Classical and Modern Control TheoryClassical and Modern Control Theory
Classical and Modern Control Theory
 
Model-driven trace diagnostics for pattern-based temporal specifications
Model-driven trace diagnostics for pattern-based temporal specificationsModel-driven trace diagnostics for pattern-based temporal specifications
Model-driven trace diagnostics for pattern-based temporal specifications
 
Processing Real-Time Volcano Seismic Measurements Through Redis: David Chaves
Processing Real-Time Volcano Seismic Measurements Through Redis: David ChavesProcessing Real-Time Volcano Seismic Measurements Through Redis: David Chaves
Processing Real-Time Volcano Seismic Measurements Through Redis: David Chaves
 
Saccolfinal 090505095735-phpapp01
Saccolfinal 090505095735-phpapp01Saccolfinal 090505095735-phpapp01
Saccolfinal 090505095735-phpapp01
 
Matthias J. Sax – A Tale of Squirrels and Storms
Matthias J. Sax – A Tale of Squirrels and StormsMatthias J. Sax – A Tale of Squirrels and Storms
Matthias J. Sax – A Tale of Squirrels and Storms
 
Elastic - DASH
Elastic - DASHElastic - DASH
Elastic - DASH
 
Classical and Modern Controls v2
Classical and Modern Controls v2Classical and Modern Controls v2
Classical and Modern Controls v2
 
Object Detection Classification, tracking and Counting
Object Detection Classification, tracking and CountingObject Detection Classification, tracking and Counting
Object Detection Classification, tracking and Counting
 
12 karel debrabandere_evaluation_of_satellite_irradiation_data__at_200_sites
12 karel debrabandere_evaluation_of_satellite_irradiation_data__at_200_sites12 karel debrabandere_evaluation_of_satellite_irradiation_data__at_200_sites
12 karel debrabandere_evaluation_of_satellite_irradiation_data__at_200_sites
 
Stream Loops on Flink - Reinventing the wheel for the streaming era
Stream Loops on Flink - Reinventing the wheel for the streaming eraStream Loops on Flink - Reinventing the wheel for the streaming era
Stream Loops on Flink - Reinventing the wheel for the streaming era
 
Enabling Model Testing of Cyber Physical Systems
Enabling Model Testing of Cyber Physical SystemsEnabling Model Testing of Cyber Physical Systems
Enabling Model Testing of Cyber Physical Systems
 

Similar to Strel streaming

Software Defined Optical Networks - Mayur Channegowda
Software Defined Optical Networks - Mayur ChannegowdaSoftware Defined Optical Networks - Mayur Channegowda
Software Defined Optical Networks - Mayur Channegowda
CPqD
 
Software Defined Optical Networks - Mayur Channegowda
Software Defined Optical Networks - Mayur ChannegowdaSoftware Defined Optical Networks - Mayur Channegowda
Software Defined Optical Networks - Mayur Channegowda
CPqD
 
On SDN Research Topics - Christian Esteve Rothenberg
On SDN Research Topics - Christian Esteve RothenbergOn SDN Research Topics - Christian Esteve Rothenberg
On SDN Research Topics - Christian Esteve Rothenberg
CPqD
 
Abstractions and Directives for Adapting Wavefront Algorithms to Future Archi...
Abstractions and Directives for Adapting Wavefront Algorithms to Future Archi...Abstractions and Directives for Adapting Wavefront Algorithms to Future Archi...
Abstractions and Directives for Adapting Wavefront Algorithms to Future Archi...
inside-BigData.com
 

Similar to Strel streaming (20)

Summit 16: The Hitchhiker/Hacker's Guide to NFV Benchmarking
Summit 16: The Hitchhiker/Hacker's Guide to NFV BenchmarkingSummit 16: The Hitchhiker/Hacker's Guide to NFV Benchmarking
Summit 16: The Hitchhiker/Hacker's Guide to NFV Benchmarking
 
The Challenges of SDN/OpenFlow in an Operational and Large-scale Network
The Challenges of SDN/OpenFlow in an Operational and Large-scale NetworkThe Challenges of SDN/OpenFlow in an Operational and Large-scale Network
The Challenges of SDN/OpenFlow in an Operational and Large-scale Network
 
Software Defined Optical Networks - Mayur Channegowda
Software Defined Optical Networks - Mayur ChannegowdaSoftware Defined Optical Networks - Mayur Channegowda
Software Defined Optical Networks - Mayur Channegowda
 
Software Defined Optical Networks - Mayur Channegowda
Software Defined Optical Networks - Mayur ChannegowdaSoftware Defined Optical Networks - Mayur Channegowda
Software Defined Optical Networks - Mayur Channegowda
 
2017 Atlanta Regional User Seminar Introduction
2017 Atlanta Regional User Seminar Introduction2017 Atlanta Regional User Seminar Introduction
2017 Atlanta Regional User Seminar Introduction
 
ROCOF-Webinar-Slides-May-2019_v4 (1).pdf
ROCOF-Webinar-Slides-May-2019_v4 (1).pdfROCOF-Webinar-Slides-May-2019_v4 (1).pdf
ROCOF-Webinar-Slides-May-2019_v4 (1).pdf
 
Simulating the behavior of satellite Internet links to small islands
Simulating the behavior of satellite Internet links to small islandsSimulating the behavior of satellite Internet links to small islands
Simulating the behavior of satellite Internet links to small islands
 
Crash course on data streaming (with examples using Apache Flink)
Crash course on data streaming (with examples using Apache Flink)Crash course on data streaming (with examples using Apache Flink)
Crash course on data streaming (with examples using Apache Flink)
 
On SDN Research Topics - Christian Esteve Rothenberg
On SDN Research Topics - Christian Esteve RothenbergOn SDN Research Topics - Christian Esteve Rothenberg
On SDN Research Topics - Christian Esteve Rothenberg
 
Development and Applications of Distributed IoT Sensors for Intermittent Conn...
Development and Applications of Distributed IoT Sensors for Intermittent Conn...Development and Applications of Distributed IoT Sensors for Intermittent Conn...
Development and Applications of Distributed IoT Sensors for Intermittent Conn...
 
F14_Class1.pptx
F14_Class1.pptxF14_Class1.pptx
F14_Class1.pptx
 
Gladier: The Globus Architecture for Data Intensive Experimental Research (AP...
Gladier: The Globus Architecture for Data Intensive Experimental Research (AP...Gladier: The Globus Architecture for Data Intensive Experimental Research (AP...
Gladier: The Globus Architecture for Data Intensive Experimental Research (AP...
 
FEWS Data Analysis with ARR2016
FEWS Data Analysis with ARR2016 FEWS Data Analysis with ARR2016
FEWS Data Analysis with ARR2016
 
PLNOG 3: John Evans - Best Practices in Network Planning
PLNOG 3: John Evans - Best Practices in Network PlanningPLNOG 3: John Evans - Best Practices in Network Planning
PLNOG 3: John Evans - Best Practices in Network Planning
 
Data Stream Management
Data Stream ManagementData Stream Management
Data Stream Management
 
Abstractions and Directives for Adapting Wavefront Algorithms to Future Archi...
Abstractions and Directives for Adapting Wavefront Algorithms to Future Archi...Abstractions and Directives for Adapting Wavefront Algorithms to Future Archi...
Abstractions and Directives for Adapting Wavefront Algorithms to Future Archi...
 
Spirent SDN and NFV Solutions
Spirent SDN and NFV SolutionsSpirent SDN and NFV Solutions
Spirent SDN and NFV Solutions
 
Spirent Accelerating SDN and NFV Deployments
Spirent Accelerating SDN and NFV DeploymentsSpirent Accelerating SDN and NFV Deployments
Spirent Accelerating SDN and NFV Deployments
 
4D Trajectories and Automation
4D Trajectories and Automation4D Trajectories and Automation
4D Trajectories and Automation
 
Timing verification of real-time automotive Ethernet networks: what can we ex...
Timing verification of real-time automotive Ethernet networks: what can we ex...Timing verification of real-time automotive Ethernet networks: what can we ex...
Timing verification of real-time automotive Ethernet networks: what can we ex...
 

More from Vincenzo Gulisano

More from Vincenzo Gulisano (9)

Tutorial: The Role of Event-Time Analysis Order in Data Streaming
Tutorial: The Role of Event-Time Analysis Order in Data StreamingTutorial: The Role of Event-Time Analysis Order in Data Streaming
Tutorial: The Role of Event-Time Analysis Order in Data Streaming
 
The data streaming processing paradigm and its use in modern fog architectures
The data streaming processing paradigm and its use in modern fog architecturesThe data streaming processing paradigm and its use in modern fog architectures
The data streaming processing paradigm and its use in modern fog architectures
 
Performance Modeling of Stream Joins
Performance Modeling of Stream JoinsPerformance Modeling of Stream Joins
Performance Modeling of Stream Joins
 
Data Streaming in Big Data Analysis
Data Streaming in Big Data AnalysisData Streaming in Big Data Analysis
Data Streaming in Big Data Analysis
 
Data Streaming in IoT and Big Data Analytics
Data Streaming in  IoT and Big Data AnalyticsData Streaming in  IoT and Big Data Analytics
Data Streaming in IoT and Big Data Analytics
 
The data streaming paradigm and its use in Fog architectures
The data streaming paradigm and its use in Fog architecturesThe data streaming paradigm and its use in Fog architectures
The data streaming paradigm and its use in Fog architectures
 
Data Streaming (in a Nutshell) ... and Spark's window operations
Data Streaming (in a Nutshell) ... and Spark's window operationsData Streaming (in a Nutshell) ... and Spark's window operations
Data Streaming (in a Nutshell) ... and Spark's window operations
 
ScaleJoin: a Deterministic, Disjoint-Parallel and Skew-Resilient Stream Join
ScaleJoin: a Deterministic, Disjoint-Parallel and Skew-Resilient Stream JoinScaleJoin: a Deterministic, Disjoint-Parallel and Skew-Resilient Stream Join
ScaleJoin: a Deterministic, Disjoint-Parallel and Skew-Resilient Stream Join
 
The benefits of fine-grained synchronization in deterministic and efficient ...
The benefits of fine-grained synchronization in  deterministic and efficient ...The benefits of fine-grained synchronization in  deterministic and efficient ...
The benefits of fine-grained synchronization in deterministic and efficient ...
 

Recently uploaded

Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Sérgio Sacani
 
Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptx
gindu3009
 
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
ssuser79fe74
 
Bacterial Identification and Classifications
Bacterial Identification and ClassificationsBacterial Identification and Classifications
Bacterial Identification and Classifications
Areesha Ahmad
 
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Lokesh Kothari
 
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroidsHubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
Sérgio Sacani
 
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Sérgio Sacani
 

Recently uploaded (20)

Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
 
Biological Classification BioHack (3).pdf
Biological Classification BioHack (3).pdfBiological Classification BioHack (3).pdf
Biological Classification BioHack (3).pdf
 
Nanoparticles synthesis and characterization​ ​
Nanoparticles synthesis and characterization​  ​Nanoparticles synthesis and characterization​  ​
Nanoparticles synthesis and characterization​ ​
 
Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptx
 
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
Chemical Tests; flame test, positive and negative ions test Edexcel Internati...
 
Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )
 
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43bNightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
 
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
 
Pulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceuticsPulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceutics
 
GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)
 
Bacterial Identification and Classifications
Bacterial Identification and ClassificationsBacterial Identification and Classifications
Bacterial Identification and Classifications
 
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
 
Botany 4th semester file By Sumit Kumar yadav.pdf
Botany 4th semester file By Sumit Kumar yadav.pdfBotany 4th semester file By Sumit Kumar yadav.pdf
Botany 4th semester file By Sumit Kumar yadav.pdf
 
Zoology 4th semester series (krishna).pdf
Zoology 4th semester series (krishna).pdfZoology 4th semester series (krishna).pdf
Zoology 4th semester series (krishna).pdf
 
Hire 💕 9907093804 Hooghly Call Girls Service Call Girls Agency
Hire 💕 9907093804 Hooghly Call Girls Service Call Girls AgencyHire 💕 9907093804 Hooghly Call Girls Service Call Girls Agency
Hire 💕 9907093804 Hooghly Call Girls Service Call Girls Agency
 
Recombinant DNA technology (Immunological screening)
Recombinant DNA technology (Immunological screening)Recombinant DNA technology (Immunological screening)
Recombinant DNA technology (Immunological screening)
 
Forensic Biology & Its biological significance.pdf
Forensic Biology & Its biological significance.pdfForensic Biology & Its biological significance.pdf
Forensic Biology & Its biological significance.pdf
 
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroidsHubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
 
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
 
Creating and Analyzing Definitive Screening Designs
Creating and Analyzing Definitive Screening DesignsCreating and Analyzing Definitive Screening Designs
Creating and Analyzing Definitive Screening Designs
 

Strel streaming

  • 1.
  • 2. Agenda • Motivation • Preliminaries: data streaming in a nutshell • Contribution: translation of Spatio-Temporal Logics to Streaming-Based Monitoring Applications • Evaluation • Conclusion / Future work 2
  • 3. 95 95 95 • Monitoring rules are essential to detect anomalies / dangerous situations / broken agents... • Challenges: the # of devices, their heterogeneity, their complex interactions... • Wishlist: • easy-to-express rules  “for the masses” • efficient analysis  for timely detection UAVs should never get closer than 10 meters to cars
  • 4. easy-to-express rules + efficient analysis • Ingredients: • High-level language  Spatio-temporal logics • Continuous analysis paradigm  Data streaming • Distributed / Parallel analysis framework  Stream Processing Engines How do we take his knowledge... ... and transfer it here?
  • 5. Agenda • Motivation • Preliminaries: data streaming in a nutshell • Contribution: translation of Spatio-Temporal Logics to Streaming-Based Monitoring Applications • Evaluation • Conclusion / Future work 5
  • 6. 7 data stream: unbounded sequence of tuples sharing the same schema 95 A 8:00 20 Ff Ff Ff A 8:03 15 Ff Ff Ff <UAV id, ts, speed, dest>
  • 7. 8 95 A 8:00 20 Ff Ff Ff A 8:03 15 Ff Ff Ff Join Aggregate stateful continuous query: Directed Acyclic Graph of streams and operators Map Filter Union Multiplex stateless Compute the average speed in the last 10 minutes (group by UAV) Add to each UAV report its average speed in the last 10 minutes Report UAVs close to the destination that are not decelerating Stream Processing Engine (SPE)
  • 8. Agenda • Motivation • Preliminaries: data streaming in a nutshell • Contribution: translation of Spatio-Temporal Logics to Streaming-Based Monitoring Applications • Evaluation • Conclusion / Future work 9
  • 9. ifo A d REET pg FEI f if a o A d REET FEI f if a o A d REET pg FEI f if a o A FEI f if a o A d REET STREL (Spatio-Temporal Reach and Escape Logic) • Spatio-temporal modal logic • Allows expressing properties over attributes which vary over space and time 𝕊2 -Operators (streaming-STREL operators) can be ported to the streaming paradigm by means of Base streaming operator whose semantics can be enforced composing FEI f if a o A FEI f if a o A d REET = 𝑓( ) = 𝑔( )
  • 10. STREL (Spatio-Temporal Reach and Escape Logic) • Spatio-temporal modal logic • Allows expressing properties over attributes which vary over space and time 𝕊2 -Operators (streaming-STREL operators) can be ported to the streaming paradigm by means of Base streaming operators whose semantics can be enforced composing What’s the novelty? Can be automated!(1) Any of the existing SPEs can be used (2) Their distribution / parallelization / adaptiveness / fault-tolerance solutions can be leveraged! (3)
  • 11. FEI f if a o A d REET pg FEI f if a o A d REET pg FEI f if a o A d REET pg FEI f if a o A d REET pg STREL (Spatio-Temporal Reach and Escape Logic) • Atomic propositions (True/False/Undefined) • Logical operations (AND/OR/NOT) • Temporal operators: • Since • Sometimes in the past • Always in the past • Spatial operators: • Somewhere • Everywhere Join Aggregate stateful Map Filter Union Multiplex stateless d REET pg = 𝑔( ) Base streaming operators 𝕊2 -MAP 𝕊2 -MERGE 𝕊2 -TAGGR (𝕊2 -time-aggregate) 𝕊2-LAGGR (𝕊2-location-aggregate) 𝕊2-Operators (streaming-STREL operators) FEI f if a o A d REET pg FEI f if a o A d REET pg = 𝑓( )
  • 12. FEI f if a o A d REET pg FEI f if a o A d REET pg FEI f if a o A d REET pg FEI f if a o A d REET pg FEI f if a o A d REET pg FEI f if a o A d REET pg = 𝑓( ) d REET pg = 𝑔( ) STREL (Spatio-Temporal Reach and Escape Logic) Any combination of STREL operators... Base streaming operators 𝕊2 -Operators (streaming-STREL operators) A tree of 𝕊2 -Operators Each node of a tree of 𝕊2 -Operators... A DAG of base operators
  • 13. FEI f if a o A d REET pg FEI f if a o A d REET pg FEI f if a o A d REET pg FEI f if a o A d REET pg FEI f if a o A d REET pg FEI f if a o A d REET pg = 𝑓( ) d REET pg = 𝑔( ) STREL (Spatio-Temporal Reach and Escape Logic) Base streaming operators 𝕊2 -Operators (streaming-STREL operators) the UAV should not have remained farther than 20 meters from its destination for longer than 10 minutes 95
  • 14. Agenda • Motivation • Preliminaries: data streaming in a nutshell • Contribution: translation of Spatio-Temporal Logics to Streaming-Based Monitoring Applications • Evaluation • Conclusion / Future work 15
  • 15. Evaluation • Performance evaluation of the monitoring query: • Implemented using Apache Flink • Testbed: Odroid-XU4 • Synthetic data, discretized over • Time: sampling frequency f (Hz) • 2D space: number of cells c the UAV should not have remained farther than 20 meters from its destination for longer than 10 minutes 95
  • 16. Throughput, latency and CPU consumption for increasing f values and fixed c values Evaluation
  • 17. Evaluation Throughput, latency and CPU consumption for increasing c values and fixed f values
  • 18. Evaluation For small to medium spatial resolution, throughput ~ 1000 t/s (max f = 8), for high spatial resolution, throughput ~ 500 t/s 0
  • 19. Evaluation If the system is not overloaded, sub-millisecond latency
  • 20. Agenda • Motivation • Preliminaries: data streaming in a nutshell • Contribution: translation of Spatio-Temporal Logics to Streaming-Based Monitoring Applications • Evaluation • Conclusion / Future work 21
  • 21. Conclusions / future work What’s next? • Extended experimental evaluation • Future temporal operators • Spatial analysis based on paths • Compilation optimizations STREL (Spatio-Temporal Reach and Escape Logic) • Spatio-temporal modal logic • Allows expressing properties over attributes which vary over space and time 𝕊2 -Operators (streaming-STREL operators) can be ported to the streaming paradigm by means of Base streaming operator whose semantics can be enforced composing

Editor's Notes

  1. In this work we focus on environments in which autonomous agents, Unmanned Arial Vehicles (UAVs) or cars, for instance, can interact with humans. /// In this environments, monitoring rules are used to check if everything is working correctly (simply put) /// Challenges [...] we usually have large / complex set of rules What we really want are easy-to-express rules (for experts that are not programmers) and efficient analysis (for timely detection)
  2. to achieve these goals we know the “ingredients” of the recipe: [...] /// The problem is who should take care of mixing them. Our research question is: How do we [...]?
  3. Differently from databases, which are designed to essentially store information and later query it, streaming applications (run by Stream Processing Engines) are running continuously (a streaming application is usually referred to as a continuous query), processing new incoming data and producing results accordingly.
  4. Very briefly, in data streaming we have streams, unbounded [...], like this one {explain example}
  5. Which are fed to DAGs of operators. The basic operators are divided into stateless {explain} and stateful {explain}. We could do something like this for instance: {explain}
  6. We start by taking STREL: a Spatio-temporal [...] and show it can be ported to the streaming paradigm [...]. Then, we show that each one of these S2 operators [...]. In a LEGO-parallelism: we show that ...
  7. Why is this important? What’s the novelty? [...] Let me show you a bit more in detail (but without too many formalisms, because of time)
  8. With STREL, monitoring rules can be composed using propositions, [...]. When it comes to porting STREL to the streaming paradigm, we actually need 4 “rich” operators. And each one of these operators is actually a small composition of the basic operators I already mentioned before
  9. As we discuss in the paper [...] Let me show you an example.
  10. Rombo is somewhere negate always in the past negate