SlideShare uma empresa Scribd logo
1 de 14
Baixar para ler offline
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Spatio-temporal analysis of flows
in CDC 2013 data
Gennady Andrienko
Natalia Andrienko
http://geoanalytics.net
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Data processing procedures
1. Initial processing in Database
• Eliminating duplicates (same ID and time stamp)
• Eliminating stationary points (speed<2km/h)
• Dividing into days (by 3AM)
• Further dividing by 30min stops and 1km gaps
• Eliminating trajectories consisting of less than 5 points, shorter than 5
minutes, within 100m bounding rectangle
2. Further processing attempts in main memory
• Removing segments with speed > 75km/h
• Removing segments with high tortuosity (>2 over 1min), sinuosity (>5
over 1min) or being within 100m radius over 10-15 minutes
3. Still, the data are far from being perfect
• Wrong hardware / software / settings?
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Data quality
• Jumping around stops;
• Systematically wrong positions
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Summarization and aggregation of trajectories
• Density-driven Voronoi polygons, r=100m: 14,033 polygons country-wide
• Correctly reflect the street network
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Flows between adjacent polygons
• 14,033 polygons => 26,094 directed connections
• 5,723 used by at least 5 different trajectories
• Attribute “N different trajectories” compensates for “hairball” structures @stops
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Hourly time series of flows: transformation and clustering
• Only connections used by
at least 5 trajectories
1. Hourly time series
2. Smoothing by 3 hours
windows
3. Mean-normalization of
each time series
4. Clustering by k-Means
with different K
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Major clusters
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Cluster 5
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Cluster 3
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Cluster 1
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Cluster 2
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Cluster 4
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
Conclusions
• Different roads have different temporal signatures
• Especially bridges
• Too few trajectories per person / per road segment for more sophisticated
analysis
• Data quality issues
© Fraunhofer-Institut für Intelligente
Analyse- und Informationssysteme IAIS
What we can do:
• Analysis of flows and their temporal dynamics
Times
Locations
Movers
Spatial events
Spatial event data Spatial time series
Movement data Local time series
Spatial distributions
Trajectories
Details:
Visual Analytics of Movement: an Overview of
Methods, Tools, and Procedures
Information Visualization, 12(1), pp.3-24, 2013
and
Visual Analytics of Movement
Springer-Verlag 2013
ISBN 978-3-642-37582-8
Due: July 5, 2013

Mais conteúdo relacionado

Semelhante a Spatio temporal analysis of flows in cdc 2013 data

OSMC 2016 | Friends and foes in API Monitoring by Heinrich Hartmann
OSMC 2016 | Friends and foes in API Monitoring by Heinrich HartmannOSMC 2016 | Friends and foes in API Monitoring by Heinrich Hartmann
OSMC 2016 | Friends and foes in API Monitoring by Heinrich HartmannNETWAYS
 
OSMC 2016 - Friends and foes by Heinrich Hartmann
OSMC 2016 - Friends and foes by Heinrich HartmannOSMC 2016 - Friends and foes by Heinrich Hartmann
OSMC 2016 - Friends and foes by Heinrich HartmannNETWAYS
 
Crash course on data streaming (with examples using Apache Flink)
Crash course on data streaming (with examples using Apache Flink)Crash course on data streaming (with examples using Apache Flink)
Crash course on data streaming (with examples using Apache Flink)Vincenzo Gulisano
 
Improving Traffic Prediction Using Weather Data with Ramya Raghavendra
Improving Traffic Prediction Using Weather Data  with Ramya RaghavendraImproving Traffic Prediction Using Weather Data  with Ramya Raghavendra
Improving Traffic Prediction Using Weather Data with Ramya RaghavendraSpark Summit
 
The data streaming processing paradigm and its use in modern fog architectures
The data streaming processing paradigm and its use in modern fog architecturesThe data streaming processing paradigm and its use in modern fog architectures
The data streaming processing paradigm and its use in modern fog architecturesVincenzo Gulisano
 
MC Lecture 8 67875667767777775677887.pptx
MC Lecture 8 67875667767777775677887.pptxMC Lecture 8 67875667767777775677887.pptx
MC Lecture 8 67875667767777775677887.pptxBinyamBekeleMoges
 
Tsinghua University: Two Exemplary Applications in China
Tsinghua University: Two Exemplary Applications in ChinaTsinghua University: Two Exemplary Applications in China
Tsinghua University: Two Exemplary Applications in ChinaDataStax Academy
 
SharkFest16_Palm_Online
SharkFest16_Palm_OnlineSharkFest16_Palm_Online
SharkFest16_Palm_OnlineBrad Palm
 
Network visibility and control using industry standard sFlow telemetry
Network visibility and control using industry standard sFlow telemetryNetwork visibility and control using industry standard sFlow telemetry
Network visibility and control using industry standard sFlow telemetrypphaal
 
A Deep Learning use case for water end use detection by Roberto Díaz and José...
A Deep Learning use case for water end use detection by Roberto Díaz and José...A Deep Learning use case for water end use detection by Roberto Díaz and José...
A Deep Learning use case for water end use detection by Roberto Díaz and José...Big Data Spain
 
An Introduction to Distributed Data Streaming
An Introduction to Distributed Data StreamingAn Introduction to Distributed Data Streaming
An Introduction to Distributed Data StreamingParis Carbone
 
Improving Traffic Prediction Using Weather Datawith Ramya Raghavendra
Improving Traffic Prediction Using Weather Datawith Ramya RaghavendraImproving Traffic Prediction Using Weather Datawith Ramya Raghavendra
Improving Traffic Prediction Using Weather Datawith Ramya RaghavendraSpark Summit
 
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...Tal Lavian Ph.D.
 
Khatibi lecture cov.uni
Khatibi lecture cov.uniKhatibi lecture cov.uni
Khatibi lecture cov.uniRahman Khatibi
 
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...Tal Lavian Ph.D.
 
2014-04-easteros
2014-04-easteros2014-04-easteros
2014-04-easterosJack Wang
 

Semelhante a Spatio temporal analysis of flows in cdc 2013 data (20)

OSMC 2016 | Friends and foes in API Monitoring by Heinrich Hartmann
OSMC 2016 | Friends and foes in API Monitoring by Heinrich HartmannOSMC 2016 | Friends and foes in API Monitoring by Heinrich Hartmann
OSMC 2016 | Friends and foes in API Monitoring by Heinrich Hartmann
 
OSMC 2016 - Friends and foes by Heinrich Hartmann
OSMC 2016 - Friends and foes by Heinrich HartmannOSMC 2016 - Friends and foes by Heinrich Hartmann
OSMC 2016 - Friends and foes by Heinrich Hartmann
 
Crash course on data streaming (with examples using Apache Flink)
Crash course on data streaming (with examples using Apache Flink)Crash course on data streaming (with examples using Apache Flink)
Crash course on data streaming (with examples using Apache Flink)
 
Strel streaming
Strel streamingStrel streaming
Strel streaming
 
Av 738 - Adaptive Filtering Lecture 1 - Introduction
Av 738 - Adaptive Filtering Lecture 1 - IntroductionAv 738 - Adaptive Filtering Lecture 1 - Introduction
Av 738 - Adaptive Filtering Lecture 1 - Introduction
 
Improving Traffic Prediction Using Weather Data with Ramya Raghavendra
Improving Traffic Prediction Using Weather Data  with Ramya RaghavendraImproving Traffic Prediction Using Weather Data  with Ramya Raghavendra
Improving Traffic Prediction Using Weather Data with Ramya Raghavendra
 
The data streaming processing paradigm and its use in modern fog architectures
The data streaming processing paradigm and its use in modern fog architecturesThe data streaming processing paradigm and its use in modern fog architectures
The data streaming processing paradigm and its use in modern fog architectures
 
MC Lecture 8 67875667767777775677887.pptx
MC Lecture 8 67875667767777775677887.pptxMC Lecture 8 67875667767777775677887.pptx
MC Lecture 8 67875667767777775677887.pptx
 
Tsinghua University: Two Exemplary Applications in China
Tsinghua University: Two Exemplary Applications in ChinaTsinghua University: Two Exemplary Applications in China
Tsinghua University: Two Exemplary Applications in China
 
Chap2 slides
Chap2 slidesChap2 slides
Chap2 slides
 
L4 volume studies
L4 volume studiesL4 volume studies
L4 volume studies
 
SharkFest16_Palm_Online
SharkFest16_Palm_OnlineSharkFest16_Palm_Online
SharkFest16_Palm_Online
 
Network visibility and control using industry standard sFlow telemetry
Network visibility and control using industry standard sFlow telemetryNetwork visibility and control using industry standard sFlow telemetry
Network visibility and control using industry standard sFlow telemetry
 
A Deep Learning use case for water end use detection by Roberto Díaz and José...
A Deep Learning use case for water end use detection by Roberto Díaz and José...A Deep Learning use case for water end use detection by Roberto Díaz and José...
A Deep Learning use case for water end use detection by Roberto Díaz and José...
 
An Introduction to Distributed Data Streaming
An Introduction to Distributed Data StreamingAn Introduction to Distributed Data Streaming
An Introduction to Distributed Data Streaming
 
Improving Traffic Prediction Using Weather Datawith Ramya Raghavendra
Improving Traffic Prediction Using Weather Datawith Ramya RaghavendraImproving Traffic Prediction Using Weather Datawith Ramya Raghavendra
Improving Traffic Prediction Using Weather Datawith Ramya Raghavendra
 
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
 
Khatibi lecture cov.uni
Khatibi lecture cov.uniKhatibi lecture cov.uni
Khatibi lecture cov.uni
 
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...
 
2014-04-easteros
2014-04-easteros2014-04-easteros
2014-04-easteros
 

Mais de cdc2013workshop

Tracking daily mobilities: GPS based bicycle data collection, processing, and...
Tracking daily mobilities: GPS based bicycle data collection, processing, and...Tracking daily mobilities: GPS based bicycle data collection, processing, and...
Tracking daily mobilities: GPS based bicycle data collection, processing, and...cdc2013workshop
 
Cycling in ghent objective and subjective evaluation of civitas policy measures
Cycling in ghent objective and subjective evaluation of civitas policy measuresCycling in ghent objective and subjective evaluation of civitas policy measures
Cycling in ghent objective and subjective evaluation of civitas policy measurescdc2013workshop
 
Application of gps tracking in bicycle research
Application of gps tracking in bicycle researchApplication of gps tracking in bicycle research
Application of gps tracking in bicycle researchcdc2013workshop
 
Relating mobility patterns to socio demographic profiles
Relating mobility patterns to socio demographic profilesRelating mobility patterns to socio demographic profiles
Relating mobility patterns to socio demographic profilescdc2013workshop
 
Analyzing cyclists’ behaviors and exploring the environments from cycling tracks
Analyzing cyclists’ behaviors and exploring the environments from cycling tracksAnalyzing cyclists’ behaviors and exploring the environments from cycling tracks
Analyzing cyclists’ behaviors and exploring the environments from cycling trackscdc2013workshop
 
Reconstructing movement traces throug a hybrid map matching algorithm
Reconstructing movement traces throug a hybrid map matching algorithmReconstructing movement traces throug a hybrid map matching algorithm
Reconstructing movement traces throug a hybrid map matching algorithmcdc2013workshop
 
Extraction of bicycle commuter trips from day long gps trajectories
Extraction of bicycle commuter trips from day long gps trajectoriesExtraction of bicycle commuter trips from day long gps trajectories
Extraction of bicycle commuter trips from day long gps trajectoriescdc2013workshop
 
Cyclist's waiting: identifying road signal patterns
Cyclist's waiting: identifying road signal patternsCyclist's waiting: identifying road signal patterns
Cyclist's waiting: identifying road signal patternscdc2013workshop
 

Mais de cdc2013workshop (8)

Tracking daily mobilities: GPS based bicycle data collection, processing, and...
Tracking daily mobilities: GPS based bicycle data collection, processing, and...Tracking daily mobilities: GPS based bicycle data collection, processing, and...
Tracking daily mobilities: GPS based bicycle data collection, processing, and...
 
Cycling in ghent objective and subjective evaluation of civitas policy measures
Cycling in ghent objective and subjective evaluation of civitas policy measuresCycling in ghent objective and subjective evaluation of civitas policy measures
Cycling in ghent objective and subjective evaluation of civitas policy measures
 
Application of gps tracking in bicycle research
Application of gps tracking in bicycle researchApplication of gps tracking in bicycle research
Application of gps tracking in bicycle research
 
Relating mobility patterns to socio demographic profiles
Relating mobility patterns to socio demographic profilesRelating mobility patterns to socio demographic profiles
Relating mobility patterns to socio demographic profiles
 
Analyzing cyclists’ behaviors and exploring the environments from cycling tracks
Analyzing cyclists’ behaviors and exploring the environments from cycling tracksAnalyzing cyclists’ behaviors and exploring the environments from cycling tracks
Analyzing cyclists’ behaviors and exploring the environments from cycling tracks
 
Reconstructing movement traces throug a hybrid map matching algorithm
Reconstructing movement traces throug a hybrid map matching algorithmReconstructing movement traces throug a hybrid map matching algorithm
Reconstructing movement traces throug a hybrid map matching algorithm
 
Extraction of bicycle commuter trips from day long gps trajectories
Extraction of bicycle commuter trips from day long gps trajectoriesExtraction of bicycle commuter trips from day long gps trajectories
Extraction of bicycle commuter trips from day long gps trajectories
 
Cyclist's waiting: identifying road signal patterns
Cyclist's waiting: identifying road signal patternsCyclist's waiting: identifying road signal patterns
Cyclist's waiting: identifying road signal patterns
 

Último

Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxRustici Software
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Zilliz
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Victor Rentea
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityWSO2
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelDeepika Singh
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MIND CTI
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusZilliz
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Orbitshub
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxRemote DBA Services
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfOrbitshub
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10
 

Último (20)

Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 

Spatio temporal analysis of flows in cdc 2013 data

  • 1. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Spatio-temporal analysis of flows in CDC 2013 data Gennady Andrienko Natalia Andrienko http://geoanalytics.net
  • 2. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Data processing procedures 1. Initial processing in Database • Eliminating duplicates (same ID and time stamp) • Eliminating stationary points (speed<2km/h) • Dividing into days (by 3AM) • Further dividing by 30min stops and 1km gaps • Eliminating trajectories consisting of less than 5 points, shorter than 5 minutes, within 100m bounding rectangle 2. Further processing attempts in main memory • Removing segments with speed > 75km/h • Removing segments with high tortuosity (>2 over 1min), sinuosity (>5 over 1min) or being within 100m radius over 10-15 minutes 3. Still, the data are far from being perfect • Wrong hardware / software / settings?
  • 3. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Data quality • Jumping around stops; • Systematically wrong positions
  • 4. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Summarization and aggregation of trajectories • Density-driven Voronoi polygons, r=100m: 14,033 polygons country-wide • Correctly reflect the street network
  • 5. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Flows between adjacent polygons • 14,033 polygons => 26,094 directed connections • 5,723 used by at least 5 different trajectories • Attribute “N different trajectories” compensates for “hairball” structures @stops
  • 6. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Hourly time series of flows: transformation and clustering • Only connections used by at least 5 trajectories 1. Hourly time series 2. Smoothing by 3 hours windows 3. Mean-normalization of each time series 4. Clustering by k-Means with different K
  • 7. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Major clusters
  • 8. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Cluster 5
  • 9. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Cluster 3
  • 10. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Cluster 1
  • 11. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Cluster 2
  • 12. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Cluster 4
  • 13. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS Conclusions • Different roads have different temporal signatures • Especially bridges • Too few trajectories per person / per road segment for more sophisticated analysis • Data quality issues
  • 14. © Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS What we can do: • Analysis of flows and their temporal dynamics Times Locations Movers Spatial events Spatial event data Spatial time series Movement data Local time series Spatial distributions Trajectories Details: Visual Analytics of Movement: an Overview of Methods, Tools, and Procedures Information Visualization, 12(1), pp.3-24, 2013 and Visual Analytics of Movement Springer-Verlag 2013 ISBN 978-3-642-37582-8 Due: July 5, 2013