SlideShare uma empresa Scribd logo
1 de 19
Baixar para ler offline
Predicting Weather
Inflicted Train Delays
Finnish Meteorological Institute
Roope Tervo
Laila Daniel
Photo by Kalevi Lehtonen 1955. Not published until Commons in 2014.
https://fi.wikipedia.org/wiki/Tiedosto:Finnish_class_Dm4_locomotive_number_1607_in_the_year_1955.jpg
If not otherwise stated, all images by author, licence CC4BY Image: Solita Oy
Operation center can take several actions:
• Reduce train shifts
• Communicate
Project timeline: 01/2018-10/2018
Project partners: FMI, FTA, Trafi, VR
Area: Finland
Time range: 2 days ahead
Time step: 1 hour
We aim to predict
disruption of rail traffic
caused by weather
If not otherwise stated, all images by author, licence CC4BY
Label
data
+
Feature
data
Method Results
If not otherwise stated, all images by author, licence CC4BY
MethodNWP Prediction
• Data from 2010 – 2018
• 30 M rows | 5.5 GB data
Data consist of train delays and corresponding
weather observations
Data Liikennevirasto (CC4)
Delay between stations
• Passenger trains
• 514 stations
Weather observations
• 19 parameters
Most trains run in time
Mean delay over all stations
2010
2018
2014
0
50
100
Minutes
Most trains run in time
Mean delay over all stations
2010
2018
2014
0
50
100
Minutes
But severe delays happen quite regurarly every year
If not otherwise stated, all images by author, licence CC4BY
Various pre-processing methods used
Tried PCA, ICA and
K-Means clustering
Image: Roope Tervo 2018.
Original image: Nicoguaro. License: CC4-BY.
100km
Observations
fetched with 100 km
radius from train
station using
aggregation
Calculated 3h and 6h
precipitation
accumulation sums
RFRLR LSTM
Image: Venkata Jagannath. License: CC4-BY
Image: CC0
Image: BiObserver. License: CC4-BY
Random search used for finding optimal hyper parameters of LR and RFR
Three ML methods considered
Three selected months picked out for testing performance
• Rest of the dataset splitted randomly to train and validation dataset with ratio 70/30 %
02/201706/201602/2011
Image: Venkata Jagannath. License: CC4-BY
Image: CC0
Image: BiObserver. License: CC4-BY
Results
RFR
RMSE: 5.37
MAE: 3.21
BSS: 0.11
LSTM
RMSE: 4.35
MAE: 2.75
BSS: 0.01
LR
RMSE: 5.59
MAE: 3.11
BSS: 0.08
𝐵𝑆𝑆 = 1 −
𝑅𝑀𝑆𝐸
𝑅𝑀𝑆𝐸)*+
,
where 𝑅𝑀𝑆𝐸)*+ denotes root mean square error
calculated with a mean value over the whole dataset
LSTM shows no real skill
0
25
50
Delay(minutes)
Time
02/2011
Time
06/2016
Time
02/2017
Predicted vs. true delay, case Ahvenus
Predicted delay
True delay
If not otherwise stated, all images by author, licence CC4BY
RFR works relatively well
0
50
100
Delay(minutes)
Time
02/2011
Time
06/2016
Time
02/2017
Predicted vs. true delay, average over all stations
Predicted delay
True delay
RFR works well for most individual stations
0
50
100
Delay(minutes)
s
Time
02/2011
Time
06/2016
Time
02/2017
Predicted vs. true delay, case Kyrö
RFR don’t work for all cases
0
50
100
Delay(minutes)
s
Time
02/2011
Time
06/2016
Time
02/2017
Predicted vs. true delay, case Karjaa
Predicted delay
True delay
Wind direction, pressure and visibility are
the most important features
Predictions are
delivered to
end users via
web interface
If not otherwise stated, all images by author, licence CC4BY Image: Solita Oy
RFR gives the best average prediction
…although its performance is not
steady
Train delays can be
predicted based on
weather conditions
Questions
roope.tervo@fmi.fi
CC0. Image by: Simon Jowett

Mais conteúdo relacionado

Semelhante a Predicting weather inflicted train delays

Semelhante a Predicting weather inflicted train delays (7)

Simulative analysis of channel and qo s aware scheduler to enhance the capaci...
Simulative analysis of channel and qo s aware scheduler to enhance the capaci...Simulative analysis of channel and qo s aware scheduler to enhance the capaci...
Simulative analysis of channel and qo s aware scheduler to enhance the capaci...
 
Slope Final Review Meeting - WP1
Slope Final Review Meeting - WP1 Slope Final Review Meeting - WP1
Slope Final Review Meeting - WP1
 
Pa nalyticals high_score_suite_brochure
Pa nalyticals high_score_suite_brochurePa nalyticals high_score_suite_brochure
Pa nalyticals high_score_suite_brochure
 
CCXG Workshop, February 2021, Elsa Hatanaka
CCXG Workshop, February 2021, Elsa HatanakaCCXG Workshop, February 2021, Elsa Hatanaka
CCXG Workshop, February 2021, Elsa Hatanaka
 
Tw Bizcases
Tw BizcasesTw Bizcases
Tw Bizcases
 
Data characterization towards modeling frequent pattern mining algorithms
Data characterization towards modeling frequent pattern mining algorithmsData characterization towards modeling frequent pattern mining algorithms
Data characterization towards modeling frequent pattern mining algorithms
 
Enhanced exponential rule scheduling algorithm for real-time traffic in LTE n...
Enhanced exponential rule scheduling algorithm for real-time traffic in LTE n...Enhanced exponential rule scheduling algorithm for real-time traffic in LTE n...
Enhanced exponential rule scheduling algorithm for real-time traffic in LTE n...
 

Mais de Roope Tervo

Producing INSPIRE compliant datasets
Producing INSPIRE compliant datasetsProducing INSPIRE compliant datasets
Producing INSPIRE compliant datasets
Roope Tervo
 

Mais de Roope Tervo (20)

FMI Open Data Impact Survey 2019
FMI Open Data Impact Survey 2019FMI Open Data Impact Survey 2019
FMI Open Data Impact Survey 2019
 
FMI Information Management System
FMI Information Management SystemFMI Information Management System
FMI Information Management System
 
FMI Open Data on AWS Public dataset program
FMI Open Data on AWS Public dataset programFMI Open Data on AWS Public dataset program
FMI Open Data on AWS Public dataset program
 
Fmi Open Data on S3
Fmi Open Data on S3Fmi Open Data on S3
Fmi Open Data on S3
 
Why we need open data? FMI Open Data on AWS
Why we need open data? FMI Open Data on AWSWhy we need open data? FMI Open Data on AWS
Why we need open data? FMI Open Data on AWS
 
Forecasting Electricity Outages Caused by Convective Storms
Forecasting Electricity Outages Caused by Convective StormsForecasting Electricity Outages Caused by Convective Storms
Forecasting Electricity Outages Caused by Convective Storms
 
FMI Open Data on S3
FMI Open Data on S3FMI Open Data on S3
FMI Open Data on S3
 
SmartMet Server in INSPIRE
SmartMet Server in INSPIRESmartMet Server in INSPIRE
SmartMet Server in INSPIRE
 
Possibilities of Open Source Code
Possibilities of Open Source CodePossibilities of Open Source Code
Possibilities of Open Source Code
 
Inspire Compliant Weather Data
Inspire Compliant Weather DataInspire Compliant Weather Data
Inspire Compliant Weather Data
 
FMI Open Data Interface and Usage
FMI Open Data Interface and UsageFMI Open Data Interface and Usage
FMI Open Data Interface and Usage
 
SmartMet Server OSGeo
SmartMet Server OSGeoSmartMet Server OSGeo
SmartMet Server OSGeo
 
Meteorological and Aviation Weather Open Data implementation utilising OGC st...
Meteorological and Aviation Weather Open Data implementation utilising OGC st...Meteorological and Aviation Weather Open Data implementation utilising OGC st...
Meteorological and Aviation Weather Open Data implementation utilising OGC st...
 
WMTS Performance Tests
WMTS Performance TestsWMTS Performance Tests
WMTS Performance Tests
 
Producing INSPIRE Compliant Data Sets
Producing INSPIRE Compliant Data SetsProducing INSPIRE Compliant Data Sets
Producing INSPIRE Compliant Data Sets
 
Producing INSPIRE compliant datasets
Producing INSPIRE compliant datasetsProducing INSPIRE compliant datasets
Producing INSPIRE compliant datasets
 
Open Weather Data as Part of Big Data
Open Weather Data as Part of Big DataOpen Weather Data as Part of Big Data
Open Weather Data as Part of Big Data
 
FMI Open Data Interface and Data Models
FMI Open Data Interface and Data ModelsFMI Open Data Interface and Data Models
FMI Open Data Interface and Data Models
 
Open Data and and INSPIRE
Open Data and and INSPIREOpen Data and and INSPIRE
Open Data and and INSPIRE
 
AvoinData-workshop käyttöesimerkki
AvoinData-workshop käyttöesimerkkiAvoinData-workshop käyttöesimerkki
AvoinData-workshop käyttöesimerkki
 

Último

Principle of erosion control- Introduction to contouring,strip cropping,conto...
Principle of erosion control- Introduction to contouring,strip cropping,conto...Principle of erosion control- Introduction to contouring,strip cropping,conto...
Principle of erosion control- Introduction to contouring,strip cropping,conto...
ZAPPAC1
 
Disaster risk reduction management Module 4: Preparedness, Prevention and Mit...
Disaster risk reduction management Module 4: Preparedness, Prevention and Mit...Disaster risk reduction management Module 4: Preparedness, Prevention and Mit...
Disaster risk reduction management Module 4: Preparedness, Prevention and Mit...
BrixsonLajara
 

Último (20)

Russian Call girls in Dubai 0508644382 Dubai Call girls
Russian Call girls in Dubai 0508644382 Dubai Call girlsRussian Call girls in Dubai 0508644382 Dubai Call girls
Russian Call girls in Dubai 0508644382 Dubai Call girls
 
Principle of erosion control- Introduction to contouring,strip cropping,conto...
Principle of erosion control- Introduction to contouring,strip cropping,conto...Principle of erosion control- Introduction to contouring,strip cropping,conto...
Principle of erosion control- Introduction to contouring,strip cropping,conto...
 
Call Girls Brigade Road ( 8250092165 ) Cheap rates call girls | Get low budget
Call Girls Brigade Road ( 8250092165 ) Cheap rates call girls | Get low budgetCall Girls Brigade Road ( 8250092165 ) Cheap rates call girls | Get low budget
Call Girls Brigade Road ( 8250092165 ) Cheap rates call girls | Get low budget
 
Call Girls in Shadnagar / 8250092165 Genuine Call girls with real Photos and ...
Call Girls in Shadnagar / 8250092165 Genuine Call girls with real Photos and ...Call Girls in Shadnagar / 8250092165 Genuine Call girls with real Photos and ...
Call Girls in Shadnagar / 8250092165 Genuine Call girls with real Photos and ...
 
Vip Salem Call Girls 8250092165 Low Price Escorts Service in Your Area
Vip Salem Call Girls 8250092165 Low Price Escorts Service in Your AreaVip Salem Call Girls 8250092165 Low Price Escorts Service in Your Area
Vip Salem Call Girls 8250092165 Low Price Escorts Service in Your Area
 
Disaster risk reduction management Module 4: Preparedness, Prevention and Mit...
Disaster risk reduction management Module 4: Preparedness, Prevention and Mit...Disaster risk reduction management Module 4: Preparedness, Prevention and Mit...
Disaster risk reduction management Module 4: Preparedness, Prevention and Mit...
 
A Review on Integrated River Basin Management and Development Master Plan of ...
A Review on Integrated River Basin Management and Development Master Plan of ...A Review on Integrated River Basin Management and Development Master Plan of ...
A Review on Integrated River Basin Management and Development Master Plan of ...
 
Mira Road Comfortable Call Girls ,09167354423,Mira Road Model Call Girls .
Mira Road  Comfortable Call Girls ,09167354423,Mira Road Model Call Girls .Mira Road  Comfortable Call Girls ,09167354423,Mira Road Model Call Girls .
Mira Road Comfortable Call Girls ,09167354423,Mira Road Model Call Girls .
 
Russian Call girl Dubai 0503464457 Dubai Call girls
Russian Call girl Dubai 0503464457 Dubai Call girlsRussian Call girl Dubai 0503464457 Dubai Call girls
Russian Call girl Dubai 0503464457 Dubai Call girls
 
Environmental Topic : Soil Pollution by Afzalul Hoda.pptx
Environmental Topic : Soil Pollution by Afzalul Hoda.pptxEnvironmental Topic : Soil Pollution by Afzalul Hoda.pptx
Environmental Topic : Soil Pollution by Afzalul Hoda.pptx
 
Bhubaneswar Call Girl Service 📞9777949614📞Just Call Inaaya📲 Call Girls In Odi...
Bhubaneswar Call Girl Service 📞9777949614📞Just Call Inaaya📲 Call Girls In Odi...Bhubaneswar Call Girl Service 📞9777949614📞Just Call Inaaya📲 Call Girls In Odi...
Bhubaneswar Call Girl Service 📞9777949614📞Just Call Inaaya📲 Call Girls In Odi...
 
Call Girl in Faridabad ₹7.5k Pick Up & Drop With Cash Payment #8168257667
Call Girl in Faridabad ₹7.5k Pick Up & Drop With Cash Payment #8168257667Call Girl in Faridabad ₹7.5k Pick Up & Drop With Cash Payment #8168257667
Call Girl in Faridabad ₹7.5k Pick Up & Drop With Cash Payment #8168257667
 
Hook Up Call Girls Rajgir 9332606886 High Profile Call Girls You Can Get T...
Hook Up Call Girls Rajgir   9332606886  High Profile Call Girls You Can Get T...Hook Up Call Girls Rajgir   9332606886  High Profile Call Girls You Can Get T...
Hook Up Call Girls Rajgir 9332606886 High Profile Call Girls You Can Get T...
 
Jumping Scales and Producing peripheries.pptx
Jumping Scales and Producing peripheries.pptxJumping Scales and Producing peripheries.pptx
Jumping Scales and Producing peripheries.pptx
 
Call Girl Service in Wardha 9332606886 HOT & SEXY Models beautiful and charm...
Call Girl Service in Wardha  9332606886 HOT & SEXY Models beautiful and charm...Call Girl Service in Wardha  9332606886 HOT & SEXY Models beautiful and charm...
Call Girl Service in Wardha 9332606886 HOT & SEXY Models beautiful and charm...
 
Russian Escort Dubai 0503464457 Dubai Escorts
Russian Escort Dubai 0503464457 Dubai EscortsRussian Escort Dubai 0503464457 Dubai Escorts
Russian Escort Dubai 0503464457 Dubai Escorts
 
Green Marketing
Green MarketingGreen Marketing
Green Marketing
 
Deforestation
DeforestationDeforestation
Deforestation
 
2024-05-08 Composting at Home 101 for the Rotary Club of Pinecrest.pptx
2024-05-08 Composting at Home 101 for the Rotary Club of Pinecrest.pptx2024-05-08 Composting at Home 101 for the Rotary Club of Pinecrest.pptx
2024-05-08 Composting at Home 101 for the Rotary Club of Pinecrest.pptx
 
Call Girls in Gachibowli / 8250092165 Genuine Call girls with real Photos and...
Call Girls in Gachibowli / 8250092165 Genuine Call girls with real Photos and...Call Girls in Gachibowli / 8250092165 Genuine Call girls with real Photos and...
Call Girls in Gachibowli / 8250092165 Genuine Call girls with real Photos and...
 

Predicting weather inflicted train delays

  • 1. Predicting Weather Inflicted Train Delays Finnish Meteorological Institute Roope Tervo Laila Daniel Photo by Kalevi Lehtonen 1955. Not published until Commons in 2014. https://fi.wikipedia.org/wiki/Tiedosto:Finnish_class_Dm4_locomotive_number_1607_in_the_year_1955.jpg
  • 2. If not otherwise stated, all images by author, licence CC4BY Image: Solita Oy Operation center can take several actions: • Reduce train shifts • Communicate Project timeline: 01/2018-10/2018 Project partners: FMI, FTA, Trafi, VR Area: Finland Time range: 2 days ahead Time step: 1 hour We aim to predict disruption of rail traffic caused by weather
  • 3. If not otherwise stated, all images by author, licence CC4BY Label data + Feature data Method Results
  • 4. If not otherwise stated, all images by author, licence CC4BY MethodNWP Prediction
  • 5. • Data from 2010 – 2018 • 30 M rows | 5.5 GB data Data consist of train delays and corresponding weather observations Data Liikennevirasto (CC4) Delay between stations • Passenger trains • 514 stations Weather observations • 19 parameters
  • 6. Most trains run in time Mean delay over all stations 2010 2018 2014 0 50 100 Minutes
  • 7. Most trains run in time Mean delay over all stations 2010 2018 2014 0 50 100 Minutes But severe delays happen quite regurarly every year
  • 8. If not otherwise stated, all images by author, licence CC4BY Various pre-processing methods used Tried PCA, ICA and K-Means clustering Image: Roope Tervo 2018. Original image: Nicoguaro. License: CC4-BY. 100km Observations fetched with 100 km radius from train station using aggregation Calculated 3h and 6h precipitation accumulation sums
  • 9. RFRLR LSTM Image: Venkata Jagannath. License: CC4-BY Image: CC0 Image: BiObserver. License: CC4-BY Random search used for finding optimal hyper parameters of LR and RFR Three ML methods considered
  • 10. Three selected months picked out for testing performance • Rest of the dataset splitted randomly to train and validation dataset with ratio 70/30 % 02/201706/201602/2011
  • 11. Image: Venkata Jagannath. License: CC4-BY Image: CC0 Image: BiObserver. License: CC4-BY Results RFR RMSE: 5.37 MAE: 3.21 BSS: 0.11 LSTM RMSE: 4.35 MAE: 2.75 BSS: 0.01 LR RMSE: 5.59 MAE: 3.11 BSS: 0.08 𝐵𝑆𝑆 = 1 − 𝑅𝑀𝑆𝐸 𝑅𝑀𝑆𝐸)*+ , where 𝑅𝑀𝑆𝐸)*+ denotes root mean square error calculated with a mean value over the whole dataset
  • 12. LSTM shows no real skill 0 25 50 Delay(minutes) Time 02/2011 Time 06/2016 Time 02/2017 Predicted vs. true delay, case Ahvenus Predicted delay True delay
  • 13. If not otherwise stated, all images by author, licence CC4BY RFR works relatively well 0 50 100 Delay(minutes) Time 02/2011 Time 06/2016 Time 02/2017 Predicted vs. true delay, average over all stations Predicted delay True delay
  • 14. RFR works well for most individual stations 0 50 100 Delay(minutes) s Time 02/2011 Time 06/2016 Time 02/2017 Predicted vs. true delay, case Kyrö
  • 15. RFR don’t work for all cases 0 50 100 Delay(minutes) s Time 02/2011 Time 06/2016 Time 02/2017 Predicted vs. true delay, case Karjaa Predicted delay True delay
  • 16. Wind direction, pressure and visibility are the most important features
  • 17. Predictions are delivered to end users via web interface
  • 18. If not otherwise stated, all images by author, licence CC4BY Image: Solita Oy RFR gives the best average prediction …although its performance is not steady Train delays can be predicted based on weather conditions