SlideShare a Scribd company logo
1 of 12
Web Services-Based Mediator of Distributed Data Flow and Processing Project Coordinators: Software Architecture:  R. Husar Software Implementation:  K. Höijärvi Data and Applications:  S. Falke, R. Husar Center for Air Pollution Impact and Trend Analysis (CAPITA) Washington University, St. Louis, MO 63130
DataFed Description ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
DataFed Multidimensional Data Model 4 D Geo-Environmental  Data Cube (X, Y, Z, T) ,[object Object],[object Object],[object Object]
Data Flow & Processing in Air Quality Management AQ DATA EPA Networks IMPROVE Visibility  Satellite-PM Pattern  METEOROLOGY Met. Data  Satellite-Transport  Forecast model EMISSIONS National Emissions  Local Inventory  Satellite Fire Locs Status and Trends AQ Compliance Exposure Assess. Network Assess. Tracking Progress AQ  Management  Reports ‘ Knowledge’ Derived from Data Primary Data  Diverse Providers Data ‘Refining’ Processes  Filtering, Aggregation, Fusion
Mediator-Based Integration Architecture   (Wiederhold, 1992)   ,[object Object],[object Object],[object Object],[object Object],Wrapper Wrapper Service Service User Query Views Heterogeneous Data
Generic Data Flow and Processing in DataFed DataView 1 Data Processed Data Portrayed Data Process Data Portrayal/ Render Abstract Data Access View Wrapper Physical Data Abstract Data Physical Data Resides in autonomous servers; accessed by view-specific  wrappers  which   yield abstract data ‘slices’ Abstract Data Abstract data slices are requested by viewers; uniform data are delivered by  wrapper  services DataView 2 DataView 3 View Data Processed data are delivered to the user as multi-layer views by portrayal and overlay  web services Processed Data Data passed through filtering, aggregation, fusion and other  web  services
Anatomy of a Wrapper Service: TOMS Satellite Image Data ,[object Object],[object Object],src_img_width src_img_height src_margin_right src_margin_left src_margin_top src_margin_bottom src_lon_min src_lat_max src_lat_min src_lon_max Image Description for Data Access: src_image_width=502 src_image_height=329 src_margin_bottom=105 src_margin_left=69 src_margin_right=69 src_margin_top=46 src_lat_min=-70 src_lat_max=70 src_lon_min=-180 src_lon_max=180 The daily TOMS images reside on the FTP archive, e.g.  ftp://toms.gsfc.nasa.gov/pub/eptoms/images/aerosol/y2000/ea000820.gif URL template:  ftp://toms.gsfc.nasa.gov/pub/eptoms/images/aerosol/y[yyyy]/ea[yy][mm][dd].gif Transparent colors for overlays RGB(89,140,255) RGB(41,117,41) RGB(23,23,23) RGB(0,0,0)
An Application Program: Voyager Data Browser ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Data Sources Controls Displays I/O Layer Device Drivers Wrappers App State Data Flow Interpreter Core Web Services WSDL Ports
[object Object],SeaWiFS Satellite Aerosol Chemical Air Trajectory Map Boarder VIEW by Web Service Composition
Air Quality  Datasets ,[object Object],[object Object],[object Object],Near Real Time Data Integration Delayed Data Integration Surface Air Quality  AIRNOW O3, PM25  ASOS_STI Visibility, 300 sites METAR Visibility, 1200 sites VIEWS_OL 40+ Aerosol Parameters Satellite MODIS_AOT AOT, Idea Project GASP Reflectance, AOT TOMS Absorption Indx, Refl. SEAW_US Reflectance, AOT Model Output NAAPS Dust, Smoke, Sulfate, AOT WRF Sulfate Fire Data HMS_Fire Fire Pixels MODIS_Fire Fire Pixels Surface Meteorology RADAR NEXTRAD SURF_MET Temp, Dewp, Humidity… SURF_WIND Wind vectors ATAD Trajectory, VIEWS locs.
Some of the Tools of DataFed Consoles:  Data from diverse sources are displayed to create a rich context for exploration and analysis CATT:  Combined Aerosol Trajectory Tool for the browsing backtrajectories for specified chemical conditions  Viewer:  General purpose spatio-temporal data browser and view editor applicable for all DataFed datasets
Sulfate in the Northeast Sahara Dust in the Gulf Fires in the Southeast Time Series Console: Southeast Analyst Console Applications: Sulfate Episode: 8/27/04

More Related Content

More from Rudolf Husar

2013-04-30 EE DSS Approach and Demo
2013-04-30 EE DSS Approach and Demo2013-04-30 EE DSS Approach and Demo
2013-04-30 EE DSS Approach and DemoRudolf Husar
 
Exceptional Event Decision Support System Description
Exceptional Event Decision Support System DescriptionExceptional Event Decision Support System Description
Exceptional Event Decision Support System DescriptionRudolf Husar
 
130205 epa exc_event_seminar
130205 epa exc_event_seminar130205 epa exc_event_seminar
130205 epa exc_event_seminarRudolf Husar
 
130205 epa ee_presentation_subm
130205 epa ee_presentation_subm130205 epa ee_presentation_subm
130205 epa ee_presentation_submRudolf Husar
 
111018 geo sif_aq_interop
111018 geo sif_aq_interop111018 geo sif_aq_interop
111018 geo sif_aq_interopRudolf Husar
 
110823 solta11 intro
110823 solta11 intro110823 solta11 intro
110823 solta11 introRudolf Husar
 
110823 data fed_solta11
110823 data fed_solta11110823 data fed_solta11
110823 data fed_solta11Rudolf Husar
 
110510 aq co_p_network
110510 aq co_p_network110510 aq co_p_network
110510 aq co_p_networkRudolf Husar
 
110509 aq co_p_solta
110509 aq co_p_solta110509 aq co_p_solta
110509 aq co_p_soltaRudolf Husar
 
110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_views
110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_views110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_views
110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_viewsRudolf Husar
 
110410 aq user_req_methodology_sydney_subm
110410 aq user_req_methodology_sydney_subm110410 aq user_req_methodology_sydney_subm
110410 aq user_req_methodology_sydney_submRudolf Husar
 
110408 aq co_p_uic_sydney_husar
110408 aq co_p_uic_sydney_husar110408 aq co_p_uic_sydney_husar
110408 aq co_p_uic_sydney_husarRudolf Husar
 
110105 htap pilot_aqco_p_esip_dc
110105 htap pilot_aqco_p_esip_dc110105 htap pilot_aqco_p_esip_dc
110105 htap pilot_aqco_p_esip_dcRudolf Husar
 
100615 htap network_brussels
100615 htap network_brussels100615 htap network_brussels
100615 htap network_brusselsRudolf Husar
 
121117 eedss briefing_nasa_epa
121117 eedss briefing_nasa_epa121117 eedss briefing_nasa_epa
121117 eedss briefing_nasa_epaRudolf Husar
 
120910 nasa satellite_outline
120910 nasa satellite_outline120910 nasa satellite_outline
120910 nasa satellite_outlineRudolf Husar
 
120612 geia closure_ofeo_ms_soa_subm
120612 geia closure_ofeo_ms_soa_subm120612 geia closure_ofeo_ms_soa_subm
120612 geia closure_ofeo_ms_soa_submRudolf Husar
 
110414 extreme dustsmokesulfate
110414 extreme dustsmokesulfate110414 extreme dustsmokesulfate
110414 extreme dustsmokesulfateRudolf Husar
 
Aq Gci Infrastructure
Aq Gci InfrastructureAq Gci Infrastructure
Aq Gci InfrastructureRudolf Husar
 
AQ GCI Infrastructure
AQ GCI InfrastructureAQ GCI Infrastructure
AQ GCI InfrastructureRudolf Husar
 

More from Rudolf Husar (20)

2013-04-30 EE DSS Approach and Demo
2013-04-30 EE DSS Approach and Demo2013-04-30 EE DSS Approach and Demo
2013-04-30 EE DSS Approach and Demo
 
Exceptional Event Decision Support System Description
Exceptional Event Decision Support System DescriptionExceptional Event Decision Support System Description
Exceptional Event Decision Support System Description
 
130205 epa exc_event_seminar
130205 epa exc_event_seminar130205 epa exc_event_seminar
130205 epa exc_event_seminar
 
130205 epa ee_presentation_subm
130205 epa ee_presentation_subm130205 epa ee_presentation_subm
130205 epa ee_presentation_subm
 
111018 geo sif_aq_interop
111018 geo sif_aq_interop111018 geo sif_aq_interop
111018 geo sif_aq_interop
 
110823 solta11 intro
110823 solta11 intro110823 solta11 intro
110823 solta11 intro
 
110823 data fed_solta11
110823 data fed_solta11110823 data fed_solta11
110823 data fed_solta11
 
110510 aq co_p_network
110510 aq co_p_network110510 aq co_p_network
110510 aq co_p_network
 
110509 aq co_p_solta
110509 aq co_p_solta110509 aq co_p_solta
110509 aq co_p_solta
 
110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_views
110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_views110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_views
110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_views
 
110410 aq user_req_methodology_sydney_subm
110410 aq user_req_methodology_sydney_subm110410 aq user_req_methodology_sydney_subm
110410 aq user_req_methodology_sydney_subm
 
110408 aq co_p_uic_sydney_husar
110408 aq co_p_uic_sydney_husar110408 aq co_p_uic_sydney_husar
110408 aq co_p_uic_sydney_husar
 
110105 htap pilot_aqco_p_esip_dc
110105 htap pilot_aqco_p_esip_dc110105 htap pilot_aqco_p_esip_dc
110105 htap pilot_aqco_p_esip_dc
 
100615 htap network_brussels
100615 htap network_brussels100615 htap network_brussels
100615 htap network_brussels
 
121117 eedss briefing_nasa_epa
121117 eedss briefing_nasa_epa121117 eedss briefing_nasa_epa
121117 eedss briefing_nasa_epa
 
120910 nasa satellite_outline
120910 nasa satellite_outline120910 nasa satellite_outline
120910 nasa satellite_outline
 
120612 geia closure_ofeo_ms_soa_subm
120612 geia closure_ofeo_ms_soa_subm120612 geia closure_ofeo_ms_soa_subm
120612 geia closure_ofeo_ms_soa_subm
 
110414 extreme dustsmokesulfate
110414 extreme dustsmokesulfate110414 extreme dustsmokesulfate
110414 extreme dustsmokesulfate
 
Aq Gci Infrastructure
Aq Gci InfrastructureAq Gci Infrastructure
Aq Gci Infrastructure
 
AQ GCI Infrastructure
AQ GCI InfrastructureAQ GCI Infrastructure
AQ GCI Infrastructure
 

Recently uploaded

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...apidays
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...apidays
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MIND CTI
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Zilliz
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native ApplicationsWSO2
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024The Digital Insurer
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKSpring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKJago de Vreede
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Orbitshub
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistandanishmna97
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxRustici Software
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsNanddeep Nachan
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfOverkill Security
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusZilliz
 

Recently uploaded (20)

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKSpring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 

051207 Agu Sna Frncisco Data Fed Web Services Based Mediator Of Distributed Data Flow And Processing Files Data Fed 051207 Agu

  • 1. Web Services-Based Mediator of Distributed Data Flow and Processing Project Coordinators: Software Architecture: R. Husar Software Implementation: K. Höijärvi Data and Applications: S. Falke, R. Husar Center for Air Pollution Impact and Trend Analysis (CAPITA) Washington University, St. Louis, MO 63130
  • 2.
  • 3.
  • 4. Data Flow & Processing in Air Quality Management AQ DATA EPA Networks IMPROVE Visibility Satellite-PM Pattern METEOROLOGY Met. Data Satellite-Transport Forecast model EMISSIONS National Emissions Local Inventory Satellite Fire Locs Status and Trends AQ Compliance Exposure Assess. Network Assess. Tracking Progress AQ Management Reports ‘ Knowledge’ Derived from Data Primary Data Diverse Providers Data ‘Refining’ Processes Filtering, Aggregation, Fusion
  • 5.
  • 6. Generic Data Flow and Processing in DataFed DataView 1 Data Processed Data Portrayed Data Process Data Portrayal/ Render Abstract Data Access View Wrapper Physical Data Abstract Data Physical Data Resides in autonomous servers; accessed by view-specific wrappers which yield abstract data ‘slices’ Abstract Data Abstract data slices are requested by viewers; uniform data are delivered by wrapper services DataView 2 DataView 3 View Data Processed data are delivered to the user as multi-layer views by portrayal and overlay web services Processed Data Data passed through filtering, aggregation, fusion and other web services
  • 7.
  • 8.
  • 9.
  • 10.
  • 11. Some of the Tools of DataFed Consoles: Data from diverse sources are displayed to create a rich context for exploration and analysis CATT: Combined Aerosol Trajectory Tool for the browsing backtrajectories for specified chemical conditions Viewer: General purpose spatio-temporal data browser and view editor applicable for all DataFed datasets
  • 12. Sulfate in the Northeast Sahara Dust in the Gulf Fires in the Southeast Time Series Console: Southeast Analyst Console Applications: Sulfate Episode: 8/27/04