SlideShare uma empresa Scribd logo
1 de 23
Baixar para ler offline
Using Linked Data in a
Heterogeneous Sensor Web:
Challenges, Experiments and
Lessons Learned

Liang Yu and Yong Liu

{liangyu, yongliu}@ncsa.illinois.edu



       National Center for Supercomputing Applications
       University of Illinois at Urbana-Champaign
Outline

   Ø Motivation and Goal
   Ø Using Linked Data for Integration
   Ø Services for Consuming Linked Data
   Ø An Example: Visualization
   Ø Conclusion and Future Work




Imaginations unbound
Motivation

   •  Interoperability as a grand challenge in a Virtual
      Environmental Observatory
        •  The need to integrating different sensor data, citizen sensing,
           and other geospatial data etc.
            •  e.g., all river gage height values from all gages in Illinois
               between 1st May and 3rd May 2011.
   •  A heterogeneous Sensor Web is a reality
        •  Different protocols and formats, unknown semantics and no
           links.
   •  A paradigm shift: using Linked Data to build a Linked
      Sensor Web
        •  Linked data has the potential to provide a solution: URI naming
           system, HTTP protocol, RDF, links to other resources.
             •  E.g. an OGC SOS usually has no links to other resources
Imaginations unbound
Objective: Data Integration in a Virtual
   Environmental Observatory


                                WaterML




Imaginations unbound
Outline

   Ø Motivation and Goal
   Ø Using Linked Data for Integration
   Ø Services for Consuming Linked Data
   Ø An Example: Visualization
   Ø Conclusion and Future Work




Imaginations unbound
A Simplified View of Linked Data

   •  Obtain sensors and observation data from sensors in
      Illinois

                                           Sensors            Data
           States          Illinois
                                           in Illinois       Stream



http://                                          http://
sensorweb.ncsa.uiuc.edu/                         sensorweb.ncsa.uiuc.edu/api/
data/map/state/USGS/ Illinois                    sensordata/observations?
                                                 observedBy.within=http://
                                                 sensorweb.ncsa.uiuc.edu/data/
                                                 map/state/USGS/Illinois
             http://sensorweb.ncsa.uiuc.edu/api/
             sensordata/sites?within=http://
             sensorweb.ncsa.uiuc.edu/data/map/state/
             USGS/Illinois

Imaginations unbound
Key Challenges

   •  Publishing Linked Data
        •  Re-publishing existing plain data to semantically linked data.
        •  Linking potentially “linkable data” together and enabling complex
           queries in a heterogeneous Sensor Web.
   •  Consuming Linked Data
        •  Serving data in an OGC RESTful SOS-like service.
        •  Tracking the provenance of Linked Data to facilitate trust and
           validation.




Imaginations unbound
Workflow of Publishing and Consuming
   Linked Data


Raw Data                Linked Data       Linked Data




                                  Geometric
           Tools                   Analysis
                                                        LDA




                       Ontology


Imaginations unbound
Republishing Data to RDF (1)

   •  Use XML as an intermediate format
        •  All non-XML data (Shapefile, Excel) are transformed to XML.
   •  Use XSLT to convert intermediate XML to RDF/XML
        •  Three different annotations are implemented in XSLT
            •  semantic annotation (rdf:type)
            •  outgoing links (to DBPedia), and
            •  provenance.
        •  Both syntactic transformations and semantic annotations are
           performed




Imaginations unbound
Republishing Data to RDF (2)




           provenance



                        Outgoing
                          link




rdf:type




Imaginations unbound
Using Multiple Ontologies




Imaginations unbound
Creating Links by Geometric Analysis (1)
   •  To discover and create links between entities based on
      their spatial attributes.
        •  Different from previous work
            •  E.g.: http://www4.wiwiss.fu-berlin.de/bizer/silk/
   •  Tools: Geotools (Java).




Imaginations unbound
Creating Links by Geometric Analysis (2)




Imaginations unbound
Provenance in Linked Data

   •  Where did the data come from? How were they
      processed?
   •  Using Open Provenance Model (OPM)

                 Observation       opmo:wasDerivedFromStar




                  ssn:observedBy        opmo:WasGeneratedBy


                       Sensor      opmo:wasDerivedFromStar




  <ssn:observedBy rdf:resource="http://sensorweb.ncsa.uiuc.edu/data/sensordata/sites/CUAHSI/
  NWIS/03339000"/>
  <opmo:wasDerivedFromStar rdf:resource="http://waterservices.usgs.gov/nwis/iv"/>




Imaginations unbound
Outline

   Ø Motivation and Goal
   Ø Using Linked Data for Integration
   Ø Services for Consuming Linked Data
   Ø An Example: Visualization
   Ø Conclusion and Future Work




Imaginations unbound
Developing SOS with Linked Data API (1)

   •  An OGC RESTful SOS-like service over the integrated
      linked data
        •  Can be accessed by simple URLs.
        •  Is as flexible as SPARQL but with simpler syntax.
  q  Feature of Interest (
      http://sensorweb.ncsa.uiuc.edu/data/map/watershed/USGS/2009_0)
  q  Single sensor site
      (
      http://sensorweb.ncsa.uiuc.edu/data/sensordata/sites/CUAHSI/EPA/
      MWRDSTOR:WW_39)
  q  Collection of sensor sites
      (http://sensorweb.ncsa.uiuc.edu/api/sensordata/sites)
  q  Single observation (
      http://sensorweb.ncsa.uiuc.edu/data/event/hail/noaa/
      2010/10908_2010-12-31T22:40:00)
  q  Collection of observations (
      http://sensorweb.ncsa.uiuc.edu/api/sensordata/observations)
Imaginations unbound
Developing SOS with Linked Data API (2)
    •    Obtain all the sensor sites within Illinois state.
          •    http://sensorweb.ncsa.uiuc.edu/api/sensordata/sites?within=http://sensorweb.ncsa.uiuc.edu/data/
               map/state/USGS/Illinois



       items": [
       {"_about": "
       http://sensorweb.ncsa.uiuc.edu/data/sensordata/sites/CUAHSI/EPA/MWRDSTOR:WW_39",
       "hasCode": "MWRDSTOR:WW 39",
       "hasLocation": {
                    "lat": 41.88185119628906,
                    "long": -87.63558197021484,
                    "type": "http://www.w3.org/2003/01/geo/wgs84_pos#Point"},
                    "hasName": "South Branch Chicago River @ Madison St.",
                    "hasNetwork": "
                    http://sensorweb.ncsa.uiuc.edu/data/sensordata/network/CUAHSI/EPA",
                    "hasStream": "
                    http://sensorweb.ncsa.uiuc.edu/api/sensordata/observations?observedBy=http://
                    sensorweb.ncsa.uiuc.edu/data/sensordata/sites/CUAHSI/EPA/
                    MWRDSTOR:WW_39",
                    "type": "Sensor",
                    "wasDerivedFromStar": "http://water.sdsc.edu/waterOneFlow/",
                    "within": ["
                    http://sensorweb.ncsa.uiuc.edu/data/map/county/USGS/Cook_County,_IL","
                    http://sensorweb.ncsa.uiuc.edu/data/map/state/USGS/Illinois","
                    http://sensorweb.ncsa.uiuc.edu/data/map/watershed/USGS/2009_2627"]},
Imaginations unbound
Outline

   Ø Motivation and Goal
   Ø Using Linked Data for Integration
   Ø Services for Consuming Linked Data
   Ø An Example: Visualization
   Ø Conclusion and Future Work




Imaginations unbound
An Example Application (Visualization of
   SOS Results)
   •    Visualization Platform: WWT (World Wide Telescope)|Earth
   •    Sensor Data: river gage height values produced by gages in Illinois between
        2011-05-01 and 2011-05-03.
         q    http://sensorweb.ncsa.uiuc.edu/api/sensordata/observations?observedBy.within=http://
               sensorweb.ncsa.uiuc.edu/data/map/state/USGS/Illinois&_sort=observationResultTime.inXSDDateTime&min-
               observationResultTime.inXSDDateTime=2011-05-01T00:00:00-05:00&_page=0&max-
               observationResultTime.inXSDDateTime=2011-05-03T00:00:00-05:00&observedProperty=http://
               sensorweb.ncsa.uiuc.edu/data/property/USGS/NWIS:UnitValues/00065




Imaginations unbound
Outline

   Ø Motivation and Goal
   Ø Using Linked Data for Integration
   Ø Services for Consuming Linked Data
   Ø An Example: Visualization
   Ø Conclusion and Future Work




Imaginations unbound
Conclusion

   •  A “Linked Sensor Web” solution for integrating
      heterogeneous sensor data sources and geospatial data.
        •  A best practice of using W3C SSN ontology as well as other
           domain ontologies.
        •  A method to discover and create links among spatial data.
        •  Using Linked Data API to provide OGC RESTful SOS-like
           services
            •  http://sensorweb.ncsa.uiuc.edu/api-list.html
        •  Tracking provenance data and managing them using OPM.




Imaginations unbound
Future Work


   •    Towards Linked Geostreaming Data
   •    Tuning the performance
   •    Facilitating searching and crawling of Linked data
   •    End-to-end provenance management




Imaginations unbound
Acknowledgements

   Ø Microsoft Research Connections
        Ø  “Environmental Informatics” Program
   Ø  Institute for Advanced Computing Applications and
       Technologies at the University of Illinois at Urbana-
       Champaign
        Ø  “Virtual Observatory for Sustainability of Intensively Managed
            Environmental Systems” Project




Imaginations unbound

Mais conteúdo relacionado

Semelhante a Using linked data in a heterogeneous sensor web: Challenges, experiments and lessons learned

Professor Dame Wendy Hall - Saving the Web
Professor Dame Wendy Hall - Saving the WebProfessor Dame Wendy Hall - Saving the Web
Professor Dame Wendy Hall - Saving the WebRamine Tinati
 
Escaping Flatland: Interactive High-Dimensional Data Analysis in Drug Discove...
Escaping Flatland: Interactive High-Dimensional Data Analysis in Drug Discove...Escaping Flatland: Interactive High-Dimensional Data Analysis in Drug Discove...
Escaping Flatland: Interactive High-Dimensional Data Analysis in Drug Discove...Spark Summit
 
Smarter Data for Smarter Libraries
Smarter Data for Smarter LibrariesSmarter Data for Smarter Libraries
Smarter Data for Smarter LibrariesOCLC
 
In search of lost knowledge: joining the dots with Linked Data
In search of lost knowledge: joining the dots with Linked DataIn search of lost knowledge: joining the dots with Linked Data
In search of lost knowledge: joining the dots with Linked Datajonblower
 
Social Semantic (Sensor) Web
Social Semantic (Sensor) WebSocial Semantic (Sensor) Web
Social Semantic (Sensor) WebDavid Crowley
 
#2 NCI data services - Fair data webinar 6 Sept 2017
#2 NCI data services - Fair data webinar 6 Sept 2017#2 NCI data services - Fair data webinar 6 Sept 2017
#2 NCI data services - Fair data webinar 6 Sept 2017ARDC
 
Talk at OHSU, September 25, 2013
Talk at OHSU, September 25, 2013Talk at OHSU, September 25, 2013
Talk at OHSU, September 25, 2013Anita de Waard
 
Meeting Federal Research Requirements
Meeting Federal Research RequirementsMeeting Federal Research Requirements
Meeting Federal Research RequirementsICPSR
 
Accelerating Data-driven Discovery in Energy Science
Accelerating Data-driven Discovery in Energy ScienceAccelerating Data-driven Discovery in Energy Science
Accelerating Data-driven Discovery in Energy ScienceIan Foster
 
Globus for Data Management: 2014 Joint Facility User Forum
Globus for Data Management: 2014 Joint Facility User ForumGlobus for Data Management: 2014 Joint Facility User Forum
Globus for Data Management: 2014 Joint Facility User ForumGlobus
 
Linked data and Semantic Web Applications for Libraries
Linked data and Semantic Web Applications for LibrariesLinked data and Semantic Web Applications for Libraries
Linked data and Semantic Web Applications for LibrariesVikas Bhushan
 
EarthCube Monthly Community Webinar- Nov. 22, 2013
EarthCube Monthly Community Webinar- Nov. 22, 2013EarthCube Monthly Community Webinar- Nov. 22, 2013
EarthCube Monthly Community Webinar- Nov. 22, 2013EarthCube
 
FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...
FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...
FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...Carole Goble
 
WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...
WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...
WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...Micah Altman
 
Tackling variety in event based systems
Tackling variety in event based systemsTackling variety in event based systems
Tackling variety in event based systemsSouleiman Hasan
 
GENI Engineering Conference -- Ian Foster
GENI Engineering Conference -- Ian FosterGENI Engineering Conference -- Ian Foster
GENI Engineering Conference -- Ian FosterIan Foster
 
2013 04-29 american art collaborative lod meeting - washington dc - web
2013 04-29 american art collaborative lod meeting - washington dc - web2013 04-29 american art collaborative lod meeting - washington dc - web
2013 04-29 american art collaborative lod meeting - washington dc - weblecmaj
 

Semelhante a Using linked data in a heterogeneous sensor web: Challenges, experiments and lessons learned (20)

Professor Dame Wendy Hall - Saving the Web
Professor Dame Wendy Hall - Saving the WebProfessor Dame Wendy Hall - Saving the Web
Professor Dame Wendy Hall - Saving the Web
 
Escaping Flatland: Interactive High-Dimensional Data Analysis in Drug Discove...
Escaping Flatland: Interactive High-Dimensional Data Analysis in Drug Discove...Escaping Flatland: Interactive High-Dimensional Data Analysis in Drug Discove...
Escaping Flatland: Interactive High-Dimensional Data Analysis in Drug Discove...
 
Smarter Data for Smarter Libraries
Smarter Data for Smarter LibrariesSmarter Data for Smarter Libraries
Smarter Data for Smarter Libraries
 
In search of lost knowledge: joining the dots with Linked Data
In search of lost knowledge: joining the dots with Linked DataIn search of lost knowledge: joining the dots with Linked Data
In search of lost knowledge: joining the dots with Linked Data
 
Social Semantic (Sensor) Web
Social Semantic (Sensor) WebSocial Semantic (Sensor) Web
Social Semantic (Sensor) Web
 
Lapis Guides
Lapis GuidesLapis Guides
Lapis Guides
 
#2 NCI data services - Fair data webinar 6 Sept 2017
#2 NCI data services - Fair data webinar 6 Sept 2017#2 NCI data services - Fair data webinar 6 Sept 2017
#2 NCI data services - Fair data webinar 6 Sept 2017
 
Enabling Citizen-empowered Apps over Linked Data
Enabling Citizen-empowered Apps over Linked DataEnabling Citizen-empowered Apps over Linked Data
Enabling Citizen-empowered Apps over Linked Data
 
Talk at OHSU, September 25, 2013
Talk at OHSU, September 25, 2013Talk at OHSU, September 25, 2013
Talk at OHSU, September 25, 2013
 
Meeting Federal Research Requirements
Meeting Federal Research RequirementsMeeting Federal Research Requirements
Meeting Federal Research Requirements
 
Accelerating Data-driven Discovery in Energy Science
Accelerating Data-driven Discovery in Energy ScienceAccelerating Data-driven Discovery in Energy Science
Accelerating Data-driven Discovery in Energy Science
 
"In the Early Days of a Better Nation": Enhancing the power of metadata today...
"In the Early Days of a Better Nation": Enhancing the power of metadata today..."In the Early Days of a Better Nation": Enhancing the power of metadata today...
"In the Early Days of a Better Nation": Enhancing the power of metadata today...
 
Globus for Data Management: 2014 Joint Facility User Forum
Globus for Data Management: 2014 Joint Facility User ForumGlobus for Data Management: 2014 Joint Facility User Forum
Globus for Data Management: 2014 Joint Facility User Forum
 
Linked data and Semantic Web Applications for Libraries
Linked data and Semantic Web Applications for LibrariesLinked data and Semantic Web Applications for Libraries
Linked data and Semantic Web Applications for Libraries
 
EarthCube Monthly Community Webinar- Nov. 22, 2013
EarthCube Monthly Community Webinar- Nov. 22, 2013EarthCube Monthly Community Webinar- Nov. 22, 2013
EarthCube Monthly Community Webinar- Nov. 22, 2013
 
FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...
FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...
FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...
 
WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...
WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...
WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...
 
Tackling variety in event based systems
Tackling variety in event based systemsTackling variety in event based systems
Tackling variety in event based systems
 
GENI Engineering Conference -- Ian Foster
GENI Engineering Conference -- Ian FosterGENI Engineering Conference -- Ian Foster
GENI Engineering Conference -- Ian Foster
 
2013 04-29 american art collaborative lod meeting - washington dc - web
2013 04-29 american art collaborative lod meeting - washington dc - web2013 04-29 american art collaborative lod meeting - washington dc - web
2013 04-29 american art collaborative lod meeting - washington dc - web
 

Mais de Cybera Inc.

Cyber Summit 2016: Technology, Education, and Democracy
Cyber Summit 2016: Technology, Education, and DemocracyCyber Summit 2016: Technology, Education, and Democracy
Cyber Summit 2016: Technology, Education, and DemocracyCybera Inc.
 
Cyber Summit 2016: Understanding Users' (In)Secure Behaviour
Cyber Summit 2016: Understanding Users' (In)Secure BehaviourCyber Summit 2016: Understanding Users' (In)Secure Behaviour
Cyber Summit 2016: Understanding Users' (In)Secure BehaviourCybera Inc.
 
Cyber Summit 2016: Insider Threat Indicators: Human Behaviour
Cyber Summit 2016: Insider Threat Indicators: Human BehaviourCyber Summit 2016: Insider Threat Indicators: Human Behaviour
Cyber Summit 2016: Insider Threat Indicators: Human BehaviourCybera Inc.
 
Cyber Summit 2016: Research Data and the Canadian Innovation Challenge
Cyber Summit 2016: Research Data and the Canadian Innovation ChallengeCyber Summit 2016: Research Data and the Canadian Innovation Challenge
Cyber Summit 2016: Research Data and the Canadian Innovation ChallengeCybera Inc.
 
Cyber Summit 2016: Knowing More and Understanding Less in the Age of Big Data
Cyber Summit 2016: Knowing More and Understanding Less in the Age of Big DataCyber Summit 2016: Knowing More and Understanding Less in the Age of Big Data
Cyber Summit 2016: Knowing More and Understanding Less in the Age of Big DataCybera Inc.
 
Cyber Summit 2016: Privacy Issues in Big Data Sharing and Reuse
Cyber Summit 2016: Privacy Issues in Big Data Sharing and ReuseCyber Summit 2016: Privacy Issues in Big Data Sharing and Reuse
Cyber Summit 2016: Privacy Issues in Big Data Sharing and ReuseCybera Inc.
 
Cyber Summit 2016: Establishing an Ethics Framework for Predictive Analytics ...
Cyber Summit 2016: Establishing an Ethics Framework for Predictive Analytics ...Cyber Summit 2016: Establishing an Ethics Framework for Predictive Analytics ...
Cyber Summit 2016: Establishing an Ethics Framework for Predictive Analytics ...Cybera Inc.
 
Cyber Summit 2016: The Data Tsunami vs The Network: How More Data Changes Eve...
Cyber Summit 2016: The Data Tsunami vs The Network: How More Data Changes Eve...Cyber Summit 2016: The Data Tsunami vs The Network: How More Data Changes Eve...
Cyber Summit 2016: The Data Tsunami vs The Network: How More Data Changes Eve...Cybera Inc.
 
Cyber Summit 2016: Issues and Challenges Facing Municipalities In Securing Data
Cyber Summit 2016: Issues and Challenges Facing Municipalities In Securing DataCyber Summit 2016: Issues and Challenges Facing Municipalities In Securing Data
Cyber Summit 2016: Issues and Challenges Facing Municipalities In Securing DataCybera Inc.
 
Cyber Summit 2016: Using Law Responsibly: What Happens When Law Meets Technol...
Cyber Summit 2016: Using Law Responsibly: What Happens When Law Meets Technol...Cyber Summit 2016: Using Law Responsibly: What Happens When Law Meets Technol...
Cyber Summit 2016: Using Law Responsibly: What Happens When Law Meets Technol...Cybera Inc.
 
Privacy, Security & Access to Data
Privacy, Security & Access to DataPrivacy, Security & Access to Data
Privacy, Security & Access to DataCybera Inc.
 
Do Universities Dream of Big Data
Do Universities Dream of Big DataDo Universities Dream of Big Data
Do Universities Dream of Big DataCybera Inc.
 
Predicting the Future With Microsoft Bing
Predicting the Future With Microsoft BingPredicting the Future With Microsoft Bing
Predicting the Future With Microsoft BingCybera Inc.
 
Analytics 101: How to not fail at analytics
Analytics 101: How to not fail at analyticsAnalytics 101: How to not fail at analytics
Analytics 101: How to not fail at analyticsCybera Inc.
 
Are MOOC's past their peak?
Are MOOC's past their peak?Are MOOC's past their peak?
Are MOOC's past their peak?Cybera Inc.
 
Opening the doors of the laboratory
Opening the doors of the laboratoryOpening the doors of the laboratory
Opening the doors of the laboratoryCybera Inc.
 
Open City - Edmonton
Open City - EdmontonOpen City - Edmonton
Open City - EdmontonCybera Inc.
 
Unlocking the power of healthcare data
Unlocking the power of healthcare dataUnlocking the power of healthcare data
Unlocking the power of healthcare dataCybera Inc.
 
Checking in on Healthcare Data Analytics
Checking in on Healthcare Data AnalyticsChecking in on Healthcare Data Analytics
Checking in on Healthcare Data AnalyticsCybera Inc.
 
Open access and open data: international trends and strategic context
Open access and open data: international trends and strategic contextOpen access and open data: international trends and strategic context
Open access and open data: international trends and strategic contextCybera Inc.
 

Mais de Cybera Inc. (20)

Cyber Summit 2016: Technology, Education, and Democracy
Cyber Summit 2016: Technology, Education, and DemocracyCyber Summit 2016: Technology, Education, and Democracy
Cyber Summit 2016: Technology, Education, and Democracy
 
Cyber Summit 2016: Understanding Users' (In)Secure Behaviour
Cyber Summit 2016: Understanding Users' (In)Secure BehaviourCyber Summit 2016: Understanding Users' (In)Secure Behaviour
Cyber Summit 2016: Understanding Users' (In)Secure Behaviour
 
Cyber Summit 2016: Insider Threat Indicators: Human Behaviour
Cyber Summit 2016: Insider Threat Indicators: Human BehaviourCyber Summit 2016: Insider Threat Indicators: Human Behaviour
Cyber Summit 2016: Insider Threat Indicators: Human Behaviour
 
Cyber Summit 2016: Research Data and the Canadian Innovation Challenge
Cyber Summit 2016: Research Data and the Canadian Innovation ChallengeCyber Summit 2016: Research Data and the Canadian Innovation Challenge
Cyber Summit 2016: Research Data and the Canadian Innovation Challenge
 
Cyber Summit 2016: Knowing More and Understanding Less in the Age of Big Data
Cyber Summit 2016: Knowing More and Understanding Less in the Age of Big DataCyber Summit 2016: Knowing More and Understanding Less in the Age of Big Data
Cyber Summit 2016: Knowing More and Understanding Less in the Age of Big Data
 
Cyber Summit 2016: Privacy Issues in Big Data Sharing and Reuse
Cyber Summit 2016: Privacy Issues in Big Data Sharing and ReuseCyber Summit 2016: Privacy Issues in Big Data Sharing and Reuse
Cyber Summit 2016: Privacy Issues in Big Data Sharing and Reuse
 
Cyber Summit 2016: Establishing an Ethics Framework for Predictive Analytics ...
Cyber Summit 2016: Establishing an Ethics Framework for Predictive Analytics ...Cyber Summit 2016: Establishing an Ethics Framework for Predictive Analytics ...
Cyber Summit 2016: Establishing an Ethics Framework for Predictive Analytics ...
 
Cyber Summit 2016: The Data Tsunami vs The Network: How More Data Changes Eve...
Cyber Summit 2016: The Data Tsunami vs The Network: How More Data Changes Eve...Cyber Summit 2016: The Data Tsunami vs The Network: How More Data Changes Eve...
Cyber Summit 2016: The Data Tsunami vs The Network: How More Data Changes Eve...
 
Cyber Summit 2016: Issues and Challenges Facing Municipalities In Securing Data
Cyber Summit 2016: Issues and Challenges Facing Municipalities In Securing DataCyber Summit 2016: Issues and Challenges Facing Municipalities In Securing Data
Cyber Summit 2016: Issues and Challenges Facing Municipalities In Securing Data
 
Cyber Summit 2016: Using Law Responsibly: What Happens When Law Meets Technol...
Cyber Summit 2016: Using Law Responsibly: What Happens When Law Meets Technol...Cyber Summit 2016: Using Law Responsibly: What Happens When Law Meets Technol...
Cyber Summit 2016: Using Law Responsibly: What Happens When Law Meets Technol...
 
Privacy, Security & Access to Data
Privacy, Security & Access to DataPrivacy, Security & Access to Data
Privacy, Security & Access to Data
 
Do Universities Dream of Big Data
Do Universities Dream of Big DataDo Universities Dream of Big Data
Do Universities Dream of Big Data
 
Predicting the Future With Microsoft Bing
Predicting the Future With Microsoft BingPredicting the Future With Microsoft Bing
Predicting the Future With Microsoft Bing
 
Analytics 101: How to not fail at analytics
Analytics 101: How to not fail at analyticsAnalytics 101: How to not fail at analytics
Analytics 101: How to not fail at analytics
 
Are MOOC's past their peak?
Are MOOC's past their peak?Are MOOC's past their peak?
Are MOOC's past their peak?
 
Opening the doors of the laboratory
Opening the doors of the laboratoryOpening the doors of the laboratory
Opening the doors of the laboratory
 
Open City - Edmonton
Open City - EdmontonOpen City - Edmonton
Open City - Edmonton
 
Unlocking the power of healthcare data
Unlocking the power of healthcare dataUnlocking the power of healthcare data
Unlocking the power of healthcare data
 
Checking in on Healthcare Data Analytics
Checking in on Healthcare Data AnalyticsChecking in on Healthcare Data Analytics
Checking in on Healthcare Data Analytics
 
Open access and open data: international trends and strategic context
Open access and open data: international trends and strategic contextOpen access and open data: international trends and strategic context
Open access and open data: international trends and strategic context
 

Último

Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfsanyamsingh5019
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Disha Kariya
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxiammrhaywood
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAssociation for Project Management
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...fonyou31
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13Steve Thomason
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfciinovamais
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Celine George
 
9548086042 for call girls in Indira Nagar with room service
9548086042  for call girls in Indira Nagar  with room service9548086042  for call girls in Indira Nagar  with room service
9548086042 for call girls in Indira Nagar with room servicediscovermytutordmt
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Krashi Coaching
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeThiyagu K
 
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptxVS Mahajan Coaching Centre
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdfQucHHunhnh
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionSafetyChain Software
 
Disha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfDisha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfchloefrazer622
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Sapana Sha
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdfQucHHunhnh
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxSayali Powar
 

Último (20)

Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdf
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across Sectors
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
9548086042 for call girls in Indira Nagar with room service
9548086042  for call girls in Indira Nagar  with room service9548086042  for call girls in Indira Nagar  with room service
9548086042 for call girls in Indira Nagar with room service
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory Inspection
 
Disha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfDisha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdf
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
 

Using linked data in a heterogeneous sensor web: Challenges, experiments and lessons learned

  • 1. Using Linked Data in a Heterogeneous Sensor Web: Challenges, Experiments and Lessons Learned Liang Yu and Yong Liu {liangyu, yongliu}@ncsa.illinois.edu National Center for Supercomputing Applications University of Illinois at Urbana-Champaign
  • 2. Outline Ø Motivation and Goal Ø Using Linked Data for Integration Ø Services for Consuming Linked Data Ø An Example: Visualization Ø Conclusion and Future Work Imaginations unbound
  • 3. Motivation •  Interoperability as a grand challenge in a Virtual Environmental Observatory •  The need to integrating different sensor data, citizen sensing, and other geospatial data etc. •  e.g., all river gage height values from all gages in Illinois between 1st May and 3rd May 2011. •  A heterogeneous Sensor Web is a reality •  Different protocols and formats, unknown semantics and no links. •  A paradigm shift: using Linked Data to build a Linked Sensor Web •  Linked data has the potential to provide a solution: URI naming system, HTTP protocol, RDF, links to other resources. •  E.g. an OGC SOS usually has no links to other resources Imaginations unbound
  • 4. Objective: Data Integration in a Virtual Environmental Observatory WaterML Imaginations unbound
  • 5. Outline Ø Motivation and Goal Ø Using Linked Data for Integration Ø Services for Consuming Linked Data Ø An Example: Visualization Ø Conclusion and Future Work Imaginations unbound
  • 6. A Simplified View of Linked Data •  Obtain sensors and observation data from sensors in Illinois Sensors Data States Illinois in Illinois Stream http:// http:// sensorweb.ncsa.uiuc.edu/ sensorweb.ncsa.uiuc.edu/api/ data/map/state/USGS/ Illinois sensordata/observations? observedBy.within=http:// sensorweb.ncsa.uiuc.edu/data/ map/state/USGS/Illinois http://sensorweb.ncsa.uiuc.edu/api/ sensordata/sites?within=http:// sensorweb.ncsa.uiuc.edu/data/map/state/ USGS/Illinois Imaginations unbound
  • 7. Key Challenges •  Publishing Linked Data •  Re-publishing existing plain data to semantically linked data. •  Linking potentially “linkable data” together and enabling complex queries in a heterogeneous Sensor Web. •  Consuming Linked Data •  Serving data in an OGC RESTful SOS-like service. •  Tracking the provenance of Linked Data to facilitate trust and validation. Imaginations unbound
  • 8. Workflow of Publishing and Consuming Linked Data Raw Data Linked Data Linked Data Geometric Tools Analysis LDA Ontology Imaginations unbound
  • 9. Republishing Data to RDF (1) •  Use XML as an intermediate format •  All non-XML data (Shapefile, Excel) are transformed to XML. •  Use XSLT to convert intermediate XML to RDF/XML •  Three different annotations are implemented in XSLT •  semantic annotation (rdf:type) •  outgoing links (to DBPedia), and •  provenance. •  Both syntactic transformations and semantic annotations are performed Imaginations unbound
  • 10. Republishing Data to RDF (2) provenance Outgoing link rdf:type Imaginations unbound
  • 12. Creating Links by Geometric Analysis (1) •  To discover and create links between entities based on their spatial attributes. •  Different from previous work •  E.g.: http://www4.wiwiss.fu-berlin.de/bizer/silk/ •  Tools: Geotools (Java). Imaginations unbound
  • 13. Creating Links by Geometric Analysis (2) Imaginations unbound
  • 14. Provenance in Linked Data •  Where did the data come from? How were they processed? •  Using Open Provenance Model (OPM) Observation opmo:wasDerivedFromStar ssn:observedBy opmo:WasGeneratedBy Sensor opmo:wasDerivedFromStar <ssn:observedBy rdf:resource="http://sensorweb.ncsa.uiuc.edu/data/sensordata/sites/CUAHSI/ NWIS/03339000"/> <opmo:wasDerivedFromStar rdf:resource="http://waterservices.usgs.gov/nwis/iv"/> Imaginations unbound
  • 15. Outline Ø Motivation and Goal Ø Using Linked Data for Integration Ø Services for Consuming Linked Data Ø An Example: Visualization Ø Conclusion and Future Work Imaginations unbound
  • 16. Developing SOS with Linked Data API (1) •  An OGC RESTful SOS-like service over the integrated linked data •  Can be accessed by simple URLs. •  Is as flexible as SPARQL but with simpler syntax. q  Feature of Interest ( http://sensorweb.ncsa.uiuc.edu/data/map/watershed/USGS/2009_0) q  Single sensor site ( http://sensorweb.ncsa.uiuc.edu/data/sensordata/sites/CUAHSI/EPA/ MWRDSTOR:WW_39) q  Collection of sensor sites (http://sensorweb.ncsa.uiuc.edu/api/sensordata/sites) q  Single observation ( http://sensorweb.ncsa.uiuc.edu/data/event/hail/noaa/ 2010/10908_2010-12-31T22:40:00) q  Collection of observations ( http://sensorweb.ncsa.uiuc.edu/api/sensordata/observations) Imaginations unbound
  • 17. Developing SOS with Linked Data API (2) •  Obtain all the sensor sites within Illinois state. •  http://sensorweb.ncsa.uiuc.edu/api/sensordata/sites?within=http://sensorweb.ncsa.uiuc.edu/data/ map/state/USGS/Illinois items": [ {"_about": " http://sensorweb.ncsa.uiuc.edu/data/sensordata/sites/CUAHSI/EPA/MWRDSTOR:WW_39", "hasCode": "MWRDSTOR:WW 39", "hasLocation": { "lat": 41.88185119628906, "long": -87.63558197021484, "type": "http://www.w3.org/2003/01/geo/wgs84_pos#Point"}, "hasName": "South Branch Chicago River @ Madison St.", "hasNetwork": " http://sensorweb.ncsa.uiuc.edu/data/sensordata/network/CUAHSI/EPA", "hasStream": " http://sensorweb.ncsa.uiuc.edu/api/sensordata/observations?observedBy=http:// sensorweb.ncsa.uiuc.edu/data/sensordata/sites/CUAHSI/EPA/ MWRDSTOR:WW_39", "type": "Sensor", "wasDerivedFromStar": "http://water.sdsc.edu/waterOneFlow/", "within": [" http://sensorweb.ncsa.uiuc.edu/data/map/county/USGS/Cook_County,_IL"," http://sensorweb.ncsa.uiuc.edu/data/map/state/USGS/Illinois"," http://sensorweb.ncsa.uiuc.edu/data/map/watershed/USGS/2009_2627"]}, Imaginations unbound
  • 18. Outline Ø Motivation and Goal Ø Using Linked Data for Integration Ø Services for Consuming Linked Data Ø An Example: Visualization Ø Conclusion and Future Work Imaginations unbound
  • 19. An Example Application (Visualization of SOS Results) •  Visualization Platform: WWT (World Wide Telescope)|Earth •  Sensor Data: river gage height values produced by gages in Illinois between 2011-05-01 and 2011-05-03. q  http://sensorweb.ncsa.uiuc.edu/api/sensordata/observations?observedBy.within=http:// sensorweb.ncsa.uiuc.edu/data/map/state/USGS/Illinois&_sort=observationResultTime.inXSDDateTime&min- observationResultTime.inXSDDateTime=2011-05-01T00:00:00-05:00&_page=0&max- observationResultTime.inXSDDateTime=2011-05-03T00:00:00-05:00&observedProperty=http:// sensorweb.ncsa.uiuc.edu/data/property/USGS/NWIS:UnitValues/00065 Imaginations unbound
  • 20. Outline Ø Motivation and Goal Ø Using Linked Data for Integration Ø Services for Consuming Linked Data Ø An Example: Visualization Ø Conclusion and Future Work Imaginations unbound
  • 21. Conclusion •  A “Linked Sensor Web” solution for integrating heterogeneous sensor data sources and geospatial data. •  A best practice of using W3C SSN ontology as well as other domain ontologies. •  A method to discover and create links among spatial data. •  Using Linked Data API to provide OGC RESTful SOS-like services •  http://sensorweb.ncsa.uiuc.edu/api-list.html •  Tracking provenance data and managing them using OPM. Imaginations unbound
  • 22. Future Work •  Towards Linked Geostreaming Data •  Tuning the performance •  Facilitating searching and crawling of Linked data •  End-to-end provenance management Imaginations unbound
  • 23. Acknowledgements Ø Microsoft Research Connections Ø  “Environmental Informatics” Program Ø  Institute for Advanced Computing Applications and Technologies at the University of Illinois at Urbana- Champaign Ø  “Virtual Observatory for Sustainability of Intensively Managed Environmental Systems” Project Imaginations unbound