Validation of services, data and metadata
•Transferir como PPT, PDF•
2 gostaram•472 visualizações
Now days organizations are making available data (e.g. vector data, rasters) via web services, that follow open standards and are easier to integrate with other data. Validation of these services is important to guarantee that clients (e.g. web portals, mobile applications) can properly discover and download the data that a user needs. Validation can also serve as curation process to improve discovery on registries [1][2] or for certification purposes [3]. This session will provide an overview and a demo of the Open Geospatial Consortium (OGC) Validation tools. The participants will understand how to invoke a test and install the tools in their own environment. The validation tools are used to test servers, data and clients. The tests can be customized to not only test implementations against OGC standards but also community profiles. The validation engine and the tests are available as open source in GitHub. [1] ESIP Discovery Cluster Testbed: Validate and Relate Data & Services - Draft - http://commons.esipfed.org/node/406 [2] Community Inventory of EarthCube Resources for Geosciences Interoperability - http://earthcube.org/group/cinergi [3] OCG Validation Website - http://cite.opengeospatial.org/teamengine/
Recomendados
Recomendados
Mais conteúdo relacionado
Destaque
Destaque (18)
Semelhante a Validation of services, data and metadata
Semelhante a Validation of services, data and metadata (20)
Mais de Luis Bermudez
Mais de Luis Bermudez (20)
Último
Último (20)
Validation of services, data and metadata
- 1. ® Validation of services, data and metadata Luis Bermudez (OGC) ESIP Summer Meeting 2016 Durham, NC July 21, 2016
- 2. Composition of this talk • Why validation • ESIP needs • OGC Compliance Program • The tool 2
- 7. Service Service Catalog Are the services correctly registered so that they can be found and use?
- 8. OGC ® © 2016 Open Geospatial Consortium, Inc. ESIP community has documented the need 8
- 11. OGC ® © 2016 Open Geospatial Consortium, Inc. OGC compliance program 11
- 12. Open Geospatial Consortium 534 volunteer organizations 6905 portal users More than 60 standards
- 14. Conformance = fulfillment of specified requirements http://www.sxc.hu/photo/149744
- 15. Implementations can get OGC Certified Currently 851 implementations 203 compliant products
- 16. For Users: Proof that a solution works (www.opengeospatial.org/ resource/products/compliant) http://www.opengeospatial.org/resource/products/compliant
- 17. For implementers: Get more business
- 18. How does it work?
- 19. OGC ® © 2016 Open Geospatial Consortium, Inc. 19 Conformant = Compliant = Super passing the test + license If not we can say Implement
- 20. Available and Expected Tests 2016 Available Tests Version Projected in 2016 Version Catalogue Service - Web (CSW) 2.0.2 Catalogue Service - Web (CSW) 3.0 Geography Markup Language (GML) 3.2.1 GeoPackage 1.0 OGC KML 2.2 KML 2.3 Sensor Observation Service (SOS) 1.0.0 O&M 2.0 Sensor Observation Service (SOS) 2.0 SensorML 1.0 Sensor Planning Service (SPS) 1.0 SensorML 2.0 Sensor Planning Service (SPS) 2.0 SensorThings API 1.0 Simple Feature Access - SQL (SFS) 1.1 WFS (Basic) 1.1 Simple Feature Access - SQL (SFS) 1.2.1 WMTS 1.0 Web Coverage Service (WCS) 1.0.0 WPS 1.0 Web Coverage Service (WCS) 1.1.1 DGIWG Profiles Web Coverage Service (WCS) 2.0.1 Web Feature Service (WFS) 1.0.0 Web Feature Service (WFS) 1.1.0 Web Feature Service (WFS) 2.0 Web Map Service (WMS) 1.1.1 Web Map Service (WMS) 1.3.0 WMS Client 1.3
- 21. How to ask for compliance? “ … Purchaser seeks geospatial products that provide maximum interoperability with purchaser’s and data sharing partner’s systems. To accomplish this, purchaser seeks to make maximum use of open standards provided by the Open Geospatial Consortium (OGC), ISO …” OGC Compliance Overview - Guide for Software Acquisition White paper (15-002r5) http://docs.opengeospatial.org/wp/15-002r5/15-002r5.html
- 22. The Open Source Tool
- 23. Tools, community and support Code Contributors Public Forum Support Open Source XSLT Tools Communities Collaboration Giacomo Martirano Stefania Morrone Enable testing of INPSIRE metadata profiles Processing non-ASCII chars GML CRS, and polygons definitions
- 24. Anybody can run the test
- 25. Tester selects test suite Tester names session Selection of Test
- 26. Testing in Progress Tester provides end point of the service Console provides feedback on test assertions Tester Selects Options
- 28. Types of Tests • Encodings – SensorML, KML, GML, Metadata in XML, … • Servers – CAT, WFS, WMS, WCS, SOS, … • Clients – WMS 1.3
- 29. Example in EuropeExample in Europe Data validation for INSPIRE Themes In collaboration with Epsilon Italia TEAM Engine and GML 3.2.1 test suit Metadata and Services Validation for Germany and INSPIRE TEAM Engine and CSW and WMS test suites http://cloud.epsilon-italia.it/ http://testsuite.gdi-de.org/gdi/
- 31. Metadata Validation used in CINERGI (Community Inventory of EarthCube Resources for Geosciences Interoperability)
- 32. 32 ILYA ZASLAVSKY RAQUELCALDERON CHRISCONDIT JEFFREYGRETHE AMARNATH GUPTA BURAKOZYURT THOMASWHITENACK DAVIDVALENTINE ALICEGILIARINI AARON GONG University of California San Diego STEPHEN RICHARD, LEAHMUSIL Arizona Geological Survey KERSTIN LEHNERT, LESLIEHSU LDEO, Columbia University TANU MALIK University of Chicago LUISBERMUDEZ Open Geospatial Consortium Community Inventory of EarthCube Resources for Geoscience Interoperability CINERGIProject Overview
- 33. Goals • Large inventory of high quality information resources across disciplines, with traceable provenance, usable across EarthCube research scenarios • Engaging geoscience community in creating and curating the inventory • Enabling search and integration across domains, and facilitating navigation across information objects of different types (resources, people, software, etc..)
- 34. 34
- 35. 3 Levels Community Inventories Validation 1 – Schema 2 – Rules not enforced by schema 3 – Community rules http://cite-dev- 03.opengeospatial.org/te amengine/
- 36. Level 1 - Schema
- 37. Level 2 – Rules not enforceable via Schema
- 38. Level 3 – Community Rules
- 39. Results
- 41. Example files for metadata validation Go to the validation web site: http://cite-dev-03.opengeospatial.org/teamengine/ Provide an XML instance http://cinergi.sdsc.edu/getmetadata/F3ACDE93-F0E3- 4F7E-AD26-F2B87DD4DB4B.xml And if needed provide a schematron http://cite-dev-03.opengeospatial.org/teamengine/geo- extend-iso.sch 41
- 42. GML Validation Common Database on Designated Areas 1.4 GB 100,181 Features CDDA application schema INSPIRE Protected Sites schema XML Schema Validation About 1 min to test against Schema with 1 GB Java heap size Test data provided b Epsilon Italia
- 43. OGC ® © 2016 Open Geospatial Consortium, Inc. Catalog (CAT 3.0) Validation 43 • https://www.youtube.com/watch?v=dWf0X6naiRU
- 45. Help and questions when testingHelp and questions when testing cite-forum@ lists.opengeospatial.org Community support with about About 300 members
- 46. Thank you Luis Bermudez lbermudez@opengeospatial.org @berdez https://www.linkedin.com/in/bermudez Presentation at: http://bit.ly/2a1Ttm5
Notas do Editor
- CONTROL ID: 1469340 TITLE: An Open Source Tool to Test Interoperability AUTHORS (FIRST NAME, LAST NAME): Luis E Bermudez1 INSTITUTIONS (ALL): 1. Open Geospatial Consortium, Rockville, MD, United States. ABSTRACT BODY: Scientists interact with information at various levels from gathering of the raw observed data to accessing portrayed processed quality control data. Geoinformatics tools help scientist on the acquisition, storage, processing, dissemination and presentation of geospatial information. Most of the interactions occur in a distributed environment between software components that take the role of either client or server. The communication between components includes protocols, encodings of messages and managing of errors. Testing of these communication components is important to guarantee proper implementation of standards. The communication between clients and servers can be adhoc or follow standards. By following standards interoperability between components increase while reducing the time of developing new software. The Open Geospatial Consortium (OGC), not only coordinates the development of standards but also, within the Compliance Testing Program (CITE), provides a testing infrastructure to test clients and servers. The OGC Web-based Test Engine Facility, based on TEAM Engine, allows developers to test Web services and clients for correct implementation of OGC standards. TEAM Engine is a JAVA open source facility, available at Sourceforge that can be run via command line, deployed in a web servlet container or integrated in developer’s environment via MAVEN. The TEAM Engine uses the Compliance Test Language (CTL) and TestNG to test HTTP requests, SOAP services and XML instances against Schemas and Schematron based assertions of any type of web service, not only OGC services. For example, the OGC Web Feature Service (WFS) 1.0.0 test has more than 400 test assertions. Some of these assertions includes conformance of HTTP responses, conformance of GML-encoded data; proper values for elements and attributes in the XML; and, correct error responses. This presentation will provide an overview of TEAM Engine, introduction of how to test via the OGC Testing web site and description of performing local tests. It will also provide information about how to participate in the open source code development of TEAM Engine. http://cite.opengeospatial.org/ KEYWORDS: [9300] GEOGRAPHIC LOCATION, [1976] INFORMATICS / Software tools and services, [1908] INFORMATICS / Cyberinfrastructure, [1982] INFORMATICS / Standards.
- Scientist interact with raw data that can be in different formats and shapes
- They can also publish data
- How good is there communication, Do they really interoperate (access, process, use). Is the interface that they are using well known?
- How good is there communication, Do they really interoperate (access, process, use). Is the interface that they are using well known?
- Global forum of developers and users to advance geospatial standards
- The Compliance Program deals with three main activities: Oversee Compliance Testing activities with SWG and software developers to improve the testing tools and the tests Manage the process for certification of software products Coordinate plugfest activities, where by via short term interoperability integration activities the test and the standards are advanced.
- Requirements = tests = passes predefined testable assertions
- Software implementations can get OGC certified. OGC certified implementations get a badge, that has the information of the organization, the software product and the standards that the product has implemented.
- Organization seeking to buy or use software they can search in the OGC database and check what implementations have been certified
- Implementers get more business and can easier promote their product
- Software companies that want to get certified need to follow the OGC compliance procedure. They go to the online testing engine facility. If the results are successful then they fill up a test result form that it gets process by OGC staff. Depending on the membership level, the company needs to pay a license fee to use the OGC certification branding in their marketing materials.
- Super passing = supervision– evalutaion + test
- OGC has released the Guide for Software Acquisition White paper, that will help those acquiring software to put the correct wording in their procurement documents.
- Open source in guthub
- When the user logins to TEAM Engine he can select the test that he wants to perform and provide a description for that testing session.
- TEAM engine will open various windows. One that can ask for more input. For example endpoint of the server and a console that gives realtime feedback on the progress of the test.
- Finally the user gets the summary of the results
- Use case
- Resources:datasets, catalogs, vocabularies, information models, services, process models, repositories, etc. Tupes: (resources, people/organizations, publications, models, workflows, software, activities, etc.)
- Data is a pan-european dataset of European Environment Agency – not yet publicly available - within a Framework Contract led by KU LEUVEN, where Epsilon Italia is a member of the team