06 standards based application deployment & execution
6 de Sep de 2017•0 gostou
0 gostaram
Seja o primeiro a gostar disto
mostrar mais
•429 visualizações
visualizações
Vistos totais
0
No Slideshare
0
De incorporações
0
Número de incorporações
0
Baixar para ler offline
Denunciar
Dados e análise
Marie-Francoise Voidrot (Open Geospatial Consortium) explained the standardisation efforts leading to better and easier development of apps in agriculture, e.g. forest change detection, through OGC web services.
06 standards based application deployment & execution
1
Marie-Francoise Voidrot, Ingo Simonis
Open Geospatial Consortium Europe
INSPIRE Conference 2017
Workshop: New Ways to Tackle Agriculture Challenges
September 2017
This project has received funding from the European
Union’s Horizon 2020 research and innovation
programme under grant agreement No 732064.
This document is part of a project that has received funding from the European Union’s Horizon 2020 programme under grant agreement No 732064. It is the property of
the DataBio consortium and shall not be distributed or reproduced without the formal approval of the DataBio Management Committee. See www.databio.eu.
Commercial
39%
Government
27%
NGO
8%
Research
6%
University
20%
Not-for-profit, international voluntary consensus standards
organization; leading open innovation for geospatial data
• Founded in 1994
• 525+ member organizations
• 100+ innovation initiatives
• 48 Open Standards
• 230 OGC certified products
• Thousands of implementations
• Enabling access to 100K+ datasets
Africa
4 Asia
Pacific
86
Europe
209
Middle
East
34
North America
182
South
America
3
This document is part of a project that has received funding from the European Union’s Horizon 2020 programme under grant agreement No 732064. It is the property of
the DataBio consortium and shall not be distributed or reproduced without the formal approval of the DataBio Management Committee. See www.databio.eu. 3
Compliance
Program
Engineering Reports &
Compliance Tests
Adopted
Standards
Gaps &
Enhancements
Standards
Program
Communications
& Outreach
Innovation
Program
Requirements
Requirements
Requirements
This document is part of a project that has received funding from the European Union’s Horizon 2020 programme under grant agreement No 732064. It is the property of
the DataBio consortium and shall not be distributed or reproduced without the formal approval of the DataBio Management Committee. See www.databio.eu. 4
This document is part of a project that has received funding from the European Union’s Horizon 2020 programme under grant agreement No 732064. It is the property of
the DataBio consortium and shall not be distributed or reproduced without the formal approval of the DataBio Management Committee. See www.databio.eu. 5
This document is part of a project that has received funding from the European Union’s Horizon 2020 programme under grant agreement No 732064. It is the property of
the DataBio consortium and shall not be distributed or reproduced without the formal approval of the DataBio Management Committee. See www.databio.eu. 6
Example: Forest Change Mapping
This document is part of a project that has received funding from the European Union’s Horizon 2020 programme under grant agreement No 732064. It is the property of
the DataBio consortium and shall not be distributed or reproduced without the formal approval of the DataBio Management Committee. See www.databio.eu. 7
Application
developer
Application
consumer
This document is part of a project that has received funding from the European Union’s Horizon 2020 programme under grant agreement No 732064. It is the property of
the DataBio consortium and shall not be distributed or reproduced without the formal approval of the DataBio Management Committee. See www.databio.eu.
Minimize extra work for developer
Allow developer to make application available
based on standards to simplify deployment
Decouple consumer from developer
Allow consumer to execute application with
own base data
8
This document is part of a project that has received funding from the European Union’s Horizon 2020 programme under grant agreement No 732064. It is the property of
the DataBio consortium and shall not be distributed or reproduced without the formal approval of the DataBio Management Committee. See www.databio.eu. 9
Application
developer
1
This document is part of a project that has received funding from the European Union’s Horizon 2020 programme under grant agreement No 732064. It is the property of
the DataBio consortium and shall not be distributed or reproduced without the formal approval of the DataBio Management Committee. See www.databio.eu. 10
Application
developer
1
2
This document is part of a project that has received funding from the European Union’s Horizon 2020 programme under grant agreement No 732064. It is the property of
the DataBio consortium and shall not be distributed or reproduced without the formal approval of the DataBio Management Committee. See www.databio.eu.
11
Title
Description
Input data
Input parameters
Output
Link to Container
This document is part of a project that has received funding from the European Union’s Horizon 2020 programme under grant agreement No 732064. It is the property of
the DataBio consortium and shall not be distributed or reproduced without the formal approval of the DataBio Management Committee. See www.databio.eu.
Sentinel images
Area of interest
Target resolution
12
Title
Description
Input data
Input parameters
Output
Link to Container
Forest
Application
Free Text
Tiff file
This document is part of a project that has received funding from the European Union’s Horizon 2020 programme under grant agreement No 732064. It is the property of
the DataBio consortium and shall not be distributed or reproduced without the formal approval of the DataBio Management Committee. See www.databio.eu. 13
Application
developer
1
2
3
This document is part of a project that has received funding from the European Union’s Horizon 2020 programme under grant agreement No 732064. It is the property of
the DataBio consortium and shall not be distributed or reproduced without the formal approval of the DataBio Management Committee. See www.databio.eu. 14
Application
developer
1
2
3
Application
consumer
4
This document is part of a project that has received funding from the European Union’s Horizon 2020 programme under grant agreement No 732064. It is the property of
the DataBio consortium and shall not be distributed or reproduced without the formal approval of the DataBio Management Committee. See www.databio.eu. 15
Application
developer
1
2
3
Application
consumer
4
5
This document is part of a project that has received funding from the European Union’s Horizon 2020 programme under grant agreement No 732064. It is the property of
the DataBio consortium and shall not be distributed or reproduced without the formal approval of the DataBio Management Committee. See www.databio.eu. 16
Application
developer
1
2
3
Application
consumer
4
5
6
This document is part of a project that has received funding from the European Union’s Horizon 2020 programme under grant agreement No 732064. It is the property of
the DataBio consortium and shall not be distributed or reproduced without the formal approval of the DataBio Management Committee. See www.databio.eu. 17
Application
developer
1
2
3
Application
consumer
4
5
6
And the standards?
This document is part of a project that has received funding from the European Union’s Horizon 2020 programme under grant agreement No 732064. It is the property of
the DataBio consortium and shall not be distributed or reproduced without the formal approval of the DataBio Management Committee. See www.databio.eu.
IAAS
18
Application
developer
Application
consumer
WPS WPS
AWS
IPT
Poland
WFS
WCS
WMS
CSW
Notas do Editor
The OGC runs four different programs. The Standards Program develops the standards, complemented by a Compliance Program and a Communications & Outreach Program.
The Innovation Program is the rapid prototyping laboratory and OGC’s research center. Here, we do participate in H2020 projects such as DataBio, and run our own initiatives, such as e.g. Testbed-13. The key idea is to collect requirements from industry, governments, or academia and develop solutions, best practices, or guides, which are fed to the Standards Program and the public to enhance geospatial information processing in general.
DataBio addresses the Bioeconomy in general, with pilots in the agriculture, forestry, and fishery sector. Thus, there are different requirements, different data, different applications.
Common to all: applications that process BigData. Big in terms of volume, but even more important, variety. (Other Vs ignored here)
forest change mapping, based on two time instant images from the same area with no need for auxiliary data. The algorithm applies two-level clustering, and based on the calculated spectral values computes the magnitude and type of the change.
Typical situation: on the one side is the application developer, who creates an application, on the other side is the consumer.
How can the developer make the application available in the cloud so that the consumer can use it?
In a first step, the application developer packs the application into a Docker container. Then the container is loaded to a DockerHub.
2nd step: The application developer describes builds an application package that includes all information.
Example:
Input data are
sentinel images that are available on some online platform
parameters such as area of interest and target resolution
So here is an Example:
Title would be “Forestry Application”
A description : at the moment the description is a free text description about what the application does and we will probably stay with that. Ideally links to other application or somehow integrated into a network of operations but this is the future .
Input data are
sentinel images that are available on some online platform
Input parameters
parameters such as area of interest in that sentinel image and target resolution
The output we product tiff files for example that show you the differences between the sentinel images
And here is the link to the container
This has to be standardized.
This is a metadata record for an application package
This is the first endeavour and we thought about the minimum we need and we came with these 6 aspects here to get an operational prototype at the end of the testbed.
We have metadata model for services, metadata model for data, can we use the metadata model for data and for services to describe applications?
3rd step: the application package is loaded to a service that acts as a application platform.
4th step: application consumer discovers the application
5th step: application consumer discovers input data
6th step: application consumer provides all execution information to the application platform
sounds good, but where are the standards?
Let’s change to a more schematic perspective: Here we see that a number of OGC Web services are deployed.
The left WPS manages all the application packages, whereas the right one deploys requested containers in the cloud and executes them.
Data can be accessed through standard OGC data access services.