This document discusses how open data is turned into services. It notes that while open data initiatives aim to spur the creation of new services, the development of sustainable services based on open data has been disappointing. Several approaches are explored to better encourage the creation of open data services, such as addressing intellectual property rights, improving data discoverability, providing support like APIs and training, and running competitions. However, studies suggest that the potential for open data to generate new services may be overstated, as reusers are not strongly demanding open datasets and there is a lack of alignment between released datasets and created services.
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
How open data are turned into services?
1. How open data are turned into
services?
Muriel Foulonneau, Sébastien Martin, Slim Turki
IESS 2014 – 5th Int. Conf. on
Exploring Services Science
5-7 February 2014
Geneva, Switzerland
2. Recent Highlights
2009 – USA, Memorandum on Transparency and Open
Government
•
1000s of datasets released in multiple sectors.
2013 – EU Commission, new release of Public Sector Information
directive
•
•
amending Directive 2003/98/EC on the re-use of public sector information
known as the “PSI Directive”
include in particular cultural heritage data in the public data that has to be
made openly accessible by public institutions in Europe.
2013 – G8 Open Data Charter; Principles are:
•
•
•
•
•
18/02/2014
Open Data by Default
Quality and Quantity
Useable by All
Releasing Data for Improved Governance
Releasing Data for Innovation
How open data are turned into services?
2
3. Observations
Open Data movement mainly a data provision movement.
Release of Open Data motivated by:
•
•
•
government transparency (citizen access to government data)
development of services by third parties for benefit for citizens and
companies (typically smart city approach), or
development of new services that stimulate the economy
Many platforms are supported by initiatives dedicated to creation
of services based on open data
Development of sustainable services based on open data is
extremely disappointing
Services delivered through Applications
18/02/2014
How open data are turned into services?
3
4. Objectives
1. Study development of services based on open data
2. Means to make data opening process more effective
3. Assessment of data opening and RoI
18/02/2014
How open data are turned into services?
4
6. Intellectual property rights and reuse
conditions
Singapore
•
insists on having well documented IPR on each dataset
Europeana
•
•
•
•
•
18/02/2014
Data Exchange Agreement, all data providers have to sign in order to have
their data included in the platform.
Release of all data (metadata in this case) transferred to Europeana with a
CC0 license, i.e., the data is in the public domain.
Lowest possible barrier to reuse; reusers haven’t to address
heterogeneous reuse conditions when reusing multiple datasets
Enforcement of a single and so open license created a number of issues
with cultural heritage institutions which have invested large resources in
manual creation of these metadata for years.
French Min. of Culture launched a study to verify if revenues of cultural
data selling > revenues in regard with open data release potential.
How open data are turned into services?
6
7. Dataset discoverability
Open Data portals at regional, national and international level
aggregate metadata on datasets, to make datasets accessible.
Vocabularies
•
•
•
18/02/2014
Different vocabularies can be used to describe datasets (VoID, POWDER,
Dublin Core Collection application profile or DDI)
Heterogeneity of metadata is an obstacle to their discovery
Harmonization of metadata through vocabularies such as DCAT can help
datasets discovery.
How open data are turned into services?
7
8. Support
Release of open data is not sufficient to make them accessible
and understandable by reusers
“Reuse requires technical skills and extensive knowledge of the
context of data that are beyond the reach of a large part of the
population” (Remiti, 2012).
Publishers create APIs to lower technical barrier and time required
to develop new services:
•
•
•
•
18/02/2014
Reusers do not have to address format heterogeneity and less knowledge
required
Singapore / API provides access to the datasets recorded on the portal
USA / Federal agencies to create public APIs that could be used by
government and private developers to tap in to data. Free, open source
tools are released to accelerate adoption of open data practices by
providing plug-and-play tools and best practices to help agencies improve
the management and release of open data.
In France, API for data.gouv.fr is under study
How open data are turned into services?
8
9. Training
World Bank platform
•
•
Exception, provides various training services, basic knowledge
Help potential reusers how to get data and to represent data it into maps.
Developers can rely on initiatives from third parties like Open
Knowledge Foundation
•
18/02/2014
For stakeholders who may not have extensive technical knowledge but
wish to work on the data (e.g. data journalists), it founded a School of data
in 2012.
How open data are turned into services?
9
10. Publicizing datasets
When data producers publish new datasets, they have to make the
datasets known to reusers to optimize the chances that reusers
will take advantage of datasets.
•
18/02/2014
French National Library has established contacts with the semantic
community to make new datasets known so as to facilitate the creation of
new services. They publicize on virtual community channels the
information and reach potential reusers for their data.bnf.fr datasets.
How open data are turned into services?
10
11. Competitions for service creations
Hackathons
•
•
•
•
Locking developers, citizens, civil servants, researchers, company
programmers or any other interested party to create services in a short
amount of times, typically 1 or 2 days.
Dev. can be individual or the result of joint code developed on site.
Europeana for instance organized several hackhatons.
Paris city, France organized an open data competition in collaboration with
companies opening their data
Off-site competitions
•
Veni, Vidi, Vici competitions organized by the European LinkedUp project
to encourage reuse of educational datasets, accompanied by monetary
prizes (39.500€).
Variety of services that can be created based on open datasets.
Effective at raising awareness of developers and service creators on
potential for reuse of the open datasets.
Most often services created in these contexts do not lead to the
18/02/2014
How open data are turned into services?
development of actual sustainable services.
11
12. Ensuring creation of sustainable services
Singapore government organizes co-funding of services via Calls
for contribution
European Commission co-funds development of
•
•
18/02/2014
services to take advantage of geographic information coming from the
Galileo satellite
services reusing open datasets (open access to scientific outcomes
experimentation calls in ICT-PSP and services based on open geographic
data).
How open data are turned into services?
12
13. Publicizing services to show reuse and
encourage service usage
Open data portals include a section to show services and
applications that use the datasets
“Application Showcase”
“Apps” section
data.gov.uk
data.gov.sg
“Anwendungen”
Berlin Open Data portal
18/02/2014
“Application showcase”
World Bank data portal
13
14. Selection of datasets to open
In order to identify the datasets to open:
•
•
•
18/02/2014
investigate which datasets are already available, which IPR conditions
would allow a publication under an open licence, and whose quality is
sufficient, or
investigate what citizens and potential reusers are interested in.
In 2013 the French ministry of culture launched a survey for the selection
of priority datasets for open data release.
How open data are turned into services?
14
16. Monitoring
Difficult to monitor services created based on open data sets.
Easier to monitor actual reuse of data, datasets available only
through APIs.
On open data catalogues, the number of downloads can be
monitored.
Effective reuse of data is more difficult to trace if reusers do not
establish a direct contact with the data publishers.
18/02/2014
Most popular datasets on the Paris
Open Data portal
How open data are turned into services?
opendata.paris.fr
16
17. UK / data.gov.uk
314 apps listed; Domains of application include:
•
•
•
•
•
•
•
Economy (Property prize , Job market)
Environment (Use of renewable energies)
Transparency (e.g., Availability of governmental financial data with the app.
« Where does my money go? »)
Society (Criminality map)
Local services (best surgery services next to me, postal code where I am,
fuel station search)
Education (geological layers where I stand), and
Citizen life (elections results, « UK arms export licence browser »)
Thematic distribution of applications based into services?
18/02/2014
How open data are turned
on datasets published on data.gov.uk
17
18. UK / data.gov.uk
Thematic distribution of applications
Although categories are not
exactly similar
•
•
•
•
Imbalance between low number of
geographic and transportation
datasets and large proportion of
transportation services.
Suggests the quite uneven potential
of datasets for reuse.
Transportation datasets appear to
have a high reusability potential
Education datasets attract less
Distribution of datasets by topic
reusers in proportion of their
quantity.
Domain is clearly not the only
element to take into
consideration when assessing
the reusability of a dataset.
18/02/2014
How open data are turned into services?
18
19. How are datasets reused?
78% reuse only a single dataset.
As an exception, Sketchmap.co.uk uses 19 datasets.
Most reused datasets are Code-Point® Open and the National
Public Transport Access Nodes (NaPTAN).
•
Transportation datasets are popular.
80% of apps are available for free
•
Others are most often sold for less than 1£.
The most downloaded app available via GooglePlay is NHS direct
app (medical diagnostic) with more than 100.000 downloads.
•
18/02/2014
This application was however created by the same administration which
released the data.
How open data are turned into services?
19
21. Evaluation of open data initiatives
Usage, audience, and uniqueness of the services
Entailed changes in public institutions opening data (improved
data management, increase information sharing culture)
Created business opportunities
Citizen and business perception of the city (open data as a
communication tool on how modern a city or country is)
Modification to particular markets it has entailed
Sustainability of created services
New dialog created with citizens (open legislation process, UK)
18/02/2014
How open data are turned into services?
21
22. Conclusion
Studies suggest that reusers are not really interested in open
datasets
Not a demand driven initiative but rather an initiative of data providers,
hoping for a possible impact in terms of service creation.
Inadequacy between released datasets and created services as
well as between the claims of huge potential service creations
and the low demand from service creators, particularly
companies
•
•
•
•
18/02/2014
Are reusers aware of the potential reuse of datasets or do not they really
need them?
Is there an adequacy between the datasets that are of interest to reusers
and the datasets actually opened?
Can we measure the potential for reuse of particular datasets? Which are
the obstacles to reuse?
Is the potential impact of open data in terms of service creation really
inflated or are there obstacles to data reuse that have not been sufficiently
addressed?
How open data are turned into services?
22
23. Thank you for your attention
How open data are turned into
services?
Muriel Foulonneau, Sébastien Martin, Slim Turki
muriel.foulonneau@tudor.lu
slim.turki@tudor.lu
IESS 2014 – 5th Int. Conf. on
Exploring Services Science
5-7 February 2014
Geneva, Switzerland