Open Data Open Innovation and The Cloud gayler berlin nov12
1. Open Data, Open Innovation
and The Cloud
Mark Gayler – magayler@microsoft.com
Open Software Lead – www.microsoft.com/openness
Summit of New Thinking – Berlin, Nov 2012
2. Expectations are Changing
Citizens expect…
Personalized, quality services wherever they are
Engagement in issues that affect them
Their privacy and security respected
Workers expect…
Tools that follow their work style
Workplaces that support the devices they use
Social tools to help them collaborate across boundaries
Leaders expect…
The ability to consult with constituents wherever they are
Insight and performance management
Competitive environment, attracting investments
3. Exploiting the Latest Technology Trends
Extracting business value from technology…
Cloud Computing
Consumerization Data Explosion
4. Open Government Data
Share public data for transparency, participation, and stimulate new services based on the data
Scenarios Utilization
• Mash-up data to create data feeds • Reuse data internally across agencies
• Publish feeds into Open Data Catalogues • Stimulate public innovation
• Develop applications that consume data • Improve citizen services
4
5.
6. Country Data Type Estimated
Business Value
Australia GIS/Spatial €5.2Bn
Australia Statistics €19M
Denmark Energy/Construction €540M
England/Wales Local Geospatial €400M
Ireland National €83M
Spain National €550M
UK GIS/Met/Mapping €7.5Bn
USA Meteorological €309M
7. Open Government Data Scenarios
Public Websites Citizen
Agency
Geographic Community Data
Information
Systems Developer
Performance
Management
Civil Servant
Open
Government
Advanced Analytics Internal Data Open Data Data
For Government Analysis Reporting Data Catalog Data feeds
Services Integration Services
Services
API Search tools
Government Data Enterprise
Interoperability Information
Government ERP
Management
LOB Apps Hierarchical Flat files oData Feeds
7
8. Open Data and the Cloud
Cloud is Open for Innovation
developers Low entry cost Accelerator
Build quickly
Minimal infrastructure
Highly scalable
Data agility
*Graphic courtesy techlabs.com http://www.windowsazure.com
9. Localized in 26
Languages
www.eyeonearth.eu
Eye On Earth is a Cloud-based service by
European Environmental Agency (EEA),
since 2009
Water quality measured vs. reported at
Brno dam – Brněnská přehrada
Eye On Earth is the outcome of a strong
collaboration with Microsoft. It maps
sensor water and air quality data, while
allowing citizen feedback through its Open for more
dynamic and user-friendly web site. information
Map functions
Enquiry pushpin
10. http://data.gov.uk
UK Weather Data Archive
Cost-Effective Catalogue Integration Cloud Scale
Infrastructure Seamless Access Big Data Analytics
13. Facts and Figures
• UK Met Office Weather Data on data.gov.uk
– 5,000 UK locations,
– Hourly forecasts: daily + 5 days, 3hrly + 5 days
– Approx 250 million rows per hour of data
• Transport for London (TfL) - London Underground Trains
– #1 European popular Open Data solution by citizen usage
• average 2.3million hits per day from 80+ ISV mobile apps on iOS,
Win8/WP, Android
– Major CAPEX savings (£2m+) for TfL cloud infrastructure
– ‘London Tube Map’ Windows 8 app
15. OGDI/DataLab
Open APIs, Scale &
Reliability of Windows Azure
Roll out open data portal Open Source with
fast and at low cost Community participation
16. European OGDI version on GOVDATA.EU
9 EU Member States
Dataset Categories already publishing
data
17. Leveraging Windows Azure DataMarket
https://datamarket.azure.com/
DataMarket
• Open standards, comfort for non-IT professionals
• Both cost-free, and also for-fee datasets from
commercial providers
• UN, EEA, World Bank, US Data.gov free datasets
already there, and more...
For Citizens
• Read datasets directly into Excel
• User friendly mash-up by Excel PowerPivot
(free add-in, downloadable)
For Developers
• REST based API for all datasets
• Software Development Kit on github
https://github.com/openlab/DataLab/wiki
18
18.
19.
20. ‘Business’ Opportunity for Open Data in
the Cloud
Deliver better services at
lower cost (*ratio)
Enable new innovative
applications and services Stimulate business and
(backed by SLA) economic growth
Enable developers and
citizens to easily
Industry and Citizen consume Open Data and Enable business insight
Engagement Big Data for Government workers
21. Produce – Upload – Consume (Open Data)
Export relational views Create an Open Data Catalog by Browse, visualize,
from databases eg. OGDI Software Development create applications
to create data feeds Kit (SDK)
https://github.com/openlab/DataLab/wiki
Talking Points: As citizens or businesses we want to be served and treated as individuals, where and when we want, to be told in advance about issues that may affect me. Citizens Engagements.. examples of citizen driven initiatives such as NetMums http://www.netmums.com/, FixMyStreet, HeyGov... For workers we want to provide tools that reflect their work styles, in terms of information access, mobile working and collaboration capabilities. And as Leaders and Executives we need to have information that really drives operational excellence deeper insight and strategic decision making. Collectively if we can help to achieve these for any government then we can expect an engaged community, a motivated and productive workforce and an attractive place to invest and do business in.
Consumerization: The capability is ubiquitous. Consumers how have more client computing power than enterprise workers. Cloud: The world is flat... reduced upfront investments, reduced barrier for global presence, reduced barriers for market entry. Data explosion: Data as a Service, Govt as a platform, but also Information Continuum (Gartner): NGOs and citizens have their own views and version of truth... see our two case studies.
Open Data projects can be found around the world. Governments share open data which creates opportunities for citizens and 3 rd -party developers to build new innovative applications and services. Open data standards enable data to be shared across technology platforms, internally and externally, and independent of access devices. The Microsoft technology platform makes extensive use of the Odata protocol. Built on standards such as HTTP, JSON and AtomPub, OData is a Web protocol for unlocking and sharing data — freeing it from silos that exist in some software applications today. The OData protocol supports serialization in multiple popular formats, including JSON and Atom/XML. With OData, developers are able to build cross-platform Web and mobile applications. Based on that demand, Citrix Systems Inc., IBM Corp., Microsoft Corp., Progress Software, SAP AG and WSO2 are proposing an Open Data Protocol (OData) Technical Committee (TC) in the Organization for the Advancement of Structured Information Standards (OASIS), an international open standards consortium. Citrix, EastBanc Technologies and Viecore FSD, among many others, have recently demonstrated OData applications, and hundreds of interested parties are registered on the http://www.odata.org open community mail list.
Open data publishing works within the operational realm of Government information, insight and accountability. The Microsoft technology platform makes extensive use of the Odata protocol. Built on standards such as HTTP, JSON and AtomPub, OData is a Web protocol for unlocking and sharing data — freeing it from silos that exist in some software applications today. The OData protocol supports serialization in multiple popular formats, including JSON and Atom/XML. With OData, developers are able to build cross-platform Web and mobile applications. Based on that demand, Citrix Systems Inc., IBM Corp., Microsoft Corp., Progress Software, SAP AG and WSO2 are proposing an Open Data Protocol (OData) Technical Committee (TC) in the Organization for the Advancement of Structured Information Standards (OASIS), an international open standards consortium. Citrix, EastBanc Technologies and Viecore FSD, among many others, have recently demonstrated OData applications, and hundreds of interested parties are registered on the http://www.odata.org open community mail list.
Cloud Computing provides distinct benefits for open data projects: Cloud has a very low-entry cost (near zero) Cloud is highly scalable. Very cost-effective no matter how much data you publish or how many citizens use that data. Cloud is open. You can share data using open data protocols enabling app developers to code with whatever tools they desire e.g. PHP, Ruby, Python, .NET Minimal impact on your existing infrastructure. Using Cloud, it doesn’t matter how many citizens use your service – this does not affect your IT infrastructure.
Eye on Earth is a project run by the European Environment Agency which publishes Air, Water, and Noise quality data enabling citizens to rate the quality of that data via any SMS-enabled device.
Another advantage of Cloud is that it provides an excellent platform for combining open data with Big Data at low cost. A good example of this is with UK http://data.gov.uk where the UK Gov open data platform uses Windows Azure to publish UK national meteorological (weather) data on an hourly basis at minimal cost. UK Met Office Weather Data on data.gov.uk o 5,000 UK locations o Hourly forecasts: daily + 5 days, 3hrly + 5 days o Approx 250 million rows per hour of data o UK SME: dotnetsolutions MGXFY13 11/28/12
These are Windows 8 open data apps available from the Windows 8 App Store
Most Governments start their open data initiative by building an open data catalog – the Cloud is an ideal platform for this. This is a typical OGDI/DataLab open data catalog hosted on Windows Azure built for EU data.
Windows Azure DataMarket is one solution for publishing data for commercial and non-commercial purposes.
A powerful aspect of publishing data in Windows Azure DataMarket is the seamless way data can be shared to/from Office tools such as Microsoft Excel, using PowerPivot.
Open data can be combined with business performance data to produce a Government ‘Dashboard’ as in this example of a Windows 8 dashboard for City of Barcelona. MGXFY13 11/28/12
Governments have an incredible opportunity to drive smart innovation and create new business and stimulate economic growth. Simply by sharing data assets to the public, the Government organization can generate considerably more value beyond the cost of providing the service. This can be done quickly and cost-effectively and in a very open way using Cloud computing. *Early open data projects indicate a cost/benefit ratio of around 5:1 depending upon data and service type (with geo-spatial data driving ratios of up to 20:1)