SlideShare uma empresa Scribd logo
1 de 39
What Is Open Data?
CODEONE 2018
…so what are we talking about…
 Introductions
 Do You Open Data?
 Defining Open Data
 How Do I Participate?
 Q&A
Who Am I?
• Architect @ Dell Technologies since 2011
• From St. Paul, MN
• Longtime Software Engineer/Architect
• Business and Software Shops
• Individual Contributor and Leadership Roles
• All phases from project conception to implementation
• Sideline projects at home
• Music Lover
• 10+ years online radio station of personal music
• Contact Info
• Email: scott [dot] sosna [@] buddhadata [dot] com
• LinkedIn: https://www.linkedin.com/in/scott-sosna
• Slideshare: https://www.slideshare.net/ScottSosna
Do You
Open Data?
Citymapper
 Initially for buses in London
 Creator struggled getting from point-to-point in London
 Now Supports 39 major world cities
 Released 2012 (iOS), 2013 (Android)
 Early adopter of TfL real-time Bus/Tube APIs
 Live bus travel data saves as much as £58 million a year, by helping
Londoners and the city’s many visitors plan better routes and avoid
long waits at bus stops.
 Center for Public Impact, March 2016
Zillow
 Integrates real estate data with other public data sources to provide
nuanced view for consumers, buyers and sellers
 Data available but difficult to access for average person
 Levels playing field for buyers/sellers/builders, allows informed
decisions
 Open Data includes
 Property valuations/taxes and real estate transactions
 US Census information
 Local crime statistics
Flight Aware
 All aspects of Aviation
 Global Flight Tracking
 Live Flight Data
 Airport Delays
 Airport Flight Information Displays
 Weather Maps
 Flight Planning
 Government Data Sources
 Federal Aviation Administration
Charles Schwab
 Financial Services
 Investing
 Wealth management
 Banking
 Trading
 Real-time (almost) market information
 Historical market and economic indicators
 Government Data Sources
 Department of the Treasury
 Securities and Exchange Commission
Do You
Open Data?
…THE ANSWER IS YES!
Quote
Data in a precious thing and will last longer than the systems
themselves
– Tim Berners-Lee
Defining
Open Data
Definitions
 Open data is data that can be freely used, shared, and built-on by anyone,
anywhere, for any purpose. Open Knowledge International
 Open data is data that can be freely used, re-used, and redistributed by anyone
– subject only, at most, to the requirement to attribute and share alike. Open Data
Handbook
 Open data is the idea that some data should be freely available to everyone to
use and republish as they wish, with restrictions from copyright, patents or other
mechanisms of control. Wikipedia
 Daten öffentlich, frei verfügbar und nutzbar zu machen für mehr Transparenz,
Innovation und Effizienz — das ist Open Data. Open Data Switzerland
Open Data Essentials
 Legally Open
 Published data must be placed in the public domain or under liberal terms of use with
minimal restrictions
 Technically Open
 Published data must be in electronic formats that are machine readable and preferably
non-proprietary, so that anyone can access and use the data using common, freely
available software tools. Data must be publicly available and accessible on a public
server, without password or firewall restrictions
Open Data Guidelines and Principles
 Completeness
 Primacy
 Timeliness
 Ease of Physical and Electronic Access
 Technically Open
 Machine Readable
 Technically Open
 Non-discrimination
 Legally Open
 Commonly owned or open standard
 Technically Open
 Licensing
 Legally Open
 Permanence
 Usage Costs
Using Open Data
Access Methods
 File downloads
 Synchronous API Calls
 RESTful
 SOAP
 Asynchronous
 File copies
 emails
Example Data Formats
 XML
 JSON
 CSV
 XSL/XSLV (spreadsheets)
 PDF
 RDF (Resource Description Framework)
 GeoJSON
 OpenDocument
 HTML
…and the exceptions…
 Personally-Identifiable Data
 Health Records
 Financial Information
 Legal Proceedings
 Government
 Proceedings, pending legal, negotiating
positions, etc.
 Materials subject to copyright, patent,
trademark, confidentiality, trade secrets
 Employee records, internal directories, IT
system info, proprietary applications
 Undue financial/administrative burden
Open Data  Open Government?
 Maybe, Maybe Not…
 http://myeinsteinjob.blogspot.com/2014/03/the-difference-between-open-
government.html
 https://www.opengovpartnership.org/theme/open-data
 http://blogs.worldbank.org/ic4d/differences-between-open-government-data-and-
open-government-data
 https://medium.com/@digidickinson/whats-the-difference-between-open-data-and-
open-government-data-8a28eb525d2a
What Can I Find?
Open Data Categories
• Agriculture
• Climate
• Consumer
• Crime and Justice
• Defense
• Ecosystems
• Education
• Energy
• Environment
• Finance
• Government Spending
• Health
• Housing
• Intellectual Property
• Labor and Wages
• Manufacturing
• Maritime
• Ocean
• Pollution
• Public Safety
• Science & Research
• Society
• Transport
Global Open Data Index
 Global Open Data Index
 Scores countries on their Open Data initiatives
Open Data Census By City
 United States Cities
 Australian Cities
 Canadian Cities
 Germany Cities
 Index of Places
Demos
 Transport for London
 National Institute of Health
 Gene, search human AFF
 Pollution
 Honk Kong, air quality, download data from lower right
 Finance
What Can I Find? ALMOST
ANYTHING
Problems With Open Data
 Too Little Data
 Many countries collect but don’t publish their data (Open Data Barometer)
 Too Much Data
 2600+ Open Data portals world-wide
 Costs to collect, to publish, to share, to maintain, to standardize, to process
feedback, etc
 Usage Fees
 Data Quality
How Do I
Participate?
INVESTIGATE
AND INNOVATE
Quote
The goal is to turn data into information, and information into
insight.
– Carly Fiorina
How Do I
Participate?
CONTRIBUTE AND
ADVOCATE
Police-involved fatalities since May 2013
Q&A
Links and References
 Open Knowledge International
 Open Data Handbook
 Open Data 500 Global Network
 Centre for Public Impact
 California Public Records Act (1968)
 California Public Records Act (2004)
 Crowd-sourced Open Data
Open Data Example Usage
 Charles Schwab
 CityMapper
 Councilmatic
 CrashMap UK
 Data Machen Schule
 FlightAware
 New York Times
 Open Railway Map
 Open Street Map
 Safe Eats
 Transport for London
 Zillow

Mais conteúdo relacionado

Mais procurados

Internet of Things: Social Applications
Internet of Things: Social ApplicationsInternet of Things: Social Applications
Internet of Things: Social ApplicationsJun Hu
 
Sss14khawaja Thingful IOT Search engine
Sss14khawaja Thingful IOT Search engineSss14khawaja Thingful IOT Search engine
Sss14khawaja Thingful IOT Search engineJustin Hayward
 
Semantic Computing Executive Briefing
Semantic Computing Executive Briefing Semantic Computing Executive Briefing
Semantic Computing Executive Briefing Graeme Wood
 
Recalculating: how we design the internet of things from the user up and the ...
Recalculating: how we design the internet of things from the user up and the ...Recalculating: how we design the internet of things from the user up and the ...
Recalculating: how we design the internet of things from the user up and the ...Alexandra Deschamps-Sonsino
 
Social Things
Social ThingsSocial Things
Social ThingsJun Hu
 
Privacy & Data Ethics
Privacy & Data EthicsPrivacy & Data Ethics
Privacy & Data EthicsErik Kokkonen
 
Ch 2 internet aplications1
Ch 2 internet aplications1Ch 2 internet aplications1
Ch 2 internet aplications1CANOSSAMAHIM
 
Finnish Legal Tech Forum launch presentation
Finnish Legal Tech Forum launch presentationFinnish Legal Tech Forum launch presentation
Finnish Legal Tech Forum launch presentationAnna Ronkainen
 
Around a Few Big Buttons
Around a Few Big Buttons Around a Few Big Buttons
Around a Few Big Buttons Suo&Co Oy
 
What is legal technology?
What is legal technology?What is legal technology?
What is legal technology?Anna Ronkainen
 
TPL Digital Privacy Initiatives
TPL Digital Privacy InitiativesTPL Digital Privacy Initiatives
TPL Digital Privacy InitiativesPam Ryan
 
WoT 2016 - Seventh International Workshop on the Web of Things
WoT 2016 - Seventh International Workshop on the Web of ThingsWoT 2016 - Seventh International Workshop on the Web of Things
WoT 2016 - Seventh International Workshop on the Web of ThingsSimon Mayer
 
Towards Privacy by Design. Key issues to unlock science.
Towards Privacy by Design. Key issues to unlock science.Towards Privacy by Design. Key issues to unlock science.
Towards Privacy by Design. Key issues to unlock science.Marlon Domingus
 
EDF2013: Selected Talk John Sheridan: Good Law from Open Data
EDF2013: Selected Talk John Sheridan: Good Law from Open DataEDF2013: Selected Talk John Sheridan: Good Law from Open Data
EDF2013: Selected Talk John Sheridan: Good Law from Open DataEuropean Data Forum
 
Towards Research-driven curricula for Law and Computer Science - Wyner and Pa...
Towards Research-driven curricula for Law and Computer Science - Wyner and Pa...Towards Research-driven curricula for Law and Computer Science - Wyner and Pa...
Towards Research-driven curricula for Law and Computer Science - Wyner and Pa...Adam Wyner
 
Cloud services in Estonian, startups cloud meetup
Cloud services in Estonian, startups cloud meetupCloud services in Estonian, startups cloud meetup
Cloud services in Estonian, startups cloud meetupRiho Kurg
 

Mais procurados (20)

Internet of Things: Social Applications
Internet of Things: Social ApplicationsInternet of Things: Social Applications
Internet of Things: Social Applications
 
Career Resources to Help Find Jobs in the Intellectual Property Area of Law
Career Resources to Help Find Jobs in the Intellectual Property Area of LawCareer Resources to Help Find Jobs in the Intellectual Property Area of Law
Career Resources to Help Find Jobs in the Intellectual Property Area of Law
 
Introduction to IP Research Tools & Strategies
Introduction to IP Research Tools & StrategiesIntroduction to IP Research Tools & Strategies
Introduction to IP Research Tools & Strategies
 
Sss14khawaja Thingful IOT Search engine
Sss14khawaja Thingful IOT Search engineSss14khawaja Thingful IOT Search engine
Sss14khawaja Thingful IOT Search engine
 
Krishna kumar singh
Krishna kumar singhKrishna kumar singh
Krishna kumar singh
 
Semantic Computing Executive Briefing
Semantic Computing Executive Briefing Semantic Computing Executive Briefing
Semantic Computing Executive Briefing
 
Recalculating: how we design the internet of things from the user up and the ...
Recalculating: how we design the internet of things from the user up and the ...Recalculating: how we design the internet of things from the user up and the ...
Recalculating: how we design the internet of things from the user up and the ...
 
Social Things
Social ThingsSocial Things
Social Things
 
Privacy & Data Ethics
Privacy & Data EthicsPrivacy & Data Ethics
Privacy & Data Ethics
 
Ch 2 internet aplications1
Ch 2 internet aplications1Ch 2 internet aplications1
Ch 2 internet aplications1
 
Finnish Legal Tech Forum launch presentation
Finnish Legal Tech Forum launch presentationFinnish Legal Tech Forum launch presentation
Finnish Legal Tech Forum launch presentation
 
Around a Few Big Buttons
Around a Few Big Buttons Around a Few Big Buttons
Around a Few Big Buttons
 
What is legal technology?
What is legal technology?What is legal technology?
What is legal technology?
 
TPL Digital Privacy Initiatives
TPL Digital Privacy InitiativesTPL Digital Privacy Initiatives
TPL Digital Privacy Initiatives
 
WoT 2016 - Seventh International Workshop on the Web of Things
WoT 2016 - Seventh International Workshop on the Web of ThingsWoT 2016 - Seventh International Workshop on the Web of Things
WoT 2016 - Seventh International Workshop on the Web of Things
 
Towards Privacy by Design. Key issues to unlock science.
Towards Privacy by Design. Key issues to unlock science.Towards Privacy by Design. Key issues to unlock science.
Towards Privacy by Design. Key issues to unlock science.
 
EDF2013: Selected Talk John Sheridan: Good Law from Open Data
EDF2013: Selected Talk John Sheridan: Good Law from Open DataEDF2013: Selected Talk John Sheridan: Good Law from Open Data
EDF2013: Selected Talk John Sheridan: Good Law from Open Data
 
Towards Research-driven curricula for Law and Computer Science - Wyner and Pa...
Towards Research-driven curricula for Law and Computer Science - Wyner and Pa...Towards Research-driven curricula for Law and Computer Science - Wyner and Pa...
Towards Research-driven curricula for Law and Computer Science - Wyner and Pa...
 
Gérald Santucci
Gérald SantucciGérald Santucci
Gérald Santucci
 
Cloud services in Estonian, startups cloud meetup
Cloud services in Estonian, startups cloud meetupCloud services in Estonian, startups cloud meetup
Cloud services in Estonian, startups cloud meetup
 

Semelhante a What Is Open Data? CODEONE 2018 Explained

Von Open Data zu Linked Open Data, M. Kaltenböck, SWC
Von Open Data zu Linked Open Data, M. Kaltenböck, SWCVon Open Data zu Linked Open Data, M. Kaltenböck, SWC
Von Open Data zu Linked Open Data, M. Kaltenböck, SWCMartin Kaltenböck
 
How open is public data agi 2011-13
How open is public data agi 2011-13How open is public data agi 2011-13
How open is public data agi 2011-13lgdigitalcomms
 
SoBigData. European Research Infrastructure for Big Data and Social Mining
SoBigData. European Research Infrastructure for Big Data and Social MiningSoBigData. European Research Infrastructure for Big Data and Social Mining
SoBigData. European Research Infrastructure for Big Data and Social MiningResearch Data Alliance
 
ODI Node Vienna: Best Practise Beispiele für: Open Innovation mittels Open Data
ODI Node Vienna: Best Practise Beispiele für: Open Innovation mittels Open DataODI Node Vienna: Best Practise Beispiele für: Open Innovation mittels Open Data
ODI Node Vienna: Best Practise Beispiele für: Open Innovation mittels Open DataMartin Kaltenböck
 
Local Open Data: a perspective from local government in England 2014
Local Open Data: a perspective from local government in England 2014Local Open Data: a perspective from local government in England 2014
Local Open Data: a perspective from local government in England 2014Gesche Schmid
 
Local Open Data: A perspective from local government in England by Gesche Schmid
Local Open Data: A perspective from local government in England by Gesche SchmidLocal Open Data: A perspective from local government in England by Gesche Schmid
Local Open Data: A perspective from local government in England by Gesche SchmidOpening-up.eu
 
Martin Howitt on Open Data at Exeter Web Feb 2016
Martin Howitt on Open Data at Exeter Web Feb 2016Martin Howitt on Open Data at Exeter Web Feb 2016
Martin Howitt on Open Data at Exeter Web Feb 2016Switch Systems Ltd
 
Ethiopian Open Government Data Initiative
Ethiopian Open Government Data InitiativeEthiopian Open Government Data Initiative
Ethiopian Open Government Data Initiativeabiyotb
 
Open data 4 startups (2°edition)
Open data 4 startups (2°edition)Open data 4 startups (2°edition)
Open data 4 startups (2°edition)TOP-IX Consortium
 
Open Smart Cities in Canada - Webinar 2 - English
Open Smart Cities in Canada - Webinar 2 - EnglishOpen Smart Cities in Canada - Webinar 2 - English
Open Smart Cities in Canada - Webinar 2 - EnglishOpen North
 
150323 lesson learned in open gov. initiative
150323 lesson learned in open gov. initiative150323 lesson learned in open gov. initiative
150323 lesson learned in open gov. initiativeKenji Hiramoto
 
[DevDay2019] Internet of Things- By: Dr. Anand Nayyar at Duy Tan University
[DevDay2019] Internet of Things- By: Dr. Anand Nayyar at Duy Tan University[DevDay2019] Internet of Things- By: Dr. Anand Nayyar at Duy Tan University
[DevDay2019] Internet of Things- By: Dr. Anand Nayyar at Duy Tan UniversityDevDay.org
 
Aligning stakeholders' perspectives in Open Government Data Community
Aligning stakeholders' perspectives in Open Government Data CommunityAligning stakeholders' perspectives in Open Government Data Community
Aligning stakeholders' perspectives in Open Government Data CommunityAdegboyega Ojo
 
Open Government Data for transparency, innovation and public engagement in so...
Open Government Data for transparency, innovation and public engagement in so...Open Government Data for transparency, innovation and public engagement in so...
Open Government Data for transparency, innovation and public engagement in so...Samos2019Summit
 
The Internet of Things: Exploring revenue generating use cases
The Internet of Things: Exploring revenue generating use casesThe Internet of Things: Exploring revenue generating use cases
The Internet of Things: Exploring revenue generating use casesDeloitte United States
 
OGD - Jeff Walpole
OGD - Jeff WalpoleOGD - Jeff Walpole
OGD - Jeff WalpoleAcquia
 

Semelhante a What Is Open Data? CODEONE 2018 Explained (20)

Von Open Data zu Linked Open Data, M. Kaltenböck, SWC
Von Open Data zu Linked Open Data, M. Kaltenböck, SWCVon Open Data zu Linked Open Data, M. Kaltenböck, SWC
Von Open Data zu Linked Open Data, M. Kaltenböck, SWC
 
How open is public data agi 2011-13
How open is public data agi 2011-13How open is public data agi 2011-13
How open is public data agi 2011-13
 
SoBigData. European Research Infrastructure for Big Data and Social Mining
SoBigData. European Research Infrastructure for Big Data and Social MiningSoBigData. European Research Infrastructure for Big Data and Social Mining
SoBigData. European Research Infrastructure for Big Data and Social Mining
 
ODI Node Vienna: Best Practise Beispiele für: Open Innovation mittels Open Data
ODI Node Vienna: Best Practise Beispiele für: Open Innovation mittels Open DataODI Node Vienna: Best Practise Beispiele für: Open Innovation mittels Open Data
ODI Node Vienna: Best Practise Beispiele für: Open Innovation mittels Open Data
 
Local Open Data: a perspective from local government in England 2014
Local Open Data: a perspective from local government in England 2014Local Open Data: a perspective from local government in England 2014
Local Open Data: a perspective from local government in England 2014
 
Local Open Data: A perspective from local government in England by Gesche Schmid
Local Open Data: A perspective from local government in England by Gesche SchmidLocal Open Data: A perspective from local government in England by Gesche Schmid
Local Open Data: A perspective from local government in England by Gesche Schmid
 
Martin Howitt on Open Data at Exeter Web Feb 2016
Martin Howitt on Open Data at Exeter Web Feb 2016Martin Howitt on Open Data at Exeter Web Feb 2016
Martin Howitt on Open Data at Exeter Web Feb 2016
 
Ethiopian Open Government Data Initiative
Ethiopian Open Government Data InitiativeEthiopian Open Government Data Initiative
Ethiopian Open Government Data Initiative
 
Open data 4 startups (2°edition)
Open data 4 startups (2°edition)Open data 4 startups (2°edition)
Open data 4 startups (2°edition)
 
Open Data in Half a Day
Open Data in Half a DayOpen Data in Half a Day
Open Data in Half a Day
 
Open Smart Cities in Canada - Webinar 2 - English
Open Smart Cities in Canada - Webinar 2 - EnglishOpen Smart Cities in Canada - Webinar 2 - English
Open Smart Cities in Canada - Webinar 2 - English
 
Benchmarking open data
Benchmarking open dataBenchmarking open data
Benchmarking open data
 
Tim willoughby
Tim willoughbyTim willoughby
Tim willoughby
 
150323 lesson learned in open gov. initiative
150323 lesson learned in open gov. initiative150323 lesson learned in open gov. initiative
150323 lesson learned in open gov. initiative
 
[DevDay2019] Internet of Things- By: Dr. Anand Nayyar at Duy Tan University
[DevDay2019] Internet of Things- By: Dr. Anand Nayyar at Duy Tan University[DevDay2019] Internet of Things- By: Dr. Anand Nayyar at Duy Tan University
[DevDay2019] Internet of Things- By: Dr. Anand Nayyar at Duy Tan University
 
Aligning stakeholders' perspectives in Open Government Data Community
Aligning stakeholders' perspectives in Open Government Data CommunityAligning stakeholders' perspectives in Open Government Data Community
Aligning stakeholders' perspectives in Open Government Data Community
 
Open Smart Cities in Canada: Webinar 2
Open Smart Cities in Canada: Webinar 2Open Smart Cities in Canada: Webinar 2
Open Smart Cities in Canada: Webinar 2
 
Open Government Data for transparency, innovation and public engagement in so...
Open Government Data for transparency, innovation and public engagement in so...Open Government Data for transparency, innovation and public engagement in so...
Open Government Data for transparency, innovation and public engagement in so...
 
The Internet of Things: Exploring revenue generating use cases
The Internet of Things: Exploring revenue generating use casesThe Internet of Things: Exploring revenue generating use cases
The Internet of Things: Exploring revenue generating use cases
 
OGD - Jeff Walpole
OGD - Jeff WalpoleOGD - Jeff Walpole
OGD - Jeff Walpole
 

Mais de Scott Sosna

Demonolithing The Monolith? Bullocks!
Demonolithing The Monolith?  Bullocks!Demonolithing The Monolith?  Bullocks!
Demonolithing The Monolith? Bullocks!Scott Sosna
 
Visualizing Open Data with Neo4J
Visualizing Open Data with Neo4JVisualizing Open Data with Neo4J
Visualizing Open Data with Neo4JScott Sosna
 
Devoxx uk 2019 digital jukebox
Devoxx uk 2019 digital jukeboxDevoxx uk 2019 digital jukebox
Devoxx uk 2019 digital jukeboxScott Sosna
 
DubJug: Neo4J and Open Data
DubJug: Neo4J and Open DataDubJug: Neo4J and Open Data
DubJug: Neo4J and Open DataScott Sosna
 
Visualizing Open Data Using Neo4J (Full)
Visualizing Open Data Using Neo4J (Full)Visualizing Open Data Using Neo4J (Full)
Visualizing Open Data Using Neo4J (Full)Scott Sosna
 
Visualizing Open Data Using Neo4J
Visualizing Open Data Using Neo4JVisualizing Open Data Using Neo4J
Visualizing Open Data Using Neo4JScott Sosna
 

Mais de Scott Sosna (6)

Demonolithing The Monolith? Bullocks!
Demonolithing The Monolith?  Bullocks!Demonolithing The Monolith?  Bullocks!
Demonolithing The Monolith? Bullocks!
 
Visualizing Open Data with Neo4J
Visualizing Open Data with Neo4JVisualizing Open Data with Neo4J
Visualizing Open Data with Neo4J
 
Devoxx uk 2019 digital jukebox
Devoxx uk 2019 digital jukeboxDevoxx uk 2019 digital jukebox
Devoxx uk 2019 digital jukebox
 
DubJug: Neo4J and Open Data
DubJug: Neo4J and Open DataDubJug: Neo4J and Open Data
DubJug: Neo4J and Open Data
 
Visualizing Open Data Using Neo4J (Full)
Visualizing Open Data Using Neo4J (Full)Visualizing Open Data Using Neo4J (Full)
Visualizing Open Data Using Neo4J (Full)
 
Visualizing Open Data Using Neo4J
Visualizing Open Data Using Neo4JVisualizing Open Data Using Neo4J
Visualizing Open Data Using Neo4J
 

Último

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGSujit Pal
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 

Último (20)

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAG
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 

What Is Open Data? CODEONE 2018 Explained

  • 1. What Is Open Data? CODEONE 2018
  • 2. …so what are we talking about…  Introductions  Do You Open Data?  Defining Open Data  How Do I Participate?  Q&A
  • 3. Who Am I? • Architect @ Dell Technologies since 2011 • From St. Paul, MN • Longtime Software Engineer/Architect • Business and Software Shops • Individual Contributor and Leadership Roles • All phases from project conception to implementation • Sideline projects at home • Music Lover • 10+ years online radio station of personal music • Contact Info • Email: scott [dot] sosna [@] buddhadata [dot] com • LinkedIn: https://www.linkedin.com/in/scott-sosna • Slideshare: https://www.slideshare.net/ScottSosna
  • 5. Citymapper  Initially for buses in London  Creator struggled getting from point-to-point in London  Now Supports 39 major world cities  Released 2012 (iOS), 2013 (Android)  Early adopter of TfL real-time Bus/Tube APIs  Live bus travel data saves as much as £58 million a year, by helping Londoners and the city’s many visitors plan better routes and avoid long waits at bus stops.  Center for Public Impact, March 2016
  • 6. Zillow  Integrates real estate data with other public data sources to provide nuanced view for consumers, buyers and sellers  Data available but difficult to access for average person  Levels playing field for buyers/sellers/builders, allows informed decisions  Open Data includes  Property valuations/taxes and real estate transactions  US Census information  Local crime statistics
  • 7. Flight Aware  All aspects of Aviation  Global Flight Tracking  Live Flight Data  Airport Delays  Airport Flight Information Displays  Weather Maps  Flight Planning  Government Data Sources  Federal Aviation Administration
  • 8. Charles Schwab  Financial Services  Investing  Wealth management  Banking  Trading  Real-time (almost) market information  Historical market and economic indicators  Government Data Sources  Department of the Treasury  Securities and Exchange Commission
  • 9. Do You Open Data? …THE ANSWER IS YES!
  • 10. Quote Data in a precious thing and will last longer than the systems themselves – Tim Berners-Lee
  • 12. Definitions  Open data is data that can be freely used, shared, and built-on by anyone, anywhere, for any purpose. Open Knowledge International  Open data is data that can be freely used, re-used, and redistributed by anyone – subject only, at most, to the requirement to attribute and share alike. Open Data Handbook  Open data is the idea that some data should be freely available to everyone to use and republish as they wish, with restrictions from copyright, patents or other mechanisms of control. Wikipedia  Daten öffentlich, frei verfügbar und nutzbar zu machen für mehr Transparenz, Innovation und Effizienz — das ist Open Data. Open Data Switzerland
  • 13. Open Data Essentials  Legally Open  Published data must be placed in the public domain or under liberal terms of use with minimal restrictions  Technically Open  Published data must be in electronic formats that are machine readable and preferably non-proprietary, so that anyone can access and use the data using common, freely available software tools. Data must be publicly available and accessible on a public server, without password or firewall restrictions
  • 14. Open Data Guidelines and Principles  Completeness  Primacy  Timeliness  Ease of Physical and Electronic Access  Technically Open  Machine Readable  Technically Open  Non-discrimination  Legally Open  Commonly owned or open standard  Technically Open  Licensing  Legally Open  Permanence  Usage Costs
  • 15. Using Open Data Access Methods  File downloads  Synchronous API Calls  RESTful  SOAP  Asynchronous  File copies  emails Example Data Formats  XML  JSON  CSV  XSL/XSLV (spreadsheets)  PDF  RDF (Resource Description Framework)  GeoJSON  OpenDocument  HTML
  • 16. …and the exceptions…  Personally-Identifiable Data  Health Records  Financial Information  Legal Proceedings  Government  Proceedings, pending legal, negotiating positions, etc.  Materials subject to copyright, patent, trademark, confidentiality, trade secrets  Employee records, internal directories, IT system info, proprietary applications  Undue financial/administrative burden
  • 17. Open Data  Open Government?  Maybe, Maybe Not…  http://myeinsteinjob.blogspot.com/2014/03/the-difference-between-open- government.html  https://www.opengovpartnership.org/theme/open-data  http://blogs.worldbank.org/ic4d/differences-between-open-government-data-and- open-government-data  https://medium.com/@digidickinson/whats-the-difference-between-open-data-and- open-government-data-8a28eb525d2a
  • 18. What Can I Find?
  • 19. Open Data Categories • Agriculture • Climate • Consumer • Crime and Justice • Defense • Ecosystems • Education • Energy • Environment • Finance • Government Spending • Health • Housing • Intellectual Property • Labor and Wages • Manufacturing • Maritime • Ocean • Pollution • Public Safety • Science & Research • Society • Transport
  • 20. Global Open Data Index  Global Open Data Index  Scores countries on their Open Data initiatives
  • 21. Open Data Census By City  United States Cities  Australian Cities  Canadian Cities  Germany Cities  Index of Places
  • 22. Demos  Transport for London  National Institute of Health  Gene, search human AFF  Pollution  Honk Kong, air quality, download data from lower right  Finance
  • 23. What Can I Find? ALMOST ANYTHING
  • 24. Problems With Open Data  Too Little Data  Many countries collect but don’t publish their data (Open Data Barometer)  Too Much Data  2600+ Open Data portals world-wide  Costs to collect, to publish, to share, to maintain, to standardize, to process feedback, etc  Usage Fees  Data Quality
  • 26. Quote The goal is to turn data into information, and information into insight. – Carly Fiorina
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 32.
  • 34.
  • 35.
  • 37. Q&A
  • 38. Links and References  Open Knowledge International  Open Data Handbook  Open Data 500 Global Network  Centre for Public Impact  California Public Records Act (1968)  California Public Records Act (2004)  Crowd-sourced Open Data
  • 39. Open Data Example Usage  Charles Schwab  CityMapper  Councilmatic  CrashMap UK  Data Machen Schule  FlightAware  New York Times  Open Railway Map  Open Street Map  Safe Eats  Transport for London  Zillow

Notas do Editor

  1. https://www.centreforpublicimpact.org/case-study/public-transport-london/
  2. http://www.esa.doc.gov/under-secretary-blog/open-data-impact-how-zillow-uses-open-data-level-playing-field-consumers https://www.zillow.com/resources/new-construction/brown-haven-homes/
  3. http://www.opendata500.com/us/flightaware/
  4. http://www.opendata500.com/us/charles-schwab-corp/
  5. California Public Records Act (1968): “This definition is intended to cover every conceivable kind of record that is involved in the governmental process and will pertain to any new form of record-keeping instrument as it is developed. Only purely personal information unrelated to 'the conduct of the public's business' could be considered exempt from this definition, i.e., the shopping list phoned from home, the letter to a public officer from a friend which is totally void of reference to governmental activities.” US Post Office Zip Codes
  6. http://opendatatoolkit.worldbank.org/en/essentials.html
  7. https://sunlightfoundation.com/policy/documents/ten-open-data-principles/ https://chhsdata.github.io/opendatahandbook/ https://data.gov.in/sites/default/files/NDSAP_Implementation_Guidelines_2.2.pdf
  8. https://reinventalbany.org/2017/03/how-nycs-open-data-law-defines-public-data/
  9. https://gcn.com/articles/2017/08/01/the-hidden-costs-of-open-data.aspx https://www.nature.com/articles/d41586-018-04874-y http://www.governing.com/columns/tech-talk/gov-open-data-cost-problems.html https://qz.com/1278239/the-us-government-wants-to-start-charging-for-landsat-the-best-free-satellite-data-on-earth/
  10. Data The data on this website comes from the Chicago City Council legislation site, a system built by Granicus using their Legistar Legislative Management Suite. The Office of the City Clerkmanages the data, and on Councilmatic, each piece of legislation provides a link to its source for reference. Daily, DataMade collects data from Legistar and the Legistar Web API, which we store using the Open Civic Data standard and platform. Built in collaboration with The Sunlight Foundation, Google, Granicus, and Open North, Open Civic Data standardizes information about people, organizations, events, and bills at any level of government. Anyone can use the OCD API! This searchable government-transparency tool contains several useful endpoints: bills: legislation introduced to City Council and their status and sponsors events: past and upcoming Council and Committee meetings people: the 50 Aldermen of Chicago and their Committee affiliations organizations: groups of Aldermen who consider and debate legislation votes: decisions made by specific Aldermen on bills
  11. https://www.europeandataportal.eu/en/highlights/open-data-schools A further example comes from Germany where a collaborative Open Data school project was launched in Moers. In Moers, a town with approximately 100,000 inhabitants in Germany’s federal state of North Rhine-Westphalia, the local administration and the Open Knowledge Foundation set out to explore the potential of Open Data in the classroom. The project -- DatenmachenSchule – aims to help develop of a series of software applications, together with the Adolfinum Gymnasium and the students of the Rhine-Whaal University of Applied Sciences. Like the Northern Irish project, the idea here as well is to make school lessons more interactive by employing Open Data.
  12. Safe Eats