Linked Open Data for Libraries

1. Linked Open Data for libraries Lukas Koster Library Systems Coordinator Library of the University of Amsterdam http://www.uba.uva.nl @lukask NVB 2011, 17 november 2011

2. http://www.loc.gov/marc/transition/news/framework-103111.html

3. Agenda <ul><li>Open data </li></ul><ul><li>Linked data </li></ul><ul><li>Linked Open Data and Libraries </li></ul><ul><li>Options for libraries </li></ul><ul><li>Recommendations </li></ul>

4. Open data: 5 stars (Tim Berners-Lee) Data: no stars Open Data: 1 star - O pen L icence Open Data: 2 stars - Re usable Open Data: 3 stars - O pen F ormat Linked Open Data: 4 stars - URI 's Linked Open Data: 5 stars - L inked D ata

5. Linked data: 4 rules (Tim Berners-Lee) <ul><li>Use URIs as names for things </li></ul><ul><li>Use HTTP URIs so that people can look up those names. </li></ul><ul><li>When someone looks up a URI, provide useful information, using the standards (RDF, SPARQL) </li></ul><ul><li>Include links to other URIs, so that they can discover more things. </li></ul>http://www.w3.org/DesignIssues/LinkedData.html

6. RDF URI Triple Ontology Vocabulary

7. URIs <ul><li>Unique identifiers on the web </li></ul><ul><li>Instead of internal database primary key </li></ul><ul><li>http://viaf.org/viaf/102403515 (Dan Brown) </li></ul><ul><li>http://openlibrary.org/works/OL76837W (The Da Vinci Code) </li></ul>

8. Relational databases: primary keys Primary key Primary key Foreign key Books Title Author Year ID Authors Name Year ID Authors record Dan Brown 1964 456 ID Name Year The Da Vinci Code Books record 456 2003 1289 Title ID Author Year

9. Relational databases and applications Select title, year from books Select name, year from authors where books.author=authors.id Database Application User interface SQL Title : The Da Vinci Code Author : Dan Brown, 1964 Year : 2003 Authors record Dan Brown 1964 456 ID Name Year The Da Vinci Code Books record 456 2003 1289 Title ID Author Year

10. URIs Primary key Primary key Foreign key OpenLibrary Title Author Year URI VIAF Name Year URI Authors record Dan Brown 1964 http://viaf.org/viaf/102403515 URI Name Year The Da Vinci Code Books record http://viaf.org/viaf/102403515 2003 http://openlibrary.org/works/OL76837W Title URI Author Year

11. Linked data and applications Select ?title ?year … Select ?name ?year WHERE ….. Database Application User interface SPARQL Title : The Da Vinci Code Author : Dan Brown, 1964 Year : 2003 Authors record Dan Brown 1964 http://viaf.org/viaf/102403515 URI Name Year The Da Vinci Code Books record http://viaf.org/viaf/102403515 2003 http://openlibrary.org/works/OL76837W Title URI Author Year

12. Triples <ul><li>Subject - Predicate – Object </li></ul><ul><li>Thing – Relation - Thing </li></ul>written by painted by is about author of painter of is subject of uri uri uri uri uri uri

13. Triples and URIs <ul><li>URIs for: </li></ul><ul><li>Subject </li></ul><ul><li>Object </li></ul><ul><li>Relation </li></ul>uri uri uri http://viaf.org/viaf/102403515 http://openlibrary.org/works/OL76837W http://purl.org/dc/terms/creator

14. RDF – Resource Description Framework <ul><li>Used for defining ontologies/vocabularies </li></ul><ul><li>Data model ( what can be described ) </li></ul><ul><ul><li>Classes (types), attributes, relations </li></ul></ul><ul><li>Used for describing triples </li></ul><ul><li>Data ( what is described ) </li></ul><ul><ul><li>Objects, attribute values, relations </li></ul></ul>

15. <ul><li>Description: http://bibliontology.com </li></ul><ul><li>Namespace: http:// purl.org/ontology/bibo/ </li></ul>

16. BIBO - Bibliographic Ontology <ul><li>xml:base="http://purl.org/ontology/bibo/" </li></ul><ul><li>xmlns:owl2xml="http://www.w3.org/2006/12/owl2-xml#" </li></ul><ul><li>xmlns:terms="http://purl.org/dc/terms/" </li></ul><ul><li>xmlns:xsd="http://www.w3.org/2001/XMLSchema#" </li></ul><ul><li>xmlns:status="&bibo;status/" </li></ul><ul><li>xmlns:vann="http://purl.org/vocab/vann/" </li></ul><ul><li>xmlns:schema="http://schemas.talis.com/2005/address/schema#" </li></ul><ul><li>xmlns:rdfs="http://www.w3.org/2000/01/rdf-schema#" </li></ul><ul><li>xmlns:foaf="http://xmlns.com/foaf/0.1/" </li></ul><ul><li>xmlns:prism="http://prismstandard.org/namespaces/1.2/basic/" </li></ul><ul><li>xmlns:owl="http://www.w3.org/2002/07/owl#" </li></ul><ul><li>xmlns:skos="http://www.w3.org/2004/02/skos/core#" </li></ul><ul><li>xmlns:event="http://purl.org/NET/c4dm/event.owl#" </li></ul><ul><li>xmlns:ns="http://www.w3.org/2003/06/sw-vocab-status/ns#" </li></ul><ul><li>xmlns:degrees="&bibo;degrees/" </li></ul><ul><li>xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" </li></ul><ul><li>xmlns:bibo="http://purl.org/ontology/bibo/"> </li></ul>Ontologies used Dublin Core - Metadata FOAF - People SKOS – Thesaurus, Subjects

17. BIBO - Bibliographic Ontology <ul><li> </li></ul><ul><li><owl:Class rdf:about="Book"> </li></ul><ul><li><rdfs:label xml:lang="en">Book</rdfs:label> </li></ul><ul><li><rdfs:subClassOf rdf:resource="Document"/> </li></ul><ul><li><rdfs:isDefinedBy rdf:datatype="&xsd;anyURI" </li></ul><ul><li>>http://purl.org/ontology/bibo/</rdfs:isDefinedBy> </li></ul><ul><li><ns:term_status>stable</ns:term_status> </li></ul><ul><li><rdfs:comment xml:lang="en">A written or printed work of fiction or nonfiction, usually on sheets of paper fastened or bound together within covers. </li></ul><ul><li></rdfs:comment> </li></ul><ul><li></owl:Class> </li></ul>Class/Object type

18. BIBO - Bibliographic Ontology <ul><li><urn:isbn:0385504209> a bibo:Book ; dc:creator <http://viaf.org/viaf/102403515> ; dc:title “The Da Vinci Code"@en ; dc:date "2003“ </li></ul>Book example

19. OpenLibrary.org: RDF Subjects as string values <ul><li><dcterms:subject>Fiction</dcterms:subject> </li></ul><ul><li><dcterms:subject>Cryptographers</dcterms:subject> </li></ul><ul><li><dcterms:subject>Grail</dcterms:subject> </li></ul><ul><li><dcterms:subject>Secret societies</dcterms:subject> </li></ul><ul><li><dcterms:subject>Art museum curators</dcterms:subject> </li></ul><ul><li><dcterms:subject>Manuscripts</dcterms:subject> </li></ul><ul><li><dcterms:subject>Appreciation</dcterms:subject> </li></ul><ul><li><dcterms:subject>Crimes against</dcterms:subject> </li></ul><ul><li><dcterms:subject>Romans</dcterms:subject> </li></ul><ul><li><dcterms:subject>Aventures</dcterms:subject> </li></ul><ul><li><dcterms:subject>Suspense fiction</dcterms:subject> </li></ul><ul><li><dcterms:subject>Religious articles</dcterms:subject> </li></ul><ul><li><dcterms:subject>Occultisme</dcterms:subject> </li></ul><ul><li><dcterms:subject>Accessible book</dcterms:subject> </li></ul><ul><li><dcterms:subject>Protected DAISY</dcterms:subject> </li></ul>

20. Subjects as URIs <ul><li><dcterms:subject> </li></ul><ul><li>http://dbpedia.org/resource/The_Last_Supper_%28Leonardo_da_Vinci%29 </li></ul><ul><li></dcterms:subject> </li></ul><ul><li><dcterms:subject> </li></ul><ul><li>http://id.loc.gov/authorities/names/n98088614 </li></ul><ul><li></dcterms:subject> </li></ul>

21. DBPedia (WikiPedia)

22. LoC

23. Two sides Publish Consume

24. Summary: Linked Open Data The web as global database/web of data RDF as universal API Applications using global data via RDF WWW

25. Original objective of libraries <ul><li>Gateways to information </li></ul><ul><li>Printed material </li></ul><ul><li>Physical objects </li></ul><ul><li>On location </li></ul>Bibliotheken en leeszalen in beeld, 1990

26. Changing information world WWW http://www.flickr.com/photos/elenaromera/353826561/ http://www.flickr.com/photos/simona_/4068354970/

27. Changing role for libraries Reference desk Content curation Information gateway

28. Linked data options for libraries <ul><li>Consume </li></ul><ul><ul><li>Traditional cataloguing </li></ul></ul><ul><ul><li>Enrichment of existing catalogue data </li></ul></ul><ul><ul><li>Create new information aggregates (new!) </li></ul></ul><ul><li>Publish (unique stuff) </li></ul><ul><ul><li>Holdings/usage data </li></ul></ul><ul><ul><li>Special collections </li></ul></ul>

29. Linked data options for libraries <ul><ul><li>Traditional cataloguing </li></ul></ul>

30. Links as text strings Links to internal records

31. RDA <ul><li>Resource Description and Access </li></ul>

32. FRBR F unctional R equirements for B ibliographic R ecords Defined in relation to tasks performed by users when searching and making use of national bibliographies and library catalogues http://archive.ifla.org/VII/s13/frbr/frbr_current2.htm#2.2

33. FRBR User Tasks <ul><li>Find </li></ul><ul><li>Identify </li></ul><ul><li>Select </li></ul><ul><li>Obtain </li></ul><ul><li>Navigate </li></ul>

34. FRBR <ul><li>Group 1: What? W ork E xpression M anifestation I tem </li></ul><ul><li>Group 2: By who? P erson C orporate Body </li></ul><ul><ul><li>FRAD Functional Requirements for Authority Data </li></ul></ul><ul><li>Group 3: About what? C oncept O bject E vent P lace </li></ul><ul><ul><li>FRSAD Functional Requirements for Subject Authority Data </li></ul></ul><ul><ul><li>Title – Author - Subject </li></ul></ul>http://archive.ifla.org/VII/s13/frbr/frbr_current2.htm#2.2

35. http://www.loc.gov/cds/downloads/FRBR.PDF © Library of Congress/Barbara Tillett

36. FRBR for books Editions Copies Original Adaptation Translation

37. FRBR Group 1 Entities - WEMI Manifestation Item Work Expression Catalogue Missing links

38. Triples written by painted by is about author of painter of is subject of uri uri uri uri uri uri

39. LOD, FRBR and cataloguing written by painted by author of painter of is subject of http://permalink.opc.uva.nl/item/001665446 is about Manifestation Item Work Expression http://viaf.org/viaf/102403515 Dan Brown http://openlibrary.org/works/OL76837W The Da Vinci Code http://viaf.org/viaf/24604287 Leonardo da Vinci http://id.loc.gov/authorities/names/n98088614 The Last Supper Dutch translation De Da Vinci Code Holding OBA http://www.worldcat.org/libraries/57394 http://<expression-uri> http://<manifestation-uri> Library

40. Work Expression Manifestation http://openlibrary.org/works/OL76837W URI 650 $a 100 $a 245 $a http://en.wikipedia.org/wiki/The_Last_Supper_(Leonardo_da_Vinci) Subject http ://viaf.org/viaf/102403515 Author The Da Vinci Code Original Title http://<expression-uri> URI 245 $a De Da Vinci Code Title 546 $a dut (or: URI to language code) Language http://openlibrary.org/works/OL76837W Work 260 $c 2006 Date 260 $b http://isbndb.com/d/publisher/anchor_books.html Publisher http://<expression-uri> Expression http://<manifestation-uri> URI

41. Work Expression Manifestation Holding Item(s) Global shared bibliographic data Local holdings data http://openlibrary.org/works/OL76837W URI http://<expression-uri> URI http://openlibrary.org/works/OL76837W Work http://<expression-uri> Expression http://<manifestation-uri> URI http://<holding-uri> URI http://<manifestation-uri> Manifestation http://www.worldcat.org/libraries/57394 Library Availability http://<holding-uri> Holding http://<item-uri> URI WWW

42. Manifestation Item Work Expression FRBR Group 1 FRBR Group 2 FRAD FRBR Group 3 FRSAD Holding Publishers Libraries

43. Problems - challenges <ul><li>Existing circumstances not suited for moving to Linked Cataloguing - RDA/FRBR/LOD: </li></ul><ul><li>Database - Bibliographic formats (MARC) </li></ul><ul><li>Applications - Local library systems </li></ul>

44. Linked Cataloguing - What’s needed <ul><li>Global Shared Bibliographic Metadata Store(s) </li></ul><ul><li>Global Shared Authority Files </li></ul><ul><li>Open Cataloguing systems </li></ul><ul><li>Supporting for linking with URIs </li></ul>

45. Linked data options for libraries <ul><ul><li>Enrichment of existing data </li></ul></ul>

46. FRBR Links

47. http://search.obvsg.at/OBV FRBR

48. http://search.obvsg.at/OBV Text about author Embedded from DBPedia (Wikipedia Linked Data engine) Uses German National Library Author ID’s

49. Enrichment - Discovery front ends <ul><li>Examples use Discovery front ends </li></ul><ul><li>Extra layer on top of processed catalogue metadata </li></ul><ul><li>Metadata are FRBRised, based on string matching </li></ul><ul><li>Linked data embedded using scripts/programming, manipulating HTML front end </li></ul>

50. Example: Pilot project Linking library catalogue data to theatre performance data Dutch Digital Cultural Heritage Foundation DEN as instigator http://den.nl/ Library of the University of Amsterdam Theatre Institute of The Netherlands http://tin.nl/ http://www.uba.uva.nl/

51. Library catalogue results No FRBR here ( yet )

52. Library catalogue results

53. TIN theatre production database

54. TIN theatre production database

55. What we made

56. How we did it - URIs < base-url >/person/Beckett, Samuel < base-url >/title/Beckett, Samuel/Waiting for Godot JavaScript/JQuery HTML

57. How we did it – JavaScript/JQuery < base-url >/person/Beckett, Samuel < base-url >/title/Beckett, Samuel/Waiting for Godot <base-url>/ production/Beckett, Samuel/Waiting for Godot/1988-11-22/6750

58. Problems/challenges <ul><li>No common identifiers </li></ul><ul><ul><li>Aleph key ≠ key </li></ul></ul><ul><li>No internal links to common entity </li></ul><ul><ul><li>No central “ Work ” </li></ul></ul><ul><li>String matching </li></ul><ul><ul><li>Author: ‘ Samuel Beckett ’- ‘ Beckett, Samuel ’ </li></ul></ul><ul><ul><li>Title: ‘ Waiting for Godot ’ – ’En attendant Godot ’ </li></ul></ul><ul><li>Copyright </li></ul><ul><ul><li>Photos, videos, audio, artwork </li></ul></ul>

59. Identifiers/URIs/String matching /title/Beckett, Samuel/Waiting for Godot /title/Beckett, Samuel/Waiting for Godot : a tragicomedy in two acts /title/Beckett, Samuel/En attendant Godot : pièce en deux actes /title/Beckett, Samuel/Wachten op Godot /title/Beckett, Samuel/Waiting for Godot /title/Beckett, Samuel/Waiting For Godot /title/Beckett, Samuel/Wachten op Godot /title/Beckett, Samuel/Wachtend op Godot /title/Beckett, Samuel/Wachten op Godot (De favorieten) /title/Beckett, Samuel/Wachten op Godot (eerste bedrijf) /title/Beckett, Samuel/En attendant Godot /title/Beckett, Samuel/Warten auf Godot

60. Ideally…. FRBR

61. Current situation Implicit relations

62. Enrichment - What’s needed <ul><li>New search type: linked data search </li></ul><ul><li>Mechanisms for consuming external linked data sources </li></ul><ul><li>Options to identify trustworthy LOD sources </li></ul><ul><li>Automatic retrieval and processing of RDF vocabularies </li></ul>

63. Linked data options for libraries <ul><ul><li>Create new information aggregates </li></ul></ul>

64. Subject: Anne Frank The girl The war The house The diary The book The movie The play About Library catalogue FRBR

65. New aggregations http://www.annefrank.org/en/Subsites/Timeline/#

66. LOCAH – Linking Lives Linked Open Copac Archives Hub http://blogs.ukoln.ac.uk/locah/ http://data.archiveshub.ac.uk/ Publish linked data Archives+libraries Using Linked Data to create biographical resources http://archiveshub.ac.uk/linkinglives

67. New Aggregates - What’s needed <ul><li>Content curation </li></ul><ul><li>Cooperation </li></ul><ul><li>Technology </li></ul><ul><li>Expertise </li></ul><ul><li>New systems </li></ul>

68. Linked data options for libraries <ul><ul><li>Publishing </li></ul></ul>

69. Publishing linked data <ul><li>RDF : </li></ul><ul><li>Ontology </li></ul><ul><ul><li>Ontologies (re)used (namespaces) </li></ul></ul><ul><ul><li>Object types, attributes, relations </li></ul></ul><ul><li>Triples </li></ul><ul><ul><li>On the fly </li></ul></ul><ul><ul><li>Triple store </li></ul></ul>

70. Publishing library data as linked data <ul><li>Bibliographic information: </li></ul><ul><ul><li>FRBR Work/Expression/Manifestation </li></ul></ul><ul><ul><li>FRAD Authors/Creators </li></ul></ul><ul><ul><li>FRSAD Subjects </li></ul></ul>Ideally only once, no redundancy LoC New Bibliographic Framework Not unique Publishers

71. Publishing library data as linked data <ul><li>Holdings information: </li></ul><ul><ul><li>Holdings per library </li></ul></ul><ul><ul><li>FRBR Items </li></ul></ul><ul><li>Usage data </li></ul>Unique Approved

72. Publishing library data as linked data <ul><li>Special collections </li></ul><ul><li>= </li></ul><ul><li>Cultural heritage </li></ul><ul><li>Archives </li></ul><ul><li>Museums </li></ul>Unique Approved

73. Publishing - What’s needed <ul><li>System development skills/staff </li></ul><ul><li>Linked Data features added to existing library systems </li></ul><ul><li>New generic linked data information systems, tools, online services </li></ul>

74. Recommendations <ul><li>Cooperate! </li></ul><ul><ul><li>Libraries, Archives, Museums </li></ul></ul><ul><ul><li>Consortia </li></ul></ul><ul><li>Ask library systems vendors to adapt (next gen) systems: </li></ul><ul><ul><li>FRBR/RDA/Linking architecture/infrastructure </li></ul></ul><ul><ul><li>LOD/RDF/URI Publishing options </li></ul></ul><ul><ul><li>LOD/RDF/URI Consuming options </li></ul></ul>

75. Existing library system vendors adding publishing options authority files - VIAF working with user group http://igelu.org/special-interests/lod

76. Linked Open Data: Systems and tools <ul><li>Develop your own systems/open source </li></ul><ul><li>Use existing commercial systems </li></ul><ul><li>Consortia infrastructures </li></ul><ul><li>National platforms </li></ul><ul><li>Use free tools </li></ul>

77. http://kasabi.com/

78. http://dydra.com/

79. http://revyu.com/

80. http://virtuoso.openlinksw.com/

81. http://metadataregistry.org/

82. http://thedatahub.org/

83. Library Linked Data documentation <ul><li>W3C Library Linked Data Incubator Group, </li></ul><ul><ul><li>Report: http://www.w3.org/2005/Incubator/lld/XGR-lld-20111025/ </li></ul></ul><ul><li>IGeLU 2011 session Linked Data and Ex Libris products, </li></ul><ul><ul><li>Summary slides: http://igelu.org/wp-content/uploads/2011/09/Linked-data-and-Ex-Libris-products-Summary.pdf </li></ul></ul><ul><li>Tutorial publishing linked open data by DEN: </li></ul><ul><ul><li>http://www.den.nl/pagina/334/den-lab/ </li></ul></ul>