SlideShare uma empresa Scribd logo
1 de 33
Fluor: Your connection to the Fedora Digital Objects Repository Roland Groen, Edia
Overview Project goals & drivers History of the project Short walkthrough Overall Architecture The features of the fluor tool Setting up a collection Project Status 12th Sakai Conference – Los Angeles, California – June 14-16 2
Project Goals Make researchers share research data in a controlled community Integrate Sakai with the Fedora Content Repository Support searching and browsing Support different access models Open vs. closed 12th Sakai Conference – Los Angeles, California – June 14-16 3
Project Drivers UvALibrary: make researchers aware of the importance of sharing data Making research data publically available becomes more and more a requirement than a wish Publishing: Support publications by disseminate the underlying research data Teaching: have students work with actual research data 12th Sakai Conference – Los Angeles, California – June 14-16 4
A bit of history And now... 12th Sakai Conference – Los Angeles, California – June 14-16 5
Project history: testweeklab ‘Testweeklab’ project (2008) Work with 40 years of privacy sensitive research data Strong security requirements Only metadata (publically) accessible Complicated access procedure for accessing the actual data Very specific metadata schema, search and browse requirements Very specific fields (year, N, type of test, scale) Build as Sakai tool for connecting to a Fedora repository 12th Sakai Conference – Los Angeles, California – June 14-16 6
Project history: next steps Findings from testweeklab User Interaction improvements Configurability Support more types of usage Make the tool flexible to support different collections and types of use Make the access model flexible Support personalization 12th Sakai Conference – Los Angeles, California – June 14-16 7
A short functional walkthrough And now… 12th Sakai Conference – Los Angeles, California – June 14-16 8
Searching 12th Sakai Conference – Los Angeles, California – June 14-16 9
Browsing 12th Sakai Conference – Los Angeles, California – June 14-16 10
My Items 12th Sakai Conference – Los Angeles, California – June 14-16 11
Upload 12th Sakai Conference – Los Angeles, California – June 14-16 12
The overview of the architecture And now... 12th Sakai Conference – Los Angeles, California – June 14-16 13
Overall architecture 12th Sakai Conference – Los Angeles, California – June 14-16 14
Overall architecture: components Fedora: act as a content repository. Generic search: do the updates and transformations to Solr Solr: indexing, provide a search and browse interface Sakai FLUOR tool: create a UI for researchers to work with 12th Sakai Conference – Los Angeles, California – June 14-16 15
Fedora Content repository Content managed as data objects Unique identifier: PID Metadata Datastreams Relation between objects Virtual datastreams Versioning, logging Multiple collections Objects handled as XML (FOXML) 12th Sakai Conference – Los Angeles, California – June 14-16 16
Fedora generic search Enables browsing and search with Lucene, Solr and Zebra Gets notifications about updates from Fedora and fetches the objects XSLT transforms FOXML into documents for the search engine a Rest and SOAP interface, search and browse based on SRW/SRU. 12th Sakai Conference – Los Angeles, California – June 14-16 17
Solr Search engine Build on top of Lucene Easy to deploy and configure Advanced full-text searching and indexing Open interfaces, Rest, JSON, XML Admin interfaces Plugin architecture 12th Sakai Conference – Los Angeles, California – June 14-16 18
the fluor tool And now… 12th Sakai Conference – Los Angeles, California – June 14-16 19
Fluor tool features Access research data Search and browse Access items in the repository Create favorites Upload new items Added directly depending on security model 12th Sakai Conference – Los Angeles, California – June 14-16 20
Data access security model Metadata is always accessible Access on datastreams is limited Open: no restrictions Request based: user needs to create a request, and admin reviews them.  Fluor tool features 12th Sakai Conference – Los Angeles, California – June 14-16 21
Fluor tool features 12th Sakai Conference – Los Angeles, California – June 14-16 22
Fluor tool features The access model is configurable.  Open Request based Per object configurable 12th Sakai Conference – Los Angeles, California – June 14-16 23
Fluor tool features Support for versioning Enables the download of previous versions. Configurable 12th Sakai Conference – Los Angeles, California – June 14-16 24
Fluor tool features Data encryption The ability to encrypt datastreams Backups etc. cause no threat to privacy Configurable on the datastream 12th Sakai Conference – Los Angeles, California – June 14-16 25
Setting up a repository 12th Sakai Conference – Los Angeles, California – June 14-16 26
Setting up a collection Describe the collection What datastreams are there? What metadata is there? Set up the Fedora repository Configure the Fedora datamodel Set up generic search and Solr Configure the FLUOR tool 12th Sakai Conference – Los Angeles, California – June 14-16 27
Setting up a collection 12th Sakai Conference – Los Angeles, California – June 14-16 28
The status of the project And now… 12th Sakai Conference – Los Angeles, California – June 14-16 29
Project status The project is currently being tested by targeted end-users Common UI bugs and issues Search and index has problems 12th Sakai Conference – Los Angeles, California – June 14-16 30
Solrvs. Generic search Generic search 2.2 Browse functionality broken with Solr. Does not use facet browsing, instead access lucene index on file system.  Browse not limited to collection, results polluted. Solution: Access Solr directly instead of generic search 12th Sakai Conference – Los Angeles, California – June 14-16 31
Any questions? An finally… 12th Sakai Conference – Los Angeles, California – June 14-16 32
Thank you! 12th Sakai Conference – Los Angeles, California – June 14-16 33

Mais conteúdo relacionado

Semelhante a Fluor sakai la 2011

XWiki Sakai Integration
XWiki Sakai IntegrationXWiki Sakai Integration
XWiki Sakai Integrationahocek
 
Visual Querying LOD sources with LODeX
 Visual Querying LOD sources with LODeX Visual Querying LOD sources with LODeX
Visual Querying LOD sources with LODeXFabio Benedetti
 
IFLA LIDASIG Open Session 2017: Introduction to Linked Data
IFLA LIDASIG Open Session 2017: Introduction to Linked DataIFLA LIDASIG Open Session 2017: Introduction to Linked Data
IFLA LIDASIG Open Session 2017: Introduction to Linked DataLars G. Svensson
 
Linked data presentation for libraries (COMO)
Linked data presentation for libraries (COMO)Linked data presentation for libraries (COMO)
Linked data presentation for libraries (COMO)robin fay
 
Stefano Cossu, The Art Institute of Chicago - Open Repositories 2014 presenta...
Stefano Cossu, The Art Institute of Chicago - Open Repositories 2014 presenta...Stefano Cossu, The Art Institute of Chicago - Open Repositories 2014 presenta...
Stefano Cossu, The Art Institute of Chicago - Open Repositories 2014 presenta...Stefano Cossu
 
Intro to UCSF Profiles
Intro to UCSF Profiles Intro to UCSF Profiles
Intro to UCSF Profiles lesliey
 
Charleston 2012 - The Future of Serials in a Linked Data World
Charleston 2012 - The Future of Serials in a Linked Data WorldCharleston 2012 - The Future of Serials in a Linked Data World
Charleston 2012 - The Future of Serials in a Linked Data WorldProQuest
 
Uk discovery-jisc-project-showcase
Uk discovery-jisc-project-showcaseUk discovery-jisc-project-showcase
Uk discovery-jisc-project-showcaseRDTF-Discovery
 
The Semantic Web and Libraries in the United States: Experimentation and Achi...
The Semantic Web and Libraries in the United States: Experimentation and Achi...The Semantic Web and Libraries in the United States: Experimentation and Achi...
The Semantic Web and Libraries in the United States: Experimentation and Achi...New York University
 
xldb2012_wed_0950_TimFrazier
xldb2012_wed_0950_TimFrazierxldb2012_wed_0950_TimFrazier
xldb2012_wed_0950_TimFrazierTim Frazier
 
Do the LOCAH-Motion: How to Make Bibliographic and Archival Linked Data
Do the LOCAH-Motion: How to Make Bibliographic and Archival Linked DataDo the LOCAH-Motion: How to Make Bibliographic and Archival Linked Data
Do the LOCAH-Motion: How to Make Bibliographic and Archival Linked DataAdrian Stevenson
 
LUCERO - Building the Open University Web of Linked Data
LUCERO - Building the Open University Web of Linked DataLUCERO - Building the Open University Web of Linked Data
LUCERO - Building the Open University Web of Linked DataMathieu d'Aquin
 
agINFRA work on germplasm and soil Linked Data by Luca Matteus, Giovanni L’Ab...
agINFRA work on germplasm and soil Linked Data by Luca Matteus, Giovanni L’Ab...agINFRA work on germplasm and soil Linked Data by Luca Matteus, Giovanni L’Ab...
agINFRA work on germplasm and soil Linked Data by Luca Matteus, Giovanni L’Ab...CIARD Movement
 
“Publishing and Consuming Linked Data. (Lessons learnt when using LOD in an a...
“Publishing and Consuming Linked Data. (Lessons learnt when using LOD in an a...“Publishing and Consuming Linked Data. (Lessons learnt when using LOD in an a...
“Publishing and Consuming Linked Data. (Lessons learnt when using LOD in an a...Marta Villegas
 
Presentation of LUCERO at EURECOM
Presentation of LUCERO at EURECOMPresentation of LUCERO at EURECOM
Presentation of LUCERO at EURECOMMathieu d'Aquin
 
The Digital Library Federation Aquifer Initiative
The Digital Library Federation Aquifer InitiativeThe Digital Library Federation Aquifer Initiative
The Digital Library Federation Aquifer InitiativeJenn Riley
 
Lifting the Lid on Linked Data
Lifting the Lid on Linked DataLifting the Lid on Linked Data
Lifting the Lid on Linked DataJane Stevenson
 
What do MARC, RDF, and OWL have in common?
What do MARC, RDF, and OWL have in common?What do MARC, RDF, and OWL have in common?
What do MARC, RDF, and OWL have in common?Violeta Ilik
 

Semelhante a Fluor sakai la 2011 (20)

XWiki Sakai Integration
XWiki Sakai IntegrationXWiki Sakai Integration
XWiki Sakai Integration
 
Sakai and uPortal 4
Sakai and uPortal 4Sakai and uPortal 4
Sakai and uPortal 4
 
Visual Querying LOD sources with LODeX
 Visual Querying LOD sources with LODeX Visual Querying LOD sources with LODeX
Visual Querying LOD sources with LODeX
 
UNC visit
UNC visitUNC visit
UNC visit
 
IFLA LIDASIG Open Session 2017: Introduction to Linked Data
IFLA LIDASIG Open Session 2017: Introduction to Linked DataIFLA LIDASIG Open Session 2017: Introduction to Linked Data
IFLA LIDASIG Open Session 2017: Introduction to Linked Data
 
Linked data presentation for libraries (COMO)
Linked data presentation for libraries (COMO)Linked data presentation for libraries (COMO)
Linked data presentation for libraries (COMO)
 
Stefano Cossu, The Art Institute of Chicago - Open Repositories 2014 presenta...
Stefano Cossu, The Art Institute of Chicago - Open Repositories 2014 presenta...Stefano Cossu, The Art Institute of Chicago - Open Repositories 2014 presenta...
Stefano Cossu, The Art Institute of Chicago - Open Repositories 2014 presenta...
 
Intro to UCSF Profiles
Intro to UCSF Profiles Intro to UCSF Profiles
Intro to UCSF Profiles
 
Charleston 2012 - The Future of Serials in a Linked Data World
Charleston 2012 - The Future of Serials in a Linked Data WorldCharleston 2012 - The Future of Serials in a Linked Data World
Charleston 2012 - The Future of Serials in a Linked Data World
 
Uk discovery-jisc-project-showcase
Uk discovery-jisc-project-showcaseUk discovery-jisc-project-showcase
Uk discovery-jisc-project-showcase
 
The Semantic Web and Libraries in the United States: Experimentation and Achi...
The Semantic Web and Libraries in the United States: Experimentation and Achi...The Semantic Web and Libraries in the United States: Experimentation and Achi...
The Semantic Web and Libraries in the United States: Experimentation and Achi...
 
xldb2012_wed_0950_TimFrazier
xldb2012_wed_0950_TimFrazierxldb2012_wed_0950_TimFrazier
xldb2012_wed_0950_TimFrazier
 
Do the LOCAH-Motion: How to Make Bibliographic and Archival Linked Data
Do the LOCAH-Motion: How to Make Bibliographic and Archival Linked DataDo the LOCAH-Motion: How to Make Bibliographic and Archival Linked Data
Do the LOCAH-Motion: How to Make Bibliographic and Archival Linked Data
 
LUCERO - Building the Open University Web of Linked Data
LUCERO - Building the Open University Web of Linked DataLUCERO - Building the Open University Web of Linked Data
LUCERO - Building the Open University Web of Linked Data
 
agINFRA work on germplasm and soil Linked Data by Luca Matteus, Giovanni L’Ab...
agINFRA work on germplasm and soil Linked Data by Luca Matteus, Giovanni L’Ab...agINFRA work on germplasm and soil Linked Data by Luca Matteus, Giovanni L’Ab...
agINFRA work on germplasm and soil Linked Data by Luca Matteus, Giovanni L’Ab...
 
“Publishing and Consuming Linked Data. (Lessons learnt when using LOD in an a...
“Publishing and Consuming Linked Data. (Lessons learnt when using LOD in an a...“Publishing and Consuming Linked Data. (Lessons learnt when using LOD in an a...
“Publishing and Consuming Linked Data. (Lessons learnt when using LOD in an a...
 
Presentation of LUCERO at EURECOM
Presentation of LUCERO at EURECOMPresentation of LUCERO at EURECOM
Presentation of LUCERO at EURECOM
 
The Digital Library Federation Aquifer Initiative
The Digital Library Federation Aquifer InitiativeThe Digital Library Federation Aquifer Initiative
The Digital Library Federation Aquifer Initiative
 
Lifting the Lid on Linked Data
Lifting the Lid on Linked DataLifting the Lid on Linked Data
Lifting the Lid on Linked Data
 
What do MARC, RDF, and OWL have in common?
What do MARC, RDF, and OWL have in common?What do MARC, RDF, and OWL have in common?
What do MARC, RDF, and OWL have in common?
 

Fluor sakai la 2011

  • 1. Fluor: Your connection to the Fedora Digital Objects Repository Roland Groen, Edia
  • 2. Overview Project goals & drivers History of the project Short walkthrough Overall Architecture The features of the fluor tool Setting up a collection Project Status 12th Sakai Conference – Los Angeles, California – June 14-16 2
  • 3. Project Goals Make researchers share research data in a controlled community Integrate Sakai with the Fedora Content Repository Support searching and browsing Support different access models Open vs. closed 12th Sakai Conference – Los Angeles, California – June 14-16 3
  • 4. Project Drivers UvALibrary: make researchers aware of the importance of sharing data Making research data publically available becomes more and more a requirement than a wish Publishing: Support publications by disseminate the underlying research data Teaching: have students work with actual research data 12th Sakai Conference – Los Angeles, California – June 14-16 4
  • 5. A bit of history And now... 12th Sakai Conference – Los Angeles, California – June 14-16 5
  • 6. Project history: testweeklab ‘Testweeklab’ project (2008) Work with 40 years of privacy sensitive research data Strong security requirements Only metadata (publically) accessible Complicated access procedure for accessing the actual data Very specific metadata schema, search and browse requirements Very specific fields (year, N, type of test, scale) Build as Sakai tool for connecting to a Fedora repository 12th Sakai Conference – Los Angeles, California – June 14-16 6
  • 7. Project history: next steps Findings from testweeklab User Interaction improvements Configurability Support more types of usage Make the tool flexible to support different collections and types of use Make the access model flexible Support personalization 12th Sakai Conference – Los Angeles, California – June 14-16 7
  • 8. A short functional walkthrough And now… 12th Sakai Conference – Los Angeles, California – June 14-16 8
  • 9. Searching 12th Sakai Conference – Los Angeles, California – June 14-16 9
  • 10. Browsing 12th Sakai Conference – Los Angeles, California – June 14-16 10
  • 11. My Items 12th Sakai Conference – Los Angeles, California – June 14-16 11
  • 12. Upload 12th Sakai Conference – Los Angeles, California – June 14-16 12
  • 13. The overview of the architecture And now... 12th Sakai Conference – Los Angeles, California – June 14-16 13
  • 14. Overall architecture 12th Sakai Conference – Los Angeles, California – June 14-16 14
  • 15. Overall architecture: components Fedora: act as a content repository. Generic search: do the updates and transformations to Solr Solr: indexing, provide a search and browse interface Sakai FLUOR tool: create a UI for researchers to work with 12th Sakai Conference – Los Angeles, California – June 14-16 15
  • 16. Fedora Content repository Content managed as data objects Unique identifier: PID Metadata Datastreams Relation between objects Virtual datastreams Versioning, logging Multiple collections Objects handled as XML (FOXML) 12th Sakai Conference – Los Angeles, California – June 14-16 16
  • 17. Fedora generic search Enables browsing and search with Lucene, Solr and Zebra Gets notifications about updates from Fedora and fetches the objects XSLT transforms FOXML into documents for the search engine a Rest and SOAP interface, search and browse based on SRW/SRU. 12th Sakai Conference – Los Angeles, California – June 14-16 17
  • 18. Solr Search engine Build on top of Lucene Easy to deploy and configure Advanced full-text searching and indexing Open interfaces, Rest, JSON, XML Admin interfaces Plugin architecture 12th Sakai Conference – Los Angeles, California – June 14-16 18
  • 19. the fluor tool And now… 12th Sakai Conference – Los Angeles, California – June 14-16 19
  • 20. Fluor tool features Access research data Search and browse Access items in the repository Create favorites Upload new items Added directly depending on security model 12th Sakai Conference – Los Angeles, California – June 14-16 20
  • 21. Data access security model Metadata is always accessible Access on datastreams is limited Open: no restrictions Request based: user needs to create a request, and admin reviews them. Fluor tool features 12th Sakai Conference – Los Angeles, California – June 14-16 21
  • 22. Fluor tool features 12th Sakai Conference – Los Angeles, California – June 14-16 22
  • 23. Fluor tool features The access model is configurable. Open Request based Per object configurable 12th Sakai Conference – Los Angeles, California – June 14-16 23
  • 24. Fluor tool features Support for versioning Enables the download of previous versions. Configurable 12th Sakai Conference – Los Angeles, California – June 14-16 24
  • 25. Fluor tool features Data encryption The ability to encrypt datastreams Backups etc. cause no threat to privacy Configurable on the datastream 12th Sakai Conference – Los Angeles, California – June 14-16 25
  • 26. Setting up a repository 12th Sakai Conference – Los Angeles, California – June 14-16 26
  • 27. Setting up a collection Describe the collection What datastreams are there? What metadata is there? Set up the Fedora repository Configure the Fedora datamodel Set up generic search and Solr Configure the FLUOR tool 12th Sakai Conference – Los Angeles, California – June 14-16 27
  • 28. Setting up a collection 12th Sakai Conference – Los Angeles, California – June 14-16 28
  • 29. The status of the project And now… 12th Sakai Conference – Los Angeles, California – June 14-16 29
  • 30. Project status The project is currently being tested by targeted end-users Common UI bugs and issues Search and index has problems 12th Sakai Conference – Los Angeles, California – June 14-16 30
  • 31. Solrvs. Generic search Generic search 2.2 Browse functionality broken with Solr. Does not use facet browsing, instead access lucene index on file system. Browse not limited to collection, results polluted. Solution: Access Solr directly instead of generic search 12th Sakai Conference – Los Angeles, California – June 14-16 31
  • 32. Any questions? An finally… 12th Sakai Conference – Los Angeles, California – June 14-16 32
  • 33. Thank you! 12th Sakai Conference – Los Angeles, California – June 14-16 33

Notas do Editor

  1. Make researchers aware of the importance of sharing data.Sharing data becomes even more a requirement than a wish.Support publications
  2. Role of the library is to support researchers managing and storing data
  3. N = amount of participants
  4. Virtualdatastreams: services (image resize, file conversion)
  5. Updates from Fedora are sent by JMSThe rest/soap interface is not used
  6. Request based: user needs to create a request. Works like a shopping cart. The request needs to be approved. Uploads need to be reviewed also.
  7. Solr 1.3