SlideShare a Scribd company logo
Implementing the Notify
protocol and standard
practices in DSpace
OPEN REPOSITORIES 2022
The 17th International Conference onOpen
Repositories 6th - 9th June 2022, Denver, Colorado, USA
Andrea Bollini, 4Science
Corrado Lombardi, 4Science
Stefano Maffei, 4Science
William Welling, Harvard University
José Carvalho, University of Minho
What are we
talking about?
The Notify Project
HOW WE
GOT HERE ?
• A minimum viable product (MVP) was funded by the
University of Minho as part of the PUBIN
(www.pubin.pt/) project (2019-2022) at the end of 2021
• The implementation was delivered by 4Science in
January/February 2022 for DSpace 5 & 6
• Harvard proposed a new use case to the Notify project
and offered help to move the MVP to DSpace 7
• Initial code for version 7 is available at 4Science's and
Harvard's GitHub repositories, official PRs will come for
evaluation in DSpace 7.4 (Fall 2022)
The goals of
the MVP
Quick & effective
Working on the most
adopted versions currently
Supporting the open review
scenarios but extensible
The MVP was implemented
for DSpace v5 and v6 JSPUI only
https://github.com/4Science/DSpace/tree/coar-notify-5
https://github.com/4Science/DSpace/tree/coar-notify-6
Documentation is available in GitHub as
README.md
Supported scenarios
The Notify Workflow
Start
DSpace
LDN Inbox
SubmissionStep
Rev. Service 1
Rev. Service 2
The author (submitter)
can request a review / endorsement
Workflow
Librarianscanmodify/ remove /
add the review requests if needed
Item
DSpace sends a LDN to each selected
servicesrequesting the review
Acknowledgement
Review
Endorsement
Store in the item metadata
Asking Review
during the
submission is
the first step
The list of servicesis
configurablebut known in
advance to the repository
system administrator
Monitor the status
of the notify
conversation
Results
links to
the review and/or
to the endorsement
(overlay journal) from
the repository
The HARVARD
use case
Credits AndrewWoods, HarvardUniversity, 2022
A short demo of the DSpace /
Dataverse integration from William
Porting to
version 7 is
ongoing, help
and feedback
are welcome!
Latest code:
• https://github.com/4Science/DSpace/tree/main-coar-notify
• https://github.com/harvard-lts/DSpace/tree/main-coar-notify
Issue tracking pending subtasks for MVP
https://github.com/harvard-lts/DSpace/issues/2
Architecture
• LDN Receiver and Consumer are coupled and embedded in DSpace: "easier deployment
option"
• Metadata (in the new COARschema) are used to flag which services need to be notified
about an item, sent and received notification
• Security: services are known and trusted in advance. Incoming message are accepted by IP
addresses
• DSpace 5 – 6 :A servlet is used to implement the INBOX
• DSpace 7: a separate maven web project has been created that if activated contributes a
controller to the server webapp (as the OAI,SWORD,etc.)
• According to the notification type a chain of actions are executed to process the message
(add metadata, send email notification)
• NotifyAnnouncements are sent by a DSpaceConsumer once an item is archived or updated
with a coar.notify.initialize metadata
A note about use of Metadata
• Several metadata have been defined in COAR schema, one for each "status" of
conversation
(coar.notify. initialize|request|examination|refused|review|endorsment)
• It was the easier/quicker solution with minimal impact for future migration and that
could work as is on versions 5, 6 and 7
• As the status is stored in a metadata it is available on SOLR and can be efficiently
queried for the monitoring dashboard
• The following information from the LDN Message is stored as metadata value
using || separator: Timestamp, Service ID, In Reply To, URL (review, endorsement)
Future plans
• Keep the implementation aligned with the COAR Notify project
• Move the status information outside the metadata
• Add support for auto-discover the Inbox
• Add support for an externalinbox
• Decouple the consumer from the inbox
• Identify authors via ORCID
Thanks for your
attention!
Andrea Bollini
CTO, 4Science
andrea.bollini@4science.com

More Related Content

Similar to Implementing the Notify protocol and standard practices in DSpace

Srikanth_testing resume
Srikanth_testing resumeSrikanth_testing resume
Srikanth_testing resume
srikanth Burra
 
Resume_abir
Resume_abirResume_abir
Resume_abir
Abir De
 

Similar to Implementing the Notify protocol and standard practices in DSpace (20)

Srikanth_testing resume
Srikanth_testing resumeSrikanth_testing resume
Srikanth_testing resume
 
DSpace Current State, Concerns and Solution by DSquare Technologies (DSpace S...
DSpace Current State, Concerns and Solution by DSquare Technologies (DSpace S...DSpace Current State, Concerns and Solution by DSquare Technologies (DSpace S...
DSpace Current State, Concerns and Solution by DSquare Technologies (DSpace S...
 
“Adoption DSpace 7 and 8 Challenges and Solutions from Real Migration Experie...
“Adoption DSpace 7 and 8 Challenges and Solutions from Real Migration Experie...“Adoption DSpace 7 and 8 Challenges and Solutions from Real Migration Experie...
“Adoption DSpace 7 and 8 Challenges and Solutions from Real Migration Experie...
 
Resume_abir
Resume_abirResume_abir
Resume_abir
 
News about DSpace-CRIS Anwendertreffen 2020
News about DSpace-CRIS Anwendertreffen 2020News about DSpace-CRIS Anwendertreffen 2020
News about DSpace-CRIS Anwendertreffen 2020
 
DSpace-CRIS & OpenAIRE
DSpace-CRIS & OpenAIREDSpace-CRIS & OpenAIRE
DSpace-CRIS & OpenAIRE
 
Resume raushan
Resume raushanResume raushan
Resume raushan
 
How to Contribute to Cloud Native Computing Foundation
How to Contribute to Cloud Native Computing FoundationHow to Contribute to Cloud Native Computing Foundation
How to Contribute to Cloud Native Computing Foundation
 
How to contribute to cloud native computing foundation (CNCF)
How to contribute to cloud native computing foundation (CNCF)How to contribute to cloud native computing foundation (CNCF)
How to contribute to cloud native computing foundation (CNCF)
 
Rajesh Paleru
Rajesh PaleruRajesh Paleru
Rajesh Paleru
 
Cloud Foundry: Hands-on Deployment Workshop
Cloud Foundry: Hands-on Deployment WorkshopCloud Foundry: Hands-on Deployment Workshop
Cloud Foundry: Hands-on Deployment Workshop
 
7 flavours of devops implementation
7 flavours of devops implementation7 flavours of devops implementation
7 flavours of devops implementation
 
Cloud Foundry May 1 2014
Cloud Foundry May 1 2014Cloud Foundry May 1 2014
Cloud Foundry May 1 2014
 
What is DevOps Services_ Tools and Benefits.pdf
What is DevOps Services_ Tools and Benefits.pdfWhat is DevOps Services_ Tools and Benefits.pdf
What is DevOps Services_ Tools and Benefits.pdf
 
What is DevOps Services_ Tools and Benefits.pdf
What is DevOps Services_ Tools and Benefits.pdfWhat is DevOps Services_ Tools and Benefits.pdf
What is DevOps Services_ Tools and Benefits.pdf
 
Managing FOSS in DevOps
Managing FOSS in DevOpsManaging FOSS in DevOps
Managing FOSS in DevOps
 
USTGlobal madrid devops
USTGlobal madrid devopsUSTGlobal madrid devops
USTGlobal madrid devops
 
DevOps and Decoys How to Build a Successful Microsoft DevOps Including the Data
DevOps and Decoys  How to Build a Successful Microsoft DevOps Including the DataDevOps and Decoys  How to Build a Successful Microsoft DevOps Including the Data
DevOps and Decoys How to Build a Successful Microsoft DevOps Including the Data
 
Resume_Bhabani_Prasad_Mohanty
Resume_Bhabani_Prasad_MohantyResume_Bhabani_Prasad_Mohanty
Resume_Bhabani_Prasad_Mohanty
 
Cloud foundry
Cloud foundryCloud foundry
Cloud foundry
 

More from 4Science

From Digital Records to Digital Cultural Landscapes. Beyond Digital Library b...
From Digital Records to Digital Cultural Landscapes. Beyond Digital Library b...From Digital Records to Digital Cultural Landscapes. Beyond Digital Library b...
From Digital Records to Digital Cultural Landscapes. Beyond Digital Library b...
4Science
 
IIIF and DSpace 7 - IIIF Conference 2023.pdf
IIIF and DSpace 7 - IIIF Conference 2023.pdfIIIF and DSpace 7 - IIIF Conference 2023.pdf
IIIF and DSpace 7 - IIIF Conference 2023.pdf
4Science
 
DSpace-CRIS, anticipating innovation
DSpace-CRIS, anticipating innovationDSpace-CRIS, anticipating innovation
DSpace-CRIS, anticipating innovation
4Science
 
DSpace 7 ORCID Integration
DSpace 7 ORCID IntegrationDSpace 7 ORCID Integration
DSpace 7 ORCID Integration
4Science
 
How to enhance your DSpace repository: use cases for DSpace-CRIS, DSpace-RDM,...
How to enhance your DSpace repository: use cases for DSpace-CRIS, DSpace-RDM,...How to enhance your DSpace repository: use cases for DSpace-CRIS, DSpace-RDM,...
How to enhance your DSpace repository: use cases for DSpace-CRIS, DSpace-RDM,...
4Science
 

More from 4Science (20)

From Digital Records to Digital Cultural Landscapes. Beyond Digital Library b...
From Digital Records to Digital Cultural Landscapes. Beyond Digital Library b...From Digital Records to Digital Cultural Landscapes. Beyond Digital Library b...
From Digital Records to Digital Cultural Landscapes. Beyond Digital Library b...
 
DSpace-CRIS design & Implementation
DSpace-CRIS design & ImplementationDSpace-CRIS design & Implementation
DSpace-CRIS design & Implementation
 
DSpace GLAM Infographic.pdf
DSpace GLAM Infographic.pdfDSpace GLAM Infographic.pdf
DSpace GLAM Infographic.pdf
 
DSpace CRIS EFS Miami.pdf
DSpace CRIS EFS Miami.pdfDSpace CRIS EFS Miami.pdf
DSpace CRIS EFS Miami.pdf
 
IIIF and DSpace 7 - IIIF Conference 2023.pdf
IIIF and DSpace 7 - IIIF Conference 2023.pdfIIIF and DSpace 7 - IIIF Conference 2023.pdf
IIIF and DSpace 7 - IIIF Conference 2023.pdf
 
DSpace-CRIS, anticipating innovation
DSpace-CRIS, anticipating innovationDSpace-CRIS, anticipating innovation
DSpace-CRIS, anticipating innovation
 
DSpace 7 ORCID Integration
DSpace 7 ORCID IntegrationDSpace 7 ORCID Integration
DSpace 7 ORCID Integration
 
Bringing IIIF to the DSpace community
Bringing IIIF to the DSpace communityBringing IIIF to the DSpace community
Bringing IIIF to the DSpace community
 
The EOSC DIH "ELD Advance" project
The EOSC DIH "ELD Advance" projectThe EOSC DIH "ELD Advance" project
The EOSC DIH "ELD Advance" project
 
DSpace implementation of the COAR Notify Project - status update
DSpace implementation of the COAR Notify Project - status updateDSpace implementation of the COAR Notify Project - status update
DSpace implementation of the COAR Notify Project - status update
 
Convegno Stelline 2020 - 4Science -16 settembre _ pubbliche
Convegno Stelline 2020 - 4Science -16 settembre _ pubblicheConvegno Stelline 2020 - 4Science -16 settembre _ pubbliche
Convegno Stelline 2020 - 4Science -16 settembre _ pubbliche
 
Convegno Stelline 2020 - 4Science -16 settembre _ accademiche
Convegno Stelline 2020 - 4Science -16 settembre _ accademicheConvegno Stelline 2020 - 4Science -16 settembre _ accademiche
Convegno Stelline 2020 - 4Science -16 settembre _ accademiche
 
Convegno Stelline 2020 - 4Science
Convegno Stelline 2020 - 4Science Convegno Stelline 2020 - 4Science
Convegno Stelline 2020 - 4Science
 
DSpace-CRIS 7: What is Coming? OR2020
DSpace-CRIS 7: What is Coming? OR2020DSpace-CRIS 7: What is Coming? OR2020
DSpace-CRIS 7: What is Coming? OR2020
 
Digital library: riflessioni su scelte e obiettivi. Visibilità delle collezio...
Digital library: riflessioni su scelte e obiettivi. Visibilità delle collezio...Digital library: riflessioni su scelte e obiettivi. Visibilità delle collezio...
Digital library: riflessioni su scelte e obiettivi. Visibilità delle collezio...
 
How to enhance your DSpace repository: use cases for DSpace-CRIS, DSpace-RDM,...
How to enhance your DSpace repository: use cases for DSpace-CRIS, DSpace-RDM,...How to enhance your DSpace repository: use cases for DSpace-CRIS, DSpace-RDM,...
How to enhance your DSpace repository: use cases for DSpace-CRIS, DSpace-RDM,...
 
DSpace-CRIS ORCID Integration
DSpace-CRIS ORCID IntegrationDSpace-CRIS ORCID Integration
DSpace-CRIS ORCID Integration
 
Enhancing Interoperability: The Implementation of OpenAIRE Guidelines and COA...
Enhancing Interoperability: The Implementation of OpenAIRE Guidelines and COA...Enhancing Interoperability: The Implementation of OpenAIRE Guidelines and COA...
Enhancing Interoperability: The Implementation of OpenAIRE Guidelines and COA...
 
Or2019 DSpace 7 Enhanced submission & workflow
Or2019 DSpace 7 Enhanced submission & workflowOr2019 DSpace 7 Enhanced submission & workflow
Or2019 DSpace 7 Enhanced submission & workflow
 
Extending DSpace 7: DSpace-CRIS and DSpace-GLAM for empowered repositories an...
Extending DSpace 7: DSpace-CRIS and DSpace-GLAM for empowered repositories an...Extending DSpace 7: DSpace-CRIS and DSpace-GLAM for empowered repositories an...
Extending DSpace 7: DSpace-CRIS and DSpace-GLAM for empowered repositories an...
 

Recently uploaded

How to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good PracticesHow to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good Practices
Globus
 
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
Alluxio, Inc.
 

Recently uploaded (20)

Cyaniclab : Software Development Agency Portfolio.pdf
Cyaniclab : Software Development Agency Portfolio.pdfCyaniclab : Software Development Agency Portfolio.pdf
Cyaniclab : Software Development Agency Portfolio.pdf
 
2024 RoOUG Security model for the cloud.pptx
2024 RoOUG Security model for the cloud.pptx2024 RoOUG Security model for the cloud.pptx
2024 RoOUG Security model for the cloud.pptx
 
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
 
SOCRadar Research Team: Latest Activities of IntelBroker
SOCRadar Research Team: Latest Activities of IntelBrokerSOCRadar Research Team: Latest Activities of IntelBroker
SOCRadar Research Team: Latest Activities of IntelBroker
 
Understanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSageUnderstanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSage
 
How to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good PracticesHow to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good Practices
 
GlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote sessionGlobusWorld 2024 Opening Keynote session
GlobusWorld 2024 Opening Keynote session
 
Studiovity film pre-production and screenwriting software
Studiovity film pre-production and screenwriting softwareStudiovity film pre-production and screenwriting software
Studiovity film pre-production and screenwriting software
 
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume MontevideoVitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume Montevideo
 
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.ILBeyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
 
A Comprehensive Look at Generative AI in Retail App Testing.pdf
A Comprehensive Look at Generative AI in Retail App Testing.pdfA Comprehensive Look at Generative AI in Retail App Testing.pdf
A Comprehensive Look at Generative AI in Retail App Testing.pdf
 
GraphAware - Transforming policing with graph-based intelligence analysis
GraphAware - Transforming policing with graph-based intelligence analysisGraphAware - Transforming policing with graph-based intelligence analysis
GraphAware - Transforming policing with graph-based intelligence analysis
 
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
 
Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024
 
Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024
 
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdfDominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
 
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
 
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
 
Into the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdfInto the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdf
 
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
 

Implementing the Notify protocol and standard practices in DSpace

  • 1. Implementing the Notify protocol and standard practices in DSpace OPEN REPOSITORIES 2022 The 17th International Conference onOpen Repositories 6th - 9th June 2022, Denver, Colorado, USA Andrea Bollini, 4Science Corrado Lombardi, 4Science Stefano Maffei, 4Science William Welling, Harvard University José Carvalho, University of Minho
  • 2. What are we talking about? The Notify Project
  • 3. HOW WE GOT HERE ? • A minimum viable product (MVP) was funded by the University of Minho as part of the PUBIN (www.pubin.pt/) project (2019-2022) at the end of 2021 • The implementation was delivered by 4Science in January/February 2022 for DSpace 5 & 6 • Harvard proposed a new use case to the Notify project and offered help to move the MVP to DSpace 7 • Initial code for version 7 is available at 4Science's and Harvard's GitHub repositories, official PRs will come for evaluation in DSpace 7.4 (Fall 2022)
  • 4. The goals of the MVP Quick & effective Working on the most adopted versions currently Supporting the open review scenarios but extensible
  • 5. The MVP was implemented for DSpace v5 and v6 JSPUI only https://github.com/4Science/DSpace/tree/coar-notify-5 https://github.com/4Science/DSpace/tree/coar-notify-6 Documentation is available in GitHub as README.md
  • 7. The Notify Workflow Start DSpace LDN Inbox SubmissionStep Rev. Service 1 Rev. Service 2 The author (submitter) can request a review / endorsement Workflow Librarianscanmodify/ remove / add the review requests if needed Item DSpace sends a LDN to each selected servicesrequesting the review Acknowledgement Review Endorsement Store in the item metadata
  • 8. Asking Review during the submission is the first step The list of servicesis configurablebut known in advance to the repository system administrator
  • 9. Monitor the status of the notify conversation
  • 10. Results links to the review and/or to the endorsement (overlay journal) from the repository
  • 11. The HARVARD use case Credits AndrewWoods, HarvardUniversity, 2022
  • 12. A short demo of the DSpace / Dataverse integration from William
  • 13. Porting to version 7 is ongoing, help and feedback are welcome! Latest code: • https://github.com/4Science/DSpace/tree/main-coar-notify • https://github.com/harvard-lts/DSpace/tree/main-coar-notify Issue tracking pending subtasks for MVP https://github.com/harvard-lts/DSpace/issues/2
  • 14. Architecture • LDN Receiver and Consumer are coupled and embedded in DSpace: "easier deployment option" • Metadata (in the new COARschema) are used to flag which services need to be notified about an item, sent and received notification • Security: services are known and trusted in advance. Incoming message are accepted by IP addresses • DSpace 5 – 6 :A servlet is used to implement the INBOX • DSpace 7: a separate maven web project has been created that if activated contributes a controller to the server webapp (as the OAI,SWORD,etc.) • According to the notification type a chain of actions are executed to process the message (add metadata, send email notification) • NotifyAnnouncements are sent by a DSpaceConsumer once an item is archived or updated with a coar.notify.initialize metadata
  • 15. A note about use of Metadata • Several metadata have been defined in COAR schema, one for each "status" of conversation (coar.notify. initialize|request|examination|refused|review|endorsment) • It was the easier/quicker solution with minimal impact for future migration and that could work as is on versions 5, 6 and 7 • As the status is stored in a metadata it is available on SOLR and can be efficiently queried for the monitoring dashboard • The following information from the LDN Message is stored as metadata value using || separator: Timestamp, Service ID, In Reply To, URL (review, endorsement)
  • 16. Future plans • Keep the implementation aligned with the COAR Notify project • Move the status information outside the metadata • Add support for auto-discover the Inbox • Add support for an externalinbox • Decouple the consumer from the inbox • Identify authors via ORCID
  • 17. Thanks for your attention! Andrea Bollini CTO, 4Science andrea.bollini@4science.com