1. ARCHIVER – Project Update
Open Market Consultation
23rd of May 2019 – Stansted, UK
João Fernandes
Project Coordinator
CERN
2. Pre-Commercial Procurement
07.05.2019 ARCHIVER Project Overview 2
Focus: Archiving and Data Preservation Services using commercial cloud services
Procurement Budget: 3.4M euro
Starting Date: 1st of January 2019
Duration: 36 Months
Coordinating Partner: CERN
3. Consortium
Includes Buyers and Experts in the preparation, execution and promotion of the Procurement of R&D
07.05.2019 ARCHIVER Project Overview 3
Procurers - Public organisations committing funds to contribute to a joint-procurement
Experts – Partner organisations bringing expertise in requirement assessment and promotion activities, not part of the Buyers Group
4. Challenge
Data volumes and complexity growing; Communities Growing; Needs of advanced functionality increase
Objective: perform R&D to demonstrate long-term preservation and archiving services for scientific data in the PB range under
F.A.I.R. principles, using commons solutions, while research groups keep total stewardship of their data sets
OAIS, FAIR and European Regulation (GDPR)
European Open Science Cloud (EOSC) integration
Reduce fragmentation expanding existing solutions to several scientific domains
Access through GÉANT network; Federated AAI support
Scalability: PB data volume of multi domain scientific data; High sustained ingest rates (1-10 Gbps)
Cost-effective and transparent business models: range of purchasing and deployment options, stimulating uptake by the wider
research community
07.05.2019 ARCHIVER Project Overview 4
Basic Scientific Data
Archiving & Bit
Preservation
5. OAIS Reference Model
Relevant Standards
Preservation: ISO 14721/16393, 26324 and related
Infrastructure Services: ISO 27000, ISO 27040, 19086
07.05.2019 ARCHIVER Project Overview 5
6. Cost-effective
Business Model
Taking into account:
- Scale
- Ingest rates
- Archive lifetime
- # of copies
- Exit strategies
- Portability
- SLAs
Regulation &
Legislation
- Auditing
- Self-assessment
- Data Retention
- GDPR
R&D Challenge
07.05.2019 ARCHIVER Project Overview 6
Data integrity/security; cloud/hybrid deployment; data
volume in the PB range; high, sustained ingest data rates;
ISO certification: 27000, 27040, 19086 and related
Archives connected to the GEANT network.
OAIS conformant services: data readability formats, normalization,
obsolesce monitoring, files fixity, authenticity checks, etc.;
ISO 14721/16393, 26324 and related standards
User services: search, discover, share, indexing, data removal, etc.;
Access under Federated IAM
Layer 1
Storage/Basic Archiving/Secure
backup
Layer 2
Preservation
Layer 3
Baseline user services
Layer 4
Advanced services
High level services: visual representation of data (domain specific),
reproducibility of scientific analyses, etc.;
Minimum
R&D
Objectives
Added
value
R&D
Fundamental aspect
of the challenge
7. ARCHIVER & European Open Science Cloud (EOSC)
07.05.2019 ARCHIVER Project Overview 7
ARCHIVER Services can be procured
2019 2020 2021 2022 2023
EOSC vision:
To give the European Union a global lead in research data management and ensure that European
scientists reap the full benefits of data-driven science
ARCHIVER Objective: to make resulting services available in the EOSC catalogue
EOSC Rules of Engagement evolving: will be presented during the the project
8. Market Potential
07.05.2019 ARCHIVER Project Overview 8
ESFRI Landmarks
RIs already implemented or in an advanced Implementation Phase.
ESFRI Projects
RIs in a preparation phase selected for scientific case excellence and maturity.
http://roadmap2018.esfri.eu/media/1049/roadmap18-part3.pdf
9. ARCHIVER timeline
07.05.2019 ARCHIVER Project Overview 9
Suppliers to sign a framework agreement in order to participate in the call-offs
Goal: Services to be commercialized after the end of the PCPWe are here
10. Summary of ARCHIVER activities so far
07.05.2019 ARCHIVER Project Overview 10
11. Open Market Consultation Kick-Off event – 8th of April
07.05.2019 ARCHIVER Project Overview 11
70 participants from 26 companies physically
present
Digital Preservation Experts, Cloud Providers, Software
integrators
42 participants connected remotely (via webcast)
Planning poker to assess Value vs. Risk in a direct
dialogue with companies
All material available at:
https://www.archiver-project.eu/open-market-consultation-kick-event
12. ARCHIVER in the EOSC-hub week
07.05.2019 ARCHIVER Project Overview 12
EOSC demand side event
Overview of current EOSC activities
Session on role of Procurement in the EOSC context
State-of-the art and landscaping discussions
Early Adopters
A number of organisations have expressed interest
Early Adopters Kit to be made available during May 2019
13. Open Market Consultation event – 7th of May Barcelona
07.05.2019 ARCHIVER Project Overview 13
40 participants from 17 companies physically
present
Digital Preservation Experts, Cloud Providers,
Software integrators
All material available at:
https://www.archiver-project.eu/open-market-consultation-kick-event
14. OAIS Webinar – 9th of May
07.05.2019 ARCHIVER Project Overview 14
17 participants
Representatives of the Buyers Group,
Companies and Research Organisations
All material available at:
https://www.archiver-project.eu/all-events
15. Draft Tender Documents Published (update)
Draft versions of the tender documents are now available during the OMC process,
including:
RfT, Framework Agreement and Functional Specification;
Annex 2 (Selection Criteria); Annex 4 (Award Criteria);
Initial list of Milestones and Deliverables;
Q&A from the OMC also publicly available
You are able to make comments on the technical documents and ask more questions
07.05.2019 ARCHIVER Project Overview 15
https://www.archiver-project.eu/draft-tender-documents
16. Early Adopters
Objective: Encourage wide deployment outside the Buyers Group of
solutions developed during the project, ARCHIVER will engage with a group
of “Early Adopters”.
Benefits:
Be consulted for feedback on the tender documents before its publication,
scheduled on October 2019
Access parts of the R&D produced by the ARCHIVER Contractors across all phases of
the project
Access to limited capacity made available by the Buyers Group during the pilot
phase to test the services developed
Early Adopters will be listed on the Request for Tender (RfT)
23/05/2019 ARCHIVER Project Overview 16
17. Preparation of a technical summary for each use case
Problem to solve
Lifecycle and workflow characteristics
Including basic and “bonus” use cases to solve
Authentication and Management
Data and Metadata description
Interface
Reliability, Compliance and Validation requirements
Cost-effectiveness requirements
Some including minimum cost tresholds
23/05/2019 ARCHIVER Project Overview 17
18. Next Open Market Consultation Event
07.05.2019 ARCHIVER Project Overview 18
Registration open: https://www.archiver-project.eu/all-events
19. Rest of the Agenda for Today
Tender Process and Requirements, Joshua Luke Davison (CERN)
Deployment Scenarios, Representatives of the Buyers Group
13.00 - 14.00 – Lunch Break
Deployment Scenarios, Representatives of the Buyers Group
GEANT Network connectivity, Vincenzo Capone (GEANT)
15.15 - 15.40 – Coffee Break
Federated Identity Management Overview, Hannah Short (CERN)
Wrapping up and Next Steps, Marion Devouassoux (CERN)
Event ends at 16:40
07.05.2019 ARCHIVER Project Overview 19
20. Summarizing, what’s in it for you?
07.05.2019 ARCHIVER Project Overview 20
Demonstrate archiving & preservation services for petabyte data volumes, high
ingest sustained data rates (1-10 Gbps per day) for multi-disciplinary scientific data
Diversify your offer and commercialize resulting services by the end of the project
Support the open data movement
Offer services via the European Open Science Cloud (EOSC) Catalogue
Access the public funded European Research Infrastructures (RIs) as a new market
segment
21. Great thanks to EMBL-EBI for the organization of the event
23/05/2019 ARCHIVER Project Overview 21