SlideShare uma empresa Scribd logo
1 de 54
eosc-hub.eu
@EOSC_eu
EOSC-hub receives funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No. 777536.
Gergely Sipos (EGI Foundation)
Integrating and managing services for the European Open Science Cloud
The EOSC-hub project
2
EOSC-hub factsheet
The Hub
Service delivery
- Who
- What
- How
Service adoption
- Thematic Services
- Competence Centres
- New communities
Extra slides: service technical details
3/23/2018
Outline
33/23/2018
EOSC-hub mobilises providers from 20 major
digital infrastructures, EGI*, EUDAT CDI** and
INDIGO-DataCloud jointly offering services,
software and data for advanced data-driven
research and innovation.
* EGI is not an acronym (any more)
** CDI – Collaborative Data Infrastructure
4
European Commission Horizon2020 programme
100 Partners, 76 beneficiaries (75 funded)
3874 PMs, 108 FTEs, more than 200 technical and
scientific staff involved
- €33,331,18, funded by:
 European Commission: €30,000,000
 EGI Foundation and its participants: €2,155,540
 EGI participants: €1,221,094
36 months: Jan 2018 – Dec 2020
3/23/2018
Project figures
53/23/2018
EOSC-hub Mission
3/23/2018 5
The project will create EOSC Hub:
a federated integration and management system
for EOSC
• Data
• Applications & tools
• Baseline services
(storage, compute,
connectivity)…
• Training, consultants
• Marketplace
• AAI
• Accounting
• Monitoring
• …
• Security regulations,
• Compliance to
standards,
• Terms of use,
• FAIR implementation
guidelines
• …
Usage according to
Principles of
engagement
(see also EOSCpilot WP2)
From the consortium
AND from external
contributors
• Lightweight certification
of providers
• SLA negotiation
• Customer Relationship
Management
• …
Services
Federation
services
Federated
operations
Processes
and
policies
Based on FitSM
63/23/2018
Work packages
73/23/2018
Service Providers
e-Infra
EGI
Federation
EUDAT CDI
Humanities
Language
and
literature
(CLARIN)
Arts
(DARIAH)
Engineering
Environmen
tal
engineering
(sea vessels,
LNEC)
Civil
Engineering
(Disaster
Mitigation)
Medical
and Health
Sciences
Biological
Sciences
(ELIXIR)
Structural
biology
(WeNMR)
Natural
sciences
Generic
services
Physical Sciences
• Astronomy (LOFAR)
• Fusion (ITER)
• High Energy Physics
(CMS and VIRGO)
• Space Science
(EISCAT-3D)
Earth Science
• EO Pillar
• GEO
• Climate Research
(ENES)
• Seismology (ORFEUS,
EPOS)
Biological Sciences
• Marine and
freshwater biology
(IFREMER)
• Biodiversity
conservation
(LifeWatch)
• Ecology (ICOS)
Open Collaboration services Basic infrastructure and added-
value services
Federation services
• Applications Database
• Repositories
• Accounting
• ARGO
• Check-in
• GGUS
• GOCDB
• Marketplace
• Operations Portal
• RC Auth
• SPMT
• DPMT
• B2ACCESS
• TTS
• SYMON
• EGI High-Throughput Compute
• EGI Cloud Compute
• EGI Cloud Container
• DIRAC4EGI
• EGI Online storage
• EGI DataHub
• B2HANDLE
• B2FIND
• B2DROP
• B2SAFE
• B2STAGE
• B2NOTE
• ETDR
• Sensitive Data Service
• Advanced IaaS
• TOSCA for Heat
• OPIE
83/23/2018
Service catalogue
https://wiki.eosc-hub.eu/display/EOSC/EOSC-hub+service+catalogue
WP6WP5
WP5
Thematic services
WP7
• ECAS
• DARIAH Gateway
• OPENCoastS
• GEOSS
• EO Pillar
• WeNMR
• DODAS
• LifeWatch
• CMI
From month 19:
• IFREMER
• EISCAT_3D Portal
93/23/2018
Generic services
Open Collaboration services
• Applications Database: Virtual appliances and application software repository and
management
• Repositories: Repositories of verified software to be deployed by the Service Providers
103/23/2018
Generic services
Federation services
• Accounting: Infrastructure composed by repositories and portal to collect usage statistics
of the EOSC-hub services and present them to the stakeholders
• ARGO: Monitoring infrastructure to track services status and collect statistics
• Check-in: AAI platform for federated authentication to EGI services
• GGUS: Helpdesk platform for the EGI infrastructure
• GOCDB: Configuration database, service registry
• Marketplace: Exposes the service catalogue to services and collects service orders
• Operations Portal: Operational tools to manage distributed infrastructures
• RCAuth: Online CA for the translation of credentials to X.509 certificates
• SPMT: Service portfolio management tool
• DPMT: Configuration management & data management tool for the users
• B2ACCESS: AAI platform for federated authentication to EUDAT services
• TTS: RT-based helpdesk service for the EUDAT infrastructure
• SYMON: Service to monitor the deployed service versions
113/23/2018
Generic services
Basic infrastructure and added-value services
• EGI HTC: High-throughput compute
• EGI Cloud Compute: Infrastructure as a
service cloud compute
• EGI Cloud Container: Docker containers
cloud computing
• DIRAC4EGI: Workload management
service for computational tasks both on
cloud and HTC
• EGI Online storage: Store data in a
reliable and high-quality environment
and share it across distributed teams
• EGI DataHub: Access public datasets
and consume them from compute
services
• B2HANDLE: Persistent ID management
• B2FIND: Metadata based data-discovery
service
• B2DROP: Secure and trusted data
exchange service for researchers
• B2SAFE: Distribute and store large
volumes of data based on data policies
• B2STAGE: Data transfer between
resources and computational facilities
• B2SHARE: Store / publish research data
• B2NOTE: Data annotation service
• ETDR: European certified Trusted Digital
Repository
• Sensitive Data Service
• Advanced IaaS
• TOSCA for Heat: Support for TOSCA
templates in OpenStack heat component
• OPIE: Open source implementation of
spot instance virtual machines for
OpenStack
123/23/2018
Disciplinary services
Thematic services
• ECAS: Climate Analytics Service
• DARIAH Gateway: A portal tailored for the digital arts and humanities communities
• OPENCoastS: On-demand Operational Coastal Circulation Forecast Service
• GEOSS: GEO DAB (Discovery and Access Broker), GEOSS portal
• EO Pillar: Earth observation services coordinated by ESA. The tools are: MEA, EPOSAR,
Sentinel playground, Datacube analytic service, Geohazards exploitation platform, OSS-X
Sentinel service
• WeNMR: Online portals for structural biology analytics: DISVIS, POWERFIT, HADDOCK,
GROMACS, AMPS-NMR, CS-ROSETTA, UNIO, FANTEN
• DODAS: Dynamic On Demand Analysis Service
• LifeWatch: PAIRQURS, Citizen science services, GBIF, Digital Knowledge preservation
framework, remote monitoring and smart sensing.
• CMI: The Component MetaData Infrastructure, including the Virtual Language
Observatory and the Virtual Collection Registry. Provided by CLARIN-ERIC
133/23/2018
Mapping Services to
the research data lifecycle
Processing & Analysis
Data Management, Curation &
Preservation
Access, Deposition & Sharing
Federation Services
● B2FIND (data)
● Marketplace (Services)
● Applications on Demand
● Federated HTC & Cloud Compute IaaS & PaaS
● Processing of sensitive data
● Jupyter Notebook
● Application DB (software & VM)
● B2DROP (data)
● B2Note (data)
● B2SHARE (data)
● DataHub
● Federated AAI. monitoring,
accounting
● SLA and order Management
● Security incident response and
policies
● Technical support & Training
● B2HANDLE
● B2SAFE
● European Certified Trusted
Repository
● Thematic data analytics
● Scientific Workflow Management,
Orchestration (DIRAC, PaaS Orchestrator)
1
2
3
4
Discover & Reuse
EOSC-hub service catalogue:
https://wiki.eosc-hub.eu/display/EOSC/EOSC-hub+service+catalogue
14
IT Service Management
• Why IT service management (ITSM)?
– About 80% of all IT service outages originate
from "people and process issues"
– Duration of outages and degradations
significantly dependent on non-technical factors
• IT service management
– Focuses on the provision of high quality IT
services that meet customers' and users’
expectations
– Defines, documents and maintains service
management processes through assigned roles
and responsibilities
Reasons for service outages
[Gartner]
15
FitSM: Requirements
• FitSM defines 85 requirements that should be fulfilled by an
organisation (or federation) offering IT services to customers
• Compliance with the 85 requirements can be regarded as a
"proof of effectiveness"
• The 85 requirements are structured as follows:
–16 general requirements (GR)
–69 process-specific requirements (PR)
• Consideration of the 14 IT service management processes from the
FitSM process model
• Between 2 and 8 requirements per process
FitSM service management processes:
• Service portfolio management
• Service level management
• Incident management
• Change management
• Capacity management
• Information security management
• …
Example – Service Portfolio Management requirements:
PR1.1 A service portfolio shall be maintained. All services shall be
specified as part of the service portfolio.
PR1.2 Design and transition of new or changed services shall be
planned.
PR1.3 Plans for the design and transition of new or changed services
shall consider timescales, responsibilities, new or changed technology,
communication and service acceptance criteria.
PR1.4 The organisational structure supporting the delivery of services
shall be identified, including a potential federation structure as well as
contact points for all parties involved.
16
Addressing requirements: Technical tools
• Process documentation
– e.g. Confluence,
Wikimedia
• Ticket tool
– e.g. GGUS, JIRA, RT
• Templates
– e.g. Word docs, Excel,
Google Apps, Forms
6 Feb 2018, GoToWebinar
173/23/2018
Adoption of generic services
Thematic services Common services
Data analytics
&
Community-
specific
Services
Open
Collaboration
Services
Application/sof
tware
repository,
Configuration
management,
Marketplace
Federation
Services
AAI,
Accounting,
Monitoring,
Operations,
Security
Added value services
Compute, data, software management,
curation & preservation
Basic infrastructure
Compute and storage
integration
Competence
Centres
incubate
Service catalogue: https://wiki.eosc-hub.eu/display/EOSC/EOSC-hub+service+catalogue
WP5 WP5WP6
WP6
WP7
WP8
New
communities
integration
Engagement and support for new communities
Provide
Including Disaster
Mitigation
Competence Centre
3/23/2018 18
Disaster Mitigation+ CC
(TW, PH, MY, ID, DE, CZ, JP)
19
1. Request services AND/OR inclusion in the EOSC-hub catalogue:
http://eosc-hub.eu/contact-us-0 (online form)
(This will be soon replaced with the EOSC-hub Marketplace)
2. Support team contacts you to discuss details (skype/phone)
4. Regular ‘satisfaction interviews’ (~3/6 months)
3/23/2018
Engagement steplist for new
user or provider communities
• If user community:
• EOSC-hub negotiates conditions
with providers
• EOSC-hub signs SLA with the new
community
• If provider community:
• EOSC-hub signs OLA with the new
community
B
O
T
H
3.
20
Both in EINFRA-12 (topic A and B)
- EOSC-hub ~ storage, compute, application services
- OpenAIRE ~ RDM; Publication services
Let’s support Open Science together!
- Joint workplan plan
 Technical integration of online services
 Dissemination, community building, support, training
 Governance
3/23/2018
EOSC-hub – OpenAIRE-Advance
collaboration
21
• EOSC-hub week, Malaga:http://eosc-
hub.eu/news/eosc-hub-launches-its-first-eosc-hub-
week-16-20-april-2018-malaga-spain-join-us
1. Public days: 16-17 Aprilhttp://eosc-hub.eu/eosc-hub-week-2018-
programme
▪ Session on Comp Centres, Thematic Services, Demonstrators :
http://eosc-hub.eu/scientific-communities-eosc-hub-and-eoscpilot
2. Project members’ all-hands meeting: 18-20 April
▪ 3 sessions about Competence Centre setup&validation plans
3/23/2018
Next event
eosc-hub.eu @EOSC_eu
Thank you for
your attention!
Contact:
Gergely.sipos@egi.eu
www.eosc-hub.eu
Questions?
DETAILS ON INDIVIDUAL SERVICES
Extra slides:
Enhance discovery and reuse of scientific products
across communities
B2Find
Marketplace
(1)Discover and Reuse
25
Making Open Science findable
(http://b2find.eudat.eu/)
Provided through EOSC-hub
● Cross-disciplinary metadata and discovery service (B2FIND) allowing RI to
make their data findable and discoverable in a central catalogue
○ Metadata can be harvested via OAI-PMH. Possibility to use also APIs as JSON-API’s and
CSW2.0 to collect the metadata from the communities.
○ The project provides support to integrate community data catalogue
To be funded in INFRAEOSC-04
● Elicitation & mapping of metadata schemas in use within the community
● Definition of FAIR implementation guidelines (input to EOSC-hub)
B2FIND
26
Provided through EOSC-hub:
● Marketplace: multi-tenant user-facing platform for service providers to publish
their EOSC services and EOSC-compliant data repositories, and collect
service orders
○ Mature services and curated data
○ The RI retains control and accountability for the services and data published and participate in
the management of the Hub service portfolio
○ Support to usage of common service templates
To be funded in INFRAEOSC-04:
● Service design to set-up a cluster-wide or RI-specific service portfolio
● Advice on ISO-compliant service portfolio management process, auditing
● Operation of a dedicated customized marketplace (if necessary)
EOSC-hub Marketplace
Scale out your computing environment and process & analyse data in a
federated environment
● Applications on Demand
● Federated High Throughput Computing
● Federated Cloud Compute IaaS and PaaS
● Processing of sensitive data
● Jupyter
● Scientific Workflow Management, Orchestration (DIRAC, PaaS
Orchestration)
● Discipline-specific data analytics tools
(2) Processing and Analysis
Online scientific applications and application-hosting frameworks
with computing and storage for compute-intensive data analysis
(https://marketplace.egi.eu/42-applications-on-demand-beta).
Provided through EOSC-hub:
• Hosting platform, compute and storage, extendible with new applications,
application-hosting frameworks, and HTC or cloud resources: custom
applications can be executed on EGI Cloud Compute and High-Throughput
Compute services and offered as scalable, online services to researchers
worldwide
• Application porting support
To be funded in INFRAEOSC-04:
• Porting of applications and support to end-users
28
Applications on Demand
29
Run computational jobs at scale on the EGI infrastructure. It allows you
to analyse large datasets and execute thousands of parallel computing
tasks. HTC is provided by a distributed network of computing centres,
accessible via a standard interface and membership of a virtual
organisation (https://marketplace.egi.eu/32-high-throughput-
compute)
Provided through EOSC-hub:
• Technical support
• Capacity via brokering to national HTC providers
• Services to federate community-owned HTC clusters
To be funded in INFRAEOSC-04:
• Capacity for compute-intensive applications
• Service enabling via porting of community applications
Federated High Throughput
Computing (HTC)
30
Execute compute- and data-intensive workloads (both batch and interactive)
Host long-running services (e.g. web servers, databases or applications servers)
Create disposable testing and development environments on virtual machines and
scale your infrastructure needs (https://marketplace.egi.eu/31-cloud-compute).
Provided through EOSC-Hub:
• Multi-cloud IaaS with Single Sign-On (EGI Federated Cloud)
• Run Docker containers (deploy and scale Docker containers on-demand)
• Appliance Library to share and automatically distribute applications
Orchestration to easily move applications across providers.
• Unified web dashboard to interact with all providers.
• Services to federate community-owned cloud resources
• Technical support
To be funded in INFRAEOSC-04:
• Capacity for compute-intensive applications
• Service enabling via porting of community applications
Federated Computing IaaS
and PaaS
31
Processing of sensitive data
Provided through EOSC-Hub:
• If access to data is restricted by National or European regulations or by other
confidentiality policies, the sensitive data services provide:
- A secure IT platform to store, process, analyse and share data in a secured environment
- Provide secure, separated and private environments enforced via strong access rules
- Provide consultation and technical support to make use of the Sensitive Data Service
To be funded in INFRAEOSC-04:
• Service provisioning and capacity on the Sensitive Data Services
32
Share documents with live code, equations, visualisations
and explanatory text.
Provided through EOSC-hub:
● Jupyter Notebook service with
● AoD integration
● Persistent storage
● Customized notebook environments
● Access to other EOSC services from the notebooks
To be funded in INFRAEOSC-04:
● Community customisation & specific services instances.
Jupyter Notebook
33
• DIRAC4EGI: Workload management service to distribute
jobs and manage centrally thousands of computational
tasks on cloud and HTC
• TOSCA-based deployment orchestration on multiple IaaS
Provided through EOSC-hub:
● Operations of of workflow management system and orchestrator
● Technical Support
● Compute infrastructure, brokering to national compute providers
To be funded in INFRAEOSC-04:
● Community customisation & specific instances.
Scientific Workflow Management
and Orchestration
34
Discipline-specific data analytics 1/3
Who Service
WeNMR. A worldwide e-
Infrastructure for NMR
spectroscopy and Structural
biology
Amber is a suite of programs that allow users to perform molecular dynamics simulations on biological systems
HADDOCK is an information-driven flexible docking approach for the modelling of biomolecular complexes.
The CS-ROSETTA web server generates 3D models of proteins.
DISVIS allows visualising and quantifying the information content of distance restraints between macromolecular
complexes.
FANTEN is a user-friendly web tool for the determination of the anisotropy tensors and residual dipolar
couplings.
The GROMACS web server is an entry point for molecular dynamics on the grid.
POWERFIT performs a full-exhaustive 6-dimensional cross-correlation search between the atomic structure and
the density.
The UNIO web server is an entry point for molecular dynamics on the grid. Besides the application software, the
services also provide automated pre- and post-processing, the compute, storage and job scheduling and
monitoring for running the application.
ENES. Services for Climate
Modeling in Europe
The ENES Climate Analytics Service (ECAS) will enable scientific end-users to perform data analysis experiments
on large volumes of climate data, by exploiting a PID-enabled, server-side, and parallel approach
Compact Muon Solenoid
(CMS)
Dynamic On Demand Analysis Service (DODAS) provides dynamic generation of scalable, monitored HTCondor-
based batch system clusters and Spark/Hadoop-based Big Data clusters instantiated on-demand over IaaS clouds
35
Who Service
CLARIN (European Research
Infrastructure for Language
Resources and Technology)
The Component MetaData Infrastructure provides a framework to describe and reuse existing metadata
blueprints
INCD (Portuguese National
Infrastructure for Distributed
Computation that provides
scientific computing services
for science)
On-demand Operational Coastal Circulation Forecast Service (OPENCoastS) builds on-demand circulation
forecast systems for selected sections of the Portuguese coast
Earth Observation Data and
Adding Value Services
MEA is a geospatial data analysis tool empowered with OGC standard interfaces.
EPOSAR allows for a systematic generation of ground displacement maps and time series.
Sentinel Playground - provide access to complete archive of Sentinel-2 data and ESA Archive of Landsat 5,7 and
8.
Datacube Data Analytics Service proposes a multi-sensor, -scale and -purpose datacube approach.
Geohazards Exploitation Platform is focused on the integration of Ground Segment capabilities and ICT
technologies to maximise the exploitation of EO data.
OSS-X Sentinel Service is a web based system designed to provide EO data users with Search - Cataloguing -
Order and Dissemination capabilities for the Sentinel products.
EO Cloud is a cloud processing platform based on open source OpenStack technology.
EODC SDIP provides cloud, high performance computing and data storage facilities.
Discipline-specific data analytics 2/3
36
Discipline-specific data analytics 3/3
Who Service
DARIAH (pan-European
infrastructure for arts and
humanities)
DARIAH Science Gateway offers cloud-based services and applications to the humanities research
communities
IFREMER (operator of tools
for observing and monitoring
oceanographic databases)
The INFRAMER platform provides users with marine data collections from state-of-the art integrators in the
world. Data collections provided on the platform are public but might require specific license or citation
agreement from the users.
EISCAT (next generation
incoherent scatter radar
system)
The EISCAT_3D portal provides services for data cataloguing, discovery and pre-defined analysis
Manage, preserve and curate data according to domain specific policies
and provide access to HTC, HPC and Cloud for the processing and
analysis of data
● B2HANDLE
● B2SAFE
● European Trusted Digital Repositories
(3) Data Management, Curation and
Preservation
Making science referenceable (https://www.eudat.eu/services/userdoc/b2handle)
Provided through EOSC-Hub
● Distributed service for storing, managing and accessing persistent references
(PIDs) to scientific products
○ Unified technical interface for minting PIDs and PID namespaces (prefixes)
○ Replicated PIDs for high availability and resolution, including reserve lookups
○ Easy integratable and client-side application support through a Python library
To be funded in INFRAEOSC-04:
● Provisioning of community dedicated PID prefixes
● Provisioning of B2HANDLE service for minting PIDs
38
B2HANDLE
39
B2SAFE
Supporting data Management Policies (https://www.eudat.eu/b2safe)
Provided through EOSC-Hub:
● Service to implement data management policies in a distributed and federated
data infrastructure
○ Enabling access to large scale storage and archiving facilities
○ Replication, persistent identifier and data curation policies to secure data for long
term preservation according to domain specific policies;
○ Staging of data to HTC/HPC resources (EGI FedCloud, PRACE HPC, etc.)
○ Technical support on data management policies
To be funded in INFRAEOSC-04:
● Procurement of large pledges of
storage infrastructure to be
federated in EOSC
40
European Trusted Digital
Repositories
Provided through EOSC-hub:
● European Trusted Digital Repositories (ETDR) allowing RIs to publish
and manage data in:
○ Deposit data in repositories which are certified according to a requirements for
trusted digital repositories (e.g. CoreTrustSeal, Data Seal of Approval, Nestor
Seal or ISO16363)
○ Ensure reliability and durability, manage, share and curate data in a FAIR way
○ Consultancy to become an ETDR
To be funded in INFRAEOSC-04:
● Technical support to ingest data in ETDR
● Service provisioning and resources in an ETDR
Make digital objects (data, software and applications) identifiable and
share them with other researchers
● Application Database
● B2DROP
● B2NOTE
● B2SHARE
● DataHub
(4) Access, Deposition, Sharing
42
Share/Discover and Use of community-specific scientific software,
applications and cloud virtual appliances (https://appdb.egi.eu/)
EOSC-hub funded:
● Application Database platform operations
● Use to the service, including dashboard for managing VAs
● Technical support
● Support to packaging virtual appliances following security best practices
Application Database
43
B2DROP
Sync and share research data (https://www.eudat.eu/services/b2drop)
Provided through EOSC-hub:
● Store and share data with colleagues and team members, including research
data not finalised for publishing
○ Cloud storage to share data with fine-grained access controls
○ Synchronise multiple versions of data across different devices, including workflow and
computing environments
○ Publish data via B2SHARE
To be funded in INFRAEOSC-04:
● Provisioning and operation of a dedicated customized
B2DROP instance (if required)
44
B2NOTE
Use annotations to structure your data (https://b2note.eudat.eu/)
Provided through EOSC-hub:
● Manage and share annotations on data with colleagues and team members
○ Annotations are keywords or commentaries attached to a object, that explains or classifies
it.
○ B2NOTE annotation service is integrated with the B2SHARE service and technology
○ B2NOTE can be easily integrated with other community data repository services
○ Provide training on semantic annotations
To be funded in INFRAEOSC-04:
● Technical support on the integration of B2NOTE
annotation service into community services
45
Store and publish data (https://b2share.eudat.eu/)
Provided through EOSC-hub:
● Data repository & publishing service (B2SHARE) allowing RIs to publish and
manage data in a persistent way
○ Use of DataCite DOIs & EPIC PID
○ Domain specific metadata extensions
○ Manage the publish life cycle with version control
○ Community defined authorisation rules
○ Annotations via defined ontologies
B2SHARE
To be funded in INFRAEOSC-04:
● Customization and provisioning of a
(dedicated) B2SHARE instance
● Definition of FAIR implementation guidelines
(input to EOSC-hub)
46
Discovery, access and usage of reference open datasets and user data
● Federates existing data sources and data storage providers into one name
space
● Brings data to the multiple hybrid clouds and HTC
○ Increased accessibility of data to users → Bring data to computing
○ Scalable federation of distributed data providers
○ Publishing/DOIs
○ Use of eduGAIN and federated AAI
DataHub
Provided through EOSC-Hub:
● Technology and its support
● Test infrastructure
To be funded in INFRAEOSC-04:
● Storage capacity to scale up data infrastructure
● Dedicated support and service customization
47
EOSC-hub service catalogue
mapping to FAIR
Service F A I R
B2Handle X X X
B2Find X X X
Marketplace X X X
Application Database X
B2SHARE X X X X
B2DROP X
DataHub X X X X
European Trusted Digital
Repositories
X X X X
Findable Accessible Interoperable Reusable
Service F A I R
Federated AAI X
B2SAFE X
B2NOTE X X
Federated Cloud/HTC
Jupyter Notebook
Applications on Demand
Workflow Management
and orchestration
Sensitive Data Services
● Federated AAI
● Monitoring and accounting
● SLA and order management
● Security incident response and security policies
● Technical support and training
Federation services
49
EOSC-hub AAI
Services for Trust and Identity
Provided through EOSC-hub:
● Multi-tenant service for federated authentication and authorization supporting all
main standards
○ Only one account needed for federated access to multiple heterogeneous (web
and non-web) service providers using different technologies (SAML, OpenID
Connect, OAuth 2.0, X509)
○ Use of federated IdPs in eduGAIN
○ Identity linking enables access to resources using different login credentials
(institutional/social)
○ Aggregation and harmonisation of authorisation information from multiple
sources
To be funded by INFRAEOSC-04:
● Dedicated support
50
EOSC-hub AAI Architecture
Secure: operates under strict
security policies
Simple: hides the complexity
Low overhead: Easy integration of
multiple IdPs and AAs
Interoperable: AARC blueprint,
eduGAIN
REFEDS R&S and Sirtfi policies
51
• Only one account needed for federated access to
multiple heterogeneous (web and non-web) service
providers using different technologies (SAML, OpenID
Connect, OAuth 2.0, X509)
• Identity linking enables access to resources using
different login credentials (institutional/social)
• Aggregation and harmonisation of authorisation
information from multiple sources
• AAI is offered in two configurations
- As a service: EOSC-hub AAI catch-all instance
- Dedicated instance
Capabilities
52
• Management of shared services of the Hub and related processes
- Federated authentication and authentication
- Marketplace (discovery, order management, SLA management)
- Helpdesk for incident and problem management
▪ can be offered and branded as front desk of RI users
- IT Security Management (e.g. coordinated incident response,
security forensics/monitoring)
- Service quality assurance (auditing)
▪ accounting and monitoring infrastructure
- Service portfolio management
• Maintenance of the EOSC-hub corpus of policies
- data policies ← input from INFRAEOSC-04
- security policies ← input from INFRAEOSC-04
- standards roadmap ← input from INFRAEOSC-04
- FAIR implementation guidelines ← input from INFRAEOSC-04
Federated service management
53
Examples of use cases -
Competence Centres
Challenges Relevant EOSC-hub services
ELIXIR CC ● Establish a federation of cloud providers to replicate
ELIXIR Core Datasets and Applications
● Bring these cloud-data providers into EOSC
● Enable federated AAI across life science and EOSC
services
● Federated Cloud
● AAI
● Operational policies
● Experience with Virtual Access
● Code of Conduct for sensitive data
Fusion CC (ITER) ● Port fusion workflows to federated compute
environment
● Federate and enable access to distributed datasets
● Application and data provenance
● AAI
● Data and compute federation (containers)
● Workflow management
● Monitoring, helpdesk,
● PIDs, ...
Marine CC
(Ifremer, Euro-
Argo)
● Cloud-based data subscription and data delivery
service (from EMSO, Argo, SeaDataNet, etc.)
● Enabling users’ simulations to run within custom
environments on ‘subscribed data’
● Operate the setup as an EOSC service
● Storage and compute clusters
● Data discovery and staging (B2Find, B2Stage)
● Jupyter service (24/7)
● FitSM (IT service management)
EISCAT_3D CC ● Make EISCAT data accessible via a ‘data webshop’
● Enable online data analytics for researchers (based
on community and custom applications)
● Operate the data-compute portal as an EOSC service
● B2Share (metadata schema management)
● DIRAC file catalogue and application manager for researchers
● Federated compute sites (cloud)
● User authentication, authorisation (VOMS, Perun)
● FitSM (IT service management)
54
Examples of use cases -
Competence Centres (cont)
Challenges Relevant EOSC-hub services
EPOS - ORFEUS CC ● Effective transfer and staging of big data
● Harmonised data management policies at seismic
observatories
● Enable researchers to analyse data, create and
publish ‘user-defined data products’
● AAI
● Data staging and transfer services
● Federated compute services
● Jupyter (data access and analytics environment)
● Data Management good practices
Radio Astronomy
CC (LOFAR→ SKA)
● Enable researchers to find, access and process
data from the LOFAR Telescope
● Support application developers in deploying
workflows for researchers
● Support research users in data analytics on
federation of compute clusters
● B2Find - B2Share
● B2Stage
● B2Safe
● B2Handle (PIDs)
● Jupyter
● Federated compute and storage resources
ICOS-eLTER CC ● Enable researchers to find, access and process
data from ICOS and eLTER
● Integrate ICOS Portal and analysis tools with
large-scale storage and compute resources
● Support research users in data analytics on
federation of compute clusters
● B2Safe
● B2Find
● B2Stage
● Federated cloud
Disaster
Mitigation Plus CC
● Setup simulation web portals for simulation of
natural hazards (storm surge, dust transportation,
forest fire, flood)
● Federate environmental data from agencies in
Asia-Pacific region
● Federated compute resources (HTC and cloud)
● Operational tools
● FitSM

Mais conteúdo relacionado

Mais procurados

Grid Computing Systems and Resource Management
Grid Computing Systems and Resource ManagementGrid Computing Systems and Resource Management
Grid Computing Systems and Resource ManagementSouparnika Patil
 
Open source glam tools for building sustainable cultural heritage and digital...
Open source glam tools for building sustainable cultural heritage and digital...Open source glam tools for building sustainable cultural heritage and digital...
Open source glam tools for building sustainable cultural heritage and digital...LIBIS
 
Virtual BenchLearning - DeepHealth - Needs & Requirements for Benchmarking
Virtual BenchLearning - DeepHealth - Needs & Requirements for BenchmarkingVirtual BenchLearning - DeepHealth - Needs & Requirements for Benchmarking
Virtual BenchLearning - DeepHealth - Needs & Requirements for BenchmarkingBig Data Value Association
 
Implementation roadmap for the EOSC
Implementation roadmap for the EOSCImplementation roadmap for the EOSC
Implementation roadmap for the EOSCEOSC-hub project
 
EOSC-hub: A Collaborative Framework for the EOSC Implementation
EOSC-hub: A Collaborative Framework  for the EOSC ImplementationEOSC-hub: A Collaborative Framework  for the EOSC Implementation
EOSC-hub: A Collaborative Framework for the EOSC ImplementationEOSC-hub project
 
Purchasing from the Cloud, Cross Border Procurement and the role of GEANT as ...
Purchasing from the Cloud, Cross Border Procurement and the role of GEANT as ...Purchasing from the Cloud, Cross Border Procurement and the role of GEANT as ...
Purchasing from the Cloud, Cross Border Procurement and the role of GEANT as ...EOSC-hub project
 
The role of public procurement in the EOSC: previous experience and EOSC-hub ...
The role of public procurement in the EOSC: previous experience and EOSC-hub ...The role of public procurement in the EOSC: previous experience and EOSC-hub ...
The role of public procurement in the EOSC: previous experience and EOSC-hub ...EOSC-hub project
 
Integrating and managing services for the European Open Science Cloud
Integrating and managing services for the European Open Science CloudIntegrating and managing services for the European Open Science Cloud
Integrating and managing services for the European Open Science CloudOpenAIRE
 
European Open Science Cloud: Concept, status and opportunities
European Open Science Cloud: Concept, status and opportunitiesEuropean Open Science Cloud: Concept, status and opportunities
European Open Science Cloud: Concept, status and opportunitiesEOSC-hub project
 
Introduction to LoCloud Collections, Marcin Werla, Poznan Supercomputing Centre
Introduction to LoCloud Collections, Marcin Werla, Poznan Supercomputing CentreIntroduction to LoCloud Collections, Marcin Werla, Poznan Supercomputing Centre
Introduction to LoCloud Collections, Marcin Werla, Poznan Supercomputing Centrelocloud
 
Spatineo Webinar: Shedding Light on INSPIRE Conformity
Spatineo Webinar: Shedding Light on INSPIRE ConformitySpatineo Webinar: Shedding Light on INSPIRE Conformity
Spatineo Webinar: Shedding Light on INSPIRE ConformityIlkka Rinne
 
COMSODE networking session at ICT Lisbon 2015
COMSODE networking session at ICT Lisbon 2015COMSODE networking session at ICT Lisbon 2015
COMSODE networking session at ICT Lisbon 2015Comsode - FP7 project
 

Mais procurados (12)

Grid Computing Systems and Resource Management
Grid Computing Systems and Resource ManagementGrid Computing Systems and Resource Management
Grid Computing Systems and Resource Management
 
Open source glam tools for building sustainable cultural heritage and digital...
Open source glam tools for building sustainable cultural heritage and digital...Open source glam tools for building sustainable cultural heritage and digital...
Open source glam tools for building sustainable cultural heritage and digital...
 
Virtual BenchLearning - DeepHealth - Needs & Requirements for Benchmarking
Virtual BenchLearning - DeepHealth - Needs & Requirements for BenchmarkingVirtual BenchLearning - DeepHealth - Needs & Requirements for Benchmarking
Virtual BenchLearning - DeepHealth - Needs & Requirements for Benchmarking
 
Implementation roadmap for the EOSC
Implementation roadmap for the EOSCImplementation roadmap for the EOSC
Implementation roadmap for the EOSC
 
EOSC-hub: A Collaborative Framework for the EOSC Implementation
EOSC-hub: A Collaborative Framework  for the EOSC ImplementationEOSC-hub: A Collaborative Framework  for the EOSC Implementation
EOSC-hub: A Collaborative Framework for the EOSC Implementation
 
Purchasing from the Cloud, Cross Border Procurement and the role of GEANT as ...
Purchasing from the Cloud, Cross Border Procurement and the role of GEANT as ...Purchasing from the Cloud, Cross Border Procurement and the role of GEANT as ...
Purchasing from the Cloud, Cross Border Procurement and the role of GEANT as ...
 
The role of public procurement in the EOSC: previous experience and EOSC-hub ...
The role of public procurement in the EOSC: previous experience and EOSC-hub ...The role of public procurement in the EOSC: previous experience and EOSC-hub ...
The role of public procurement in the EOSC: previous experience and EOSC-hub ...
 
Integrating and managing services for the European Open Science Cloud
Integrating and managing services for the European Open Science CloudIntegrating and managing services for the European Open Science Cloud
Integrating and managing services for the European Open Science Cloud
 
European Open Science Cloud: Concept, status and opportunities
European Open Science Cloud: Concept, status and opportunitiesEuropean Open Science Cloud: Concept, status and opportunities
European Open Science Cloud: Concept, status and opportunities
 
Introduction to LoCloud Collections, Marcin Werla, Poznan Supercomputing Centre
Introduction to LoCloud Collections, Marcin Werla, Poznan Supercomputing CentreIntroduction to LoCloud Collections, Marcin Werla, Poznan Supercomputing Centre
Introduction to LoCloud Collections, Marcin Werla, Poznan Supercomputing Centre
 
Spatineo Webinar: Shedding Light on INSPIRE Conformity
Spatineo Webinar: Shedding Light on INSPIRE ConformitySpatineo Webinar: Shedding Light on INSPIRE Conformity
Spatineo Webinar: Shedding Light on INSPIRE Conformity
 
COMSODE networking session at ICT Lisbon 2015
COMSODE networking session at ICT Lisbon 2015COMSODE networking session at ICT Lisbon 2015
COMSODE networking session at ICT Lisbon 2015
 

Semelhante a Introduction to the EOSC-hub project

ELIXIR Competence Centre in EOSC-hub
ELIXIR Competence Centre in EOSC-hubELIXIR Competence Centre in EOSC-hub
ELIXIR Competence Centre in EOSC-hubEOSC-hub project
 
EGI-EUDAT interoperability| www.eudat.eu |
EGI-EUDAT interoperability| www.eudat.eu | EGI-EUDAT interoperability| www.eudat.eu |
EGI-EUDAT interoperability| www.eudat.eu | EUDAT
 
The Irish Centre for High End Computing and IBM - The role of advanced comput...
The Irish Centre for High End Computing and IBM - The role of advanced comput...The Irish Centre for High End Computing and IBM - The role of advanced comput...
The Irish Centre for High End Computing and IBM - The role of advanced comput...MarieThrseCulligan
 
The Irish Centre for High End Computing and IBM: The role of advanced computi...
The Irish Centre for High End Computing and IBM: The role of advanced computi...The Irish Centre for High End Computing and IBM: The role of advanced computi...
The Irish Centre for High End Computing and IBM: The role of advanced computi...MarieThrseCulligan
 
fiware_event_13_06_2023_fragkou_pavlina.pptx
fiware_event_13_06_2023_fragkou_pavlina.pptxfiware_event_13_06_2023_fragkou_pavlina.pptx
fiware_event_13_06_2023_fragkou_pavlina.pptxFIWARE
 
EOSC-Hub - Services for the European Open Science Cloud
EOSC-Hub - Services for the European Open Science CloudEOSC-Hub - Services for the European Open Science Cloud
EOSC-Hub - Services for the European Open Science Cloude-ROSA
 
Case study: How Cozy Cloud monitors every layer of its activity using OVH Met...
Case study: How Cozy Cloud monitors every layer of its activity using OVH Met...Case study: How Cozy Cloud monitors every layer of its activity using OVH Met...
Case study: How Cozy Cloud monitors every layer of its activity using OVH Met...OVHcloud
 
ENES Climate Analytics Service (ECAS)
ENES Climate Analytics Service (ECAS)ENES Climate Analytics Service (ECAS)
ENES Climate Analytics Service (ECAS)EOSC-hub project
 
RECAP at ETSI Experiential Network Intelligence (ENI) Meeting
RECAP at ETSI Experiential Network Intelligence (ENI) MeetingRECAP at ETSI Experiential Network Intelligence (ENI) Meeting
RECAP at ETSI Experiential Network Intelligence (ENI) MeetingRECAP Project
 
Cross e-Infrastructure collaborations
Cross e-Infrastructure collaborationsCross e-Infrastructure collaborations
Cross e-Infrastructure collaborationsEUDAT
 
GEO Analytics Canada Overview April 2020
GEO Analytics Canada Overview April 2020GEO Analytics Canada Overview April 2020
GEO Analytics Canada Overview April 2020GEO Analytics Canada
 
IoT Solutions for Smart Energy Smart Grid and Smart Utility Applications
IoT Solutions for Smart Energy Smart Grid and Smart Utility ApplicationsIoT Solutions for Smart Energy Smart Grid and Smart Utility Applications
IoT Solutions for Smart Energy Smart Grid and Smart Utility ApplicationsEurotech
 
Using the EGI Fed-Cloud for Data Analysis - EUDAT Summer School (Giuseppe La ...
Using the EGI Fed-Cloud for Data Analysis - EUDAT Summer School (Giuseppe La ...Using the EGI Fed-Cloud for Data Analysis - EUDAT Summer School (Giuseppe La ...
Using the EGI Fed-Cloud for Data Analysis - EUDAT Summer School (Giuseppe La ...EUDAT
 
RECAP Project Overview
RECAP Project OverviewRECAP Project Overview
RECAP Project OverviewRECAP Project
 
Eudat presentation nov2013 | www.eudat.eu |
Eudat presentation nov2013 | www.eudat.eu | Eudat presentation nov2013 | www.eudat.eu |
Eudat presentation nov2013 | www.eudat.eu | EUDAT
 
T6.6 Sensitive Data Activities
T6.6 Sensitive Data ActivitiesT6.6 Sensitive Data Activities
T6.6 Sensitive Data ActivitiesOpenAIRE
 
The EOSC Compute Platform with the EGI-ACE project
The EOSC Compute Platform with the EGI-ACE project The EOSC Compute Platform with the EGI-ACE project
The EOSC Compute Platform with the EGI-ACE project EGI Federation
 

Semelhante a Introduction to the EOSC-hub project (20)

ELIXIR Competence Centre in EOSC-hub
ELIXIR Competence Centre in EOSC-hubELIXIR Competence Centre in EOSC-hub
ELIXIR Competence Centre in EOSC-hub
 
ICOS Services and Products
ICOS Services and Products ICOS Services and Products
ICOS Services and Products
 
EGI-EUDAT interoperability| www.eudat.eu |
EGI-EUDAT interoperability| www.eudat.eu | EGI-EUDAT interoperability| www.eudat.eu |
EGI-EUDAT interoperability| www.eudat.eu |
 
2019 04-08 hopu-aj
2019 04-08 hopu-aj2019 04-08 hopu-aj
2019 04-08 hopu-aj
 
The Irish Centre for High End Computing and IBM - The role of advanced comput...
The Irish Centre for High End Computing and IBM - The role of advanced comput...The Irish Centre for High End Computing and IBM - The role of advanced comput...
The Irish Centre for High End Computing and IBM - The role of advanced comput...
 
The Irish Centre for High End Computing and IBM: The role of advanced computi...
The Irish Centre for High End Computing and IBM: The role of advanced computi...The Irish Centre for High End Computing and IBM: The role of advanced computi...
The Irish Centre for High End Computing and IBM: The role of advanced computi...
 
fiware_event_13_06_2023_fragkou_pavlina.pptx
fiware_event_13_06_2023_fragkou_pavlina.pptxfiware_event_13_06_2023_fragkou_pavlina.pptx
fiware_event_13_06_2023_fragkou_pavlina.pptx
 
EOSC-Hub - Services for the European Open Science Cloud
EOSC-Hub - Services for the European Open Science CloudEOSC-Hub - Services for the European Open Science Cloud
EOSC-Hub - Services for the European Open Science Cloud
 
Case study: How Cozy Cloud monitors every layer of its activity using OVH Met...
Case study: How Cozy Cloud monitors every layer of its activity using OVH Met...Case study: How Cozy Cloud monitors every layer of its activity using OVH Met...
Case study: How Cozy Cloud monitors every layer of its activity using OVH Met...
 
ENES Climate Analytics Service (ECAS)
ENES Climate Analytics Service (ECAS)ENES Climate Analytics Service (ECAS)
ENES Climate Analytics Service (ECAS)
 
RECAP at ETSI Experiential Network Intelligence (ENI) Meeting
RECAP at ETSI Experiential Network Intelligence (ENI) MeetingRECAP at ETSI Experiential Network Intelligence (ENI) Meeting
RECAP at ETSI Experiential Network Intelligence (ENI) Meeting
 
Cross e-Infrastructure collaborations
Cross e-Infrastructure collaborationsCross e-Infrastructure collaborations
Cross e-Infrastructure collaborations
 
GEO Analytics Canada Overview April 2020
GEO Analytics Canada Overview April 2020GEO Analytics Canada Overview April 2020
GEO Analytics Canada Overview April 2020
 
IoT Solutions for Smart Energy Smart Grid and Smart Utility Applications
IoT Solutions for Smart Energy Smart Grid and Smart Utility ApplicationsIoT Solutions for Smart Energy Smart Grid and Smart Utility Applications
IoT Solutions for Smart Energy Smart Grid and Smart Utility Applications
 
nstitutional repositories, item and research data metrics
nstitutional repositories, item and research data metricsnstitutional repositories, item and research data metrics
nstitutional repositories, item and research data metrics
 
Using the EGI Fed-Cloud for Data Analysis - EUDAT Summer School (Giuseppe La ...
Using the EGI Fed-Cloud for Data Analysis - EUDAT Summer School (Giuseppe La ...Using the EGI Fed-Cloud for Data Analysis - EUDAT Summer School (Giuseppe La ...
Using the EGI Fed-Cloud for Data Analysis - EUDAT Summer School (Giuseppe La ...
 
RECAP Project Overview
RECAP Project OverviewRECAP Project Overview
RECAP Project Overview
 
Eudat presentation nov2013 | www.eudat.eu |
Eudat presentation nov2013 | www.eudat.eu | Eudat presentation nov2013 | www.eudat.eu |
Eudat presentation nov2013 | www.eudat.eu |
 
T6.6 Sensitive Data Activities
T6.6 Sensitive Data ActivitiesT6.6 Sensitive Data Activities
T6.6 Sensitive Data Activities
 
The EOSC Compute Platform with the EGI-ACE project
The EOSC Compute Platform with the EGI-ACE project The EOSC Compute Platform with the EGI-ACE project
The EOSC Compute Platform with the EGI-ACE project
 

Mais de EOSC-hub project

EOSC-hub Early Adopter Programme
EOSC-hub Early Adopter ProgrammeEOSC-hub Early Adopter Programme
EOSC-hub Early Adopter ProgrammeEOSC-hub project
 
2019 05-21 egi and eosc - final
2019 05-21 egi and eosc - final2019 05-21 egi and eosc - final
2019 05-21 egi and eosc - finalEOSC-hub project
 
Introduction to service management and FitSM
Introduction to service management and FitSMIntroduction to service management and FitSM
Introduction to service management and FitSMEOSC-hub project
 
Service management board (SMB), Service providers’ forum (SPF)
Service management board (SMB), Service providers’ forum (SPF)Service management board (SMB), Service providers’ forum (SPF)
Service management board (SMB), Service providers’ forum (SPF)EOSC-hub project
 
Joining the EOSC-hub as a Service Provider
Joining the EOSC-hub as a Service ProviderJoining the EOSC-hub as a Service Provider
Joining the EOSC-hub as a Service ProviderEOSC-hub project
 
PID services - understandability and findability of data
PID services - understandability and findability of dataPID services - understandability and findability of data
PID services - understandability and findability of dataEOSC-hub project
 
Software for data management and exploitation
Software for data management and exploitationSoftware for data management and exploitation
Software for data management and exploitationEOSC-hub project
 
Repositories for long-term preservation - certification
Repositories for long-term preservation - certificationRepositories for long-term preservation - certification
Repositories for long-term preservation - certificationEOSC-hub project
 
EOSC working group on FAIR
EOSC working group on FAIREOSC working group on FAIR
EOSC working group on FAIREOSC-hub project
 
Updates on the FAIR Data Maturity Model RDA Working Group & the DG RTD FAIR i...
Updates on the FAIR Data Maturity Model RDA Working Group & the DG RTD FAIR i...Updates on the FAIR Data Maturity Model RDA Working Group & the DG RTD FAIR i...
Updates on the FAIR Data Maturity Model RDA Working Group & the DG RTD FAIR i...EOSC-hub project
 
Services to support FAIR data - Introduction
Services to support FAIR data - IntroductionServices to support FAIR data - Introduction
Services to support FAIR data - IntroductionEOSC-hub project
 
Pathways for EOSC-hub and MaX collaboration
Pathways for EOSC-hub and MaX collaborationPathways for EOSC-hub and MaX collaboration
Pathways for EOSC-hub and MaX collaborationEOSC-hub project
 
Overview on the HPC CoEs panorama
Overview on the HPC CoEs panoramaOverview on the HPC CoEs panorama
Overview on the HPC CoEs panoramaEOSC-hub project
 
Overview of the Onboarding and validation process and the Rules of Participat...
Overview of the Onboarding and validation process and the Rules of Participat...Overview of the Onboarding and validation process and the Rules of Participat...
Overview of the Onboarding and validation process and the Rules of Participat...EOSC-hub project
 
Data sharing in EOSC-hub: perspectives on “sensitive” data
Data sharing in EOSC-hub: perspectives on “sensitive” dataData sharing in EOSC-hub: perspectives on “sensitive” data
Data sharing in EOSC-hub: perspectives on “sensitive” dataEOSC-hub project
 

Mais de EOSC-hub project (20)

EOSC-hub Early Adopter Programme
EOSC-hub Early Adopter ProgrammeEOSC-hub Early Adopter Programme
EOSC-hub Early Adopter Programme
 
2019 05-21 egi and eosc - final
2019 05-21 egi and eosc - final2019 05-21 egi and eosc - final
2019 05-21 egi and eosc - final
 
Introduction to service management and FitSM
Introduction to service management and FitSMIntroduction to service management and FitSM
Introduction to service management and FitSM
 
Service management board (SMB), Service providers’ forum (SPF)
Service management board (SMB), Service providers’ forum (SPF)Service management board (SMB), Service providers’ forum (SPF)
Service management board (SMB), Service providers’ forum (SPF)
 
Joining the EOSC-hub as a Service Provider
Joining the EOSC-hub as a Service ProviderJoining the EOSC-hub as a Service Provider
Joining the EOSC-hub as a Service Provider
 
PID services - understandability and findability of data
PID services - understandability and findability of dataPID services - understandability and findability of data
PID services - understandability and findability of data
 
Software for data management and exploitation
Software for data management and exploitationSoftware for data management and exploitation
Software for data management and exploitation
 
Repositories for long-term preservation - certification
Repositories for long-term preservation - certificationRepositories for long-term preservation - certification
Repositories for long-term preservation - certification
 
EOSC working group on FAIR
EOSC working group on FAIREOSC working group on FAIR
EOSC working group on FAIR
 
Updates on the FAIR Data Maturity Model RDA Working Group & the DG RTD FAIR i...
Updates on the FAIR Data Maturity Model RDA Working Group & the DG RTD FAIR i...Updates on the FAIR Data Maturity Model RDA Working Group & the DG RTD FAIR i...
Updates on the FAIR Data Maturity Model RDA Working Group & the DG RTD FAIR i...
 
Services to support FAIR data - Introduction
Services to support FAIR data - IntroductionServices to support FAIR data - Introduction
Services to support FAIR data - Introduction
 
EOSC-synergy
EOSC-synergyEOSC-synergy
EOSC-synergy
 
ExPaNDS
ExPaNDSExPaNDS
ExPaNDS
 
EOSC-Pillar
EOSC-PillarEOSC-Pillar
EOSC-Pillar
 
NI4OS-Europe
NI4OS-EuropeNI4OS-Europe
NI4OS-Europe
 
Excellerat CoE
Excellerat CoEExcellerat CoE
Excellerat CoE
 
Pathways for EOSC-hub and MaX collaboration
Pathways for EOSC-hub and MaX collaborationPathways for EOSC-hub and MaX collaboration
Pathways for EOSC-hub and MaX collaboration
 
Overview on the HPC CoEs panorama
Overview on the HPC CoEs panoramaOverview on the HPC CoEs panorama
Overview on the HPC CoEs panorama
 
Overview of the Onboarding and validation process and the Rules of Participat...
Overview of the Onboarding and validation process and the Rules of Participat...Overview of the Onboarding and validation process and the Rules of Participat...
Overview of the Onboarding and validation process and the Rules of Participat...
 
Data sharing in EOSC-hub: perspectives on “sensitive” data
Data sharing in EOSC-hub: perspectives on “sensitive” dataData sharing in EOSC-hub: perspectives on “sensitive” data
Data sharing in EOSC-hub: perspectives on “sensitive” data
 

Último

10.National Rural Employment Programme.pptx
10.National Rural Employment Programme.pptx10.National Rural Employment Programme.pptx
10.National Rural Employment Programme.pptxBoobalanBala12
 
Tibetan Call Girls In Majnu Ka Tilla Delhi 9911107661
Tibetan Call Girls In Majnu Ka Tilla Delhi 9911107661Tibetan Call Girls In Majnu Ka Tilla Delhi 9911107661
Tibetan Call Girls In Majnu Ka Tilla Delhi 9911107661safdarjungdelhi1
 
High Class Escort Service in Marina +971509430017 Marina Escorts Service
High Class Escort Service in Marina +971509430017 Marina Escorts ServiceHigh Class Escort Service in Marina +971509430017 Marina Escorts Service
High Class Escort Service in Marina +971509430017 Marina Escorts Servicetajaga2345
 
Protecting your business: staying compliant with NFPA codes
Protecting your business: staying compliant with NFPA codesProtecting your business: staying compliant with NFPA codes
Protecting your business: staying compliant with NFPA codesStartech Engineering
 
Buy Facebook Marketing Services in Delhi - IndianLikes.com
Buy Facebook Marketing Services in Delhi - IndianLikes.comBuy Facebook Marketing Services in Delhi - IndianLikes.com
Buy Facebook Marketing Services in Delhi - IndianLikes.comSagar Sinha
 
KREATIVAN TECHNOLOGY IS THE BEST DIGITAL COMPANY IN CHANDIGARH
KREATIVAN TECHNOLOGY IS THE BEST DIGITAL COMPANY IN CHANDIGARHKREATIVAN TECHNOLOGY IS THE BEST DIGITAL COMPANY IN CHANDIGARH
KREATIVAN TECHNOLOGY IS THE BEST DIGITAL COMPANY IN CHANDIGARHKreativan Technologies
 
Dubai Call Girls Riri O525547819 Call Girls Dubai
Dubai Call Girls Riri O525547819 Call Girls DubaiDubai Call Girls Riri O525547819 Call Girls Dubai
Dubai Call Girls Riri O525547819 Call Girls Dubaikojalkojal131
 
What are the major challenges while integrating Salesforce
What are the major challenges while integrating SalesforceWhat are the major challenges while integrating Salesforce
What are the major challenges while integrating SalesforceNaresh Gupta
 
kreativan technology is a best IT company
kreativan technology is a best IT companykreativan technology is a best IT company
kreativan technology is a best IT companyKreativan Technologies
 
Challenges for Salesforce CRM Implementation
Challenges for Salesforce CRM ImplementationChallenges for Salesforce CRM Implementation
Challenges for Salesforce CRM ImplementationNaresh Gupta
 
High Class Escort Service in Ajman +971509430017 Ajman Escorts Service
High Class Escort Service in Ajman +971509430017 Ajman Escorts ServiceHigh Class Escort Service in Ajman +971509430017 Ajman Escorts Service
High Class Escort Service in Ajman +971509430017 Ajman Escorts Servicetajaga2345
 
Customize Your Positioning System with Partner Solutions.ppt
Customize Your Positioning System with Partner Solutions.pptCustomize Your Positioning System with Partner Solutions.ppt
Customize Your Positioning System with Partner Solutions.pptUbiTrack UK
 
Balancing Sexual Desires for a Happier Relationship_ An Astrological Perspect...
Balancing Sexual Desires for a Happier Relationship_ An Astrological Perspect...Balancing Sexual Desires for a Happier Relationship_ An Astrological Perspect...
Balancing Sexual Desires for a Happier Relationship_ An Astrological Perspect...shubhamaapkikismat
 
Boost Your Brand with Professional Digital Marketing Company in Noida
Boost Your Brand with Professional Digital Marketing Company in NoidaBoost Your Brand with Professional Digital Marketing Company in Noida
Boost Your Brand with Professional Digital Marketing Company in NoidaWAFI Media Marketing Solutions
 
Online Dating Precautions How Background Checks Can Safeguard You
Online Dating Precautions How Background Checks Can Safeguard YouOnline Dating Precautions How Background Checks Can Safeguard You
Online Dating Precautions How Background Checks Can Safeguard Youaffordablebackgroundchecks
 
Amil Baba In Pakistan Authentic Amil In pakistan Best Amil In Pak
Amil Baba In Pakistan Authentic Amil In pakistan Best Amil In PakAmil Baba In Pakistan Authentic Amil In pakistan Best Amil In Pak
Amil Baba In Pakistan Authentic Amil In pakistan Best Amil In Pakdilawarshahuk
 
_Al Afnan Steel Industrial Company _LLC_
_Al Afnan Steel Industrial Company _LLC__Al Afnan Steel Industrial Company _LLC_
_Al Afnan Steel Industrial Company _LLC_alafnanmetals
 
Understanding QuickBooks Reconciliation Discrepancy
Understanding QuickBooks Reconciliation DiscrepancyUnderstanding QuickBooks Reconciliation Discrepancy
Understanding QuickBooks Reconciliation Discrepancykatejenifer990
 
Justdial Call Girls In Moolchand Metro Delhi 9911191017 Escorts Service
Justdial Call Girls In Moolchand Metro Delhi 9911191017 Escorts ServiceJustdial Call Girls In Moolchand Metro Delhi 9911191017 Escorts Service
Justdial Call Girls In Moolchand Metro Delhi 9911191017 Escorts Servicesafdarjungdelhi1
 

Último (20)

10.National Rural Employment Programme.pptx
10.National Rural Employment Programme.pptx10.National Rural Employment Programme.pptx
10.National Rural Employment Programme.pptx
 
Tibetan Call Girls In Majnu Ka Tilla Delhi 9911107661
Tibetan Call Girls In Majnu Ka Tilla Delhi 9911107661Tibetan Call Girls In Majnu Ka Tilla Delhi 9911107661
Tibetan Call Girls In Majnu Ka Tilla Delhi 9911107661
 
High Class Escort Service in Marina +971509430017 Marina Escorts Service
High Class Escort Service in Marina +971509430017 Marina Escorts ServiceHigh Class Escort Service in Marina +971509430017 Marina Escorts Service
High Class Escort Service in Marina +971509430017 Marina Escorts Service
 
Protecting your business: staying compliant with NFPA codes
Protecting your business: staying compliant with NFPA codesProtecting your business: staying compliant with NFPA codes
Protecting your business: staying compliant with NFPA codes
 
Buy Facebook Marketing Services in Delhi - IndianLikes.com
Buy Facebook Marketing Services in Delhi - IndianLikes.comBuy Facebook Marketing Services in Delhi - IndianLikes.com
Buy Facebook Marketing Services in Delhi - IndianLikes.com
 
Search Engine optimization and its types
Search Engine optimization and its typesSearch Engine optimization and its types
Search Engine optimization and its types
 
KREATIVAN TECHNOLOGY IS THE BEST DIGITAL COMPANY IN CHANDIGARH
KREATIVAN TECHNOLOGY IS THE BEST DIGITAL COMPANY IN CHANDIGARHKREATIVAN TECHNOLOGY IS THE BEST DIGITAL COMPANY IN CHANDIGARH
KREATIVAN TECHNOLOGY IS THE BEST DIGITAL COMPANY IN CHANDIGARH
 
Dubai Call Girls Riri O525547819 Call Girls Dubai
Dubai Call Girls Riri O525547819 Call Girls DubaiDubai Call Girls Riri O525547819 Call Girls Dubai
Dubai Call Girls Riri O525547819 Call Girls Dubai
 
What are the major challenges while integrating Salesforce
What are the major challenges while integrating SalesforceWhat are the major challenges while integrating Salesforce
What are the major challenges while integrating Salesforce
 
kreativan technology is a best IT company
kreativan technology is a best IT companykreativan technology is a best IT company
kreativan technology is a best IT company
 
Challenges for Salesforce CRM Implementation
Challenges for Salesforce CRM ImplementationChallenges for Salesforce CRM Implementation
Challenges for Salesforce CRM Implementation
 
High Class Escort Service in Ajman +971509430017 Ajman Escorts Service
High Class Escort Service in Ajman +971509430017 Ajman Escorts ServiceHigh Class Escort Service in Ajman +971509430017 Ajman Escorts Service
High Class Escort Service in Ajman +971509430017 Ajman Escorts Service
 
Customize Your Positioning System with Partner Solutions.ppt
Customize Your Positioning System with Partner Solutions.pptCustomize Your Positioning System with Partner Solutions.ppt
Customize Your Positioning System with Partner Solutions.ppt
 
Balancing Sexual Desires for a Happier Relationship_ An Astrological Perspect...
Balancing Sexual Desires for a Happier Relationship_ An Astrological Perspect...Balancing Sexual Desires for a Happier Relationship_ An Astrological Perspect...
Balancing Sexual Desires for a Happier Relationship_ An Astrological Perspect...
 
Boost Your Brand with Professional Digital Marketing Company in Noida
Boost Your Brand with Professional Digital Marketing Company in NoidaBoost Your Brand with Professional Digital Marketing Company in Noida
Boost Your Brand with Professional Digital Marketing Company in Noida
 
Online Dating Precautions How Background Checks Can Safeguard You
Online Dating Precautions How Background Checks Can Safeguard YouOnline Dating Precautions How Background Checks Can Safeguard You
Online Dating Precautions How Background Checks Can Safeguard You
 
Amil Baba In Pakistan Authentic Amil In pakistan Best Amil In Pak
Amil Baba In Pakistan Authentic Amil In pakistan Best Amil In PakAmil Baba In Pakistan Authentic Amil In pakistan Best Amil In Pak
Amil Baba In Pakistan Authentic Amil In pakistan Best Amil In Pak
 
_Al Afnan Steel Industrial Company _LLC_
_Al Afnan Steel Industrial Company _LLC__Al Afnan Steel Industrial Company _LLC_
_Al Afnan Steel Industrial Company _LLC_
 
Understanding QuickBooks Reconciliation Discrepancy
Understanding QuickBooks Reconciliation DiscrepancyUnderstanding QuickBooks Reconciliation Discrepancy
Understanding QuickBooks Reconciliation Discrepancy
 
Justdial Call Girls In Moolchand Metro Delhi 9911191017 Escorts Service
Justdial Call Girls In Moolchand Metro Delhi 9911191017 Escorts ServiceJustdial Call Girls In Moolchand Metro Delhi 9911191017 Escorts Service
Justdial Call Girls In Moolchand Metro Delhi 9911191017 Escorts Service
 

Introduction to the EOSC-hub project

  • 1. eosc-hub.eu @EOSC_eu EOSC-hub receives funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No. 777536. Gergely Sipos (EGI Foundation) Integrating and managing services for the European Open Science Cloud The EOSC-hub project
  • 2. 2 EOSC-hub factsheet The Hub Service delivery - Who - What - How Service adoption - Thematic Services - Competence Centres - New communities Extra slides: service technical details 3/23/2018 Outline
  • 3. 33/23/2018 EOSC-hub mobilises providers from 20 major digital infrastructures, EGI*, EUDAT CDI** and INDIGO-DataCloud jointly offering services, software and data for advanced data-driven research and innovation. * EGI is not an acronym (any more) ** CDI – Collaborative Data Infrastructure
  • 4. 4 European Commission Horizon2020 programme 100 Partners, 76 beneficiaries (75 funded) 3874 PMs, 108 FTEs, more than 200 technical and scientific staff involved - €33,331,18, funded by:  European Commission: €30,000,000  EGI Foundation and its participants: €2,155,540  EGI participants: €1,221,094 36 months: Jan 2018 – Dec 2020 3/23/2018 Project figures
  • 5. 53/23/2018 EOSC-hub Mission 3/23/2018 5 The project will create EOSC Hub: a federated integration and management system for EOSC • Data • Applications & tools • Baseline services (storage, compute, connectivity)… • Training, consultants • Marketplace • AAI • Accounting • Monitoring • … • Security regulations, • Compliance to standards, • Terms of use, • FAIR implementation guidelines • … Usage according to Principles of engagement (see also EOSCpilot WP2) From the consortium AND from external contributors • Lightweight certification of providers • SLA negotiation • Customer Relationship Management • … Services Federation services Federated operations Processes and policies Based on FitSM
  • 7. 73/23/2018 Service Providers e-Infra EGI Federation EUDAT CDI Humanities Language and literature (CLARIN) Arts (DARIAH) Engineering Environmen tal engineering (sea vessels, LNEC) Civil Engineering (Disaster Mitigation) Medical and Health Sciences Biological Sciences (ELIXIR) Structural biology (WeNMR) Natural sciences Generic services Physical Sciences • Astronomy (LOFAR) • Fusion (ITER) • High Energy Physics (CMS and VIRGO) • Space Science (EISCAT-3D) Earth Science • EO Pillar • GEO • Climate Research (ENES) • Seismology (ORFEUS, EPOS) Biological Sciences • Marine and freshwater biology (IFREMER) • Biodiversity conservation (LifeWatch) • Ecology (ICOS)
  • 8. Open Collaboration services Basic infrastructure and added- value services Federation services • Applications Database • Repositories • Accounting • ARGO • Check-in • GGUS • GOCDB • Marketplace • Operations Portal • RC Auth • SPMT • DPMT • B2ACCESS • TTS • SYMON • EGI High-Throughput Compute • EGI Cloud Compute • EGI Cloud Container • DIRAC4EGI • EGI Online storage • EGI DataHub • B2HANDLE • B2FIND • B2DROP • B2SAFE • B2STAGE • B2NOTE • ETDR • Sensitive Data Service • Advanced IaaS • TOSCA for Heat • OPIE 83/23/2018 Service catalogue https://wiki.eosc-hub.eu/display/EOSC/EOSC-hub+service+catalogue WP6WP5 WP5 Thematic services WP7 • ECAS • DARIAH Gateway • OPENCoastS • GEOSS • EO Pillar • WeNMR • DODAS • LifeWatch • CMI From month 19: • IFREMER • EISCAT_3D Portal
  • 9. 93/23/2018 Generic services Open Collaboration services • Applications Database: Virtual appliances and application software repository and management • Repositories: Repositories of verified software to be deployed by the Service Providers
  • 10. 103/23/2018 Generic services Federation services • Accounting: Infrastructure composed by repositories and portal to collect usage statistics of the EOSC-hub services and present them to the stakeholders • ARGO: Monitoring infrastructure to track services status and collect statistics • Check-in: AAI platform for federated authentication to EGI services • GGUS: Helpdesk platform for the EGI infrastructure • GOCDB: Configuration database, service registry • Marketplace: Exposes the service catalogue to services and collects service orders • Operations Portal: Operational tools to manage distributed infrastructures • RCAuth: Online CA for the translation of credentials to X.509 certificates • SPMT: Service portfolio management tool • DPMT: Configuration management & data management tool for the users • B2ACCESS: AAI platform for federated authentication to EUDAT services • TTS: RT-based helpdesk service for the EUDAT infrastructure • SYMON: Service to monitor the deployed service versions
  • 11. 113/23/2018 Generic services Basic infrastructure and added-value services • EGI HTC: High-throughput compute • EGI Cloud Compute: Infrastructure as a service cloud compute • EGI Cloud Container: Docker containers cloud computing • DIRAC4EGI: Workload management service for computational tasks both on cloud and HTC • EGI Online storage: Store data in a reliable and high-quality environment and share it across distributed teams • EGI DataHub: Access public datasets and consume them from compute services • B2HANDLE: Persistent ID management • B2FIND: Metadata based data-discovery service • B2DROP: Secure and trusted data exchange service for researchers • B2SAFE: Distribute and store large volumes of data based on data policies • B2STAGE: Data transfer between resources and computational facilities • B2SHARE: Store / publish research data • B2NOTE: Data annotation service • ETDR: European certified Trusted Digital Repository • Sensitive Data Service • Advanced IaaS • TOSCA for Heat: Support for TOSCA templates in OpenStack heat component • OPIE: Open source implementation of spot instance virtual machines for OpenStack
  • 12. 123/23/2018 Disciplinary services Thematic services • ECAS: Climate Analytics Service • DARIAH Gateway: A portal tailored for the digital arts and humanities communities • OPENCoastS: On-demand Operational Coastal Circulation Forecast Service • GEOSS: GEO DAB (Discovery and Access Broker), GEOSS portal • EO Pillar: Earth observation services coordinated by ESA. The tools are: MEA, EPOSAR, Sentinel playground, Datacube analytic service, Geohazards exploitation platform, OSS-X Sentinel service • WeNMR: Online portals for structural biology analytics: DISVIS, POWERFIT, HADDOCK, GROMACS, AMPS-NMR, CS-ROSETTA, UNIO, FANTEN • DODAS: Dynamic On Demand Analysis Service • LifeWatch: PAIRQURS, Citizen science services, GBIF, Digital Knowledge preservation framework, remote monitoring and smart sensing. • CMI: The Component MetaData Infrastructure, including the Virtual Language Observatory and the Virtual Collection Registry. Provided by CLARIN-ERIC
  • 13. 133/23/2018 Mapping Services to the research data lifecycle Processing & Analysis Data Management, Curation & Preservation Access, Deposition & Sharing Federation Services ● B2FIND (data) ● Marketplace (Services) ● Applications on Demand ● Federated HTC & Cloud Compute IaaS & PaaS ● Processing of sensitive data ● Jupyter Notebook ● Application DB (software & VM) ● B2DROP (data) ● B2Note (data) ● B2SHARE (data) ● DataHub ● Federated AAI. monitoring, accounting ● SLA and order Management ● Security incident response and policies ● Technical support & Training ● B2HANDLE ● B2SAFE ● European Certified Trusted Repository ● Thematic data analytics ● Scientific Workflow Management, Orchestration (DIRAC, PaaS Orchestrator) 1 2 3 4 Discover & Reuse EOSC-hub service catalogue: https://wiki.eosc-hub.eu/display/EOSC/EOSC-hub+service+catalogue
  • 14. 14 IT Service Management • Why IT service management (ITSM)? – About 80% of all IT service outages originate from "people and process issues" – Duration of outages and degradations significantly dependent on non-technical factors • IT service management – Focuses on the provision of high quality IT services that meet customers' and users’ expectations – Defines, documents and maintains service management processes through assigned roles and responsibilities Reasons for service outages [Gartner]
  • 15. 15 FitSM: Requirements • FitSM defines 85 requirements that should be fulfilled by an organisation (or federation) offering IT services to customers • Compliance with the 85 requirements can be regarded as a "proof of effectiveness" • The 85 requirements are structured as follows: –16 general requirements (GR) –69 process-specific requirements (PR) • Consideration of the 14 IT service management processes from the FitSM process model • Between 2 and 8 requirements per process FitSM service management processes: • Service portfolio management • Service level management • Incident management • Change management • Capacity management • Information security management • … Example – Service Portfolio Management requirements: PR1.1 A service portfolio shall be maintained. All services shall be specified as part of the service portfolio. PR1.2 Design and transition of new or changed services shall be planned. PR1.3 Plans for the design and transition of new or changed services shall consider timescales, responsibilities, new or changed technology, communication and service acceptance criteria. PR1.4 The organisational structure supporting the delivery of services shall be identified, including a potential federation structure as well as contact points for all parties involved.
  • 16. 16 Addressing requirements: Technical tools • Process documentation – e.g. Confluence, Wikimedia • Ticket tool – e.g. GGUS, JIRA, RT • Templates – e.g. Word docs, Excel, Google Apps, Forms 6 Feb 2018, GoToWebinar
  • 17. 173/23/2018 Adoption of generic services Thematic services Common services Data analytics & Community- specific Services Open Collaboration Services Application/sof tware repository, Configuration management, Marketplace Federation Services AAI, Accounting, Monitoring, Operations, Security Added value services Compute, data, software management, curation & preservation Basic infrastructure Compute and storage integration Competence Centres incubate Service catalogue: https://wiki.eosc-hub.eu/display/EOSC/EOSC-hub+service+catalogue WP5 WP5WP6 WP6 WP7 WP8 New communities integration Engagement and support for new communities Provide Including Disaster Mitigation Competence Centre
  • 18. 3/23/2018 18 Disaster Mitigation+ CC (TW, PH, MY, ID, DE, CZ, JP)
  • 19. 19 1. Request services AND/OR inclusion in the EOSC-hub catalogue: http://eosc-hub.eu/contact-us-0 (online form) (This will be soon replaced with the EOSC-hub Marketplace) 2. Support team contacts you to discuss details (skype/phone) 4. Regular ‘satisfaction interviews’ (~3/6 months) 3/23/2018 Engagement steplist for new user or provider communities • If user community: • EOSC-hub negotiates conditions with providers • EOSC-hub signs SLA with the new community • If provider community: • EOSC-hub signs OLA with the new community B O T H 3.
  • 20. 20 Both in EINFRA-12 (topic A and B) - EOSC-hub ~ storage, compute, application services - OpenAIRE ~ RDM; Publication services Let’s support Open Science together! - Joint workplan plan  Technical integration of online services  Dissemination, community building, support, training  Governance 3/23/2018 EOSC-hub – OpenAIRE-Advance collaboration
  • 21. 21 • EOSC-hub week, Malaga:http://eosc- hub.eu/news/eosc-hub-launches-its-first-eosc-hub- week-16-20-april-2018-malaga-spain-join-us 1. Public days: 16-17 Aprilhttp://eosc-hub.eu/eosc-hub-week-2018- programme ▪ Session on Comp Centres, Thematic Services, Demonstrators : http://eosc-hub.eu/scientific-communities-eosc-hub-and-eoscpilot 2. Project members’ all-hands meeting: 18-20 April ▪ 3 sessions about Competence Centre setup&validation plans 3/23/2018 Next event
  • 22. eosc-hub.eu @EOSC_eu Thank you for your attention! Contact: Gergely.sipos@egi.eu www.eosc-hub.eu Questions?
  • 23. DETAILS ON INDIVIDUAL SERVICES Extra slides:
  • 24. Enhance discovery and reuse of scientific products across communities B2Find Marketplace (1)Discover and Reuse
  • 25. 25 Making Open Science findable (http://b2find.eudat.eu/) Provided through EOSC-hub ● Cross-disciplinary metadata and discovery service (B2FIND) allowing RI to make their data findable and discoverable in a central catalogue ○ Metadata can be harvested via OAI-PMH. Possibility to use also APIs as JSON-API’s and CSW2.0 to collect the metadata from the communities. ○ The project provides support to integrate community data catalogue To be funded in INFRAEOSC-04 ● Elicitation & mapping of metadata schemas in use within the community ● Definition of FAIR implementation guidelines (input to EOSC-hub) B2FIND
  • 26. 26 Provided through EOSC-hub: ● Marketplace: multi-tenant user-facing platform for service providers to publish their EOSC services and EOSC-compliant data repositories, and collect service orders ○ Mature services and curated data ○ The RI retains control and accountability for the services and data published and participate in the management of the Hub service portfolio ○ Support to usage of common service templates To be funded in INFRAEOSC-04: ● Service design to set-up a cluster-wide or RI-specific service portfolio ● Advice on ISO-compliant service portfolio management process, auditing ● Operation of a dedicated customized marketplace (if necessary) EOSC-hub Marketplace
  • 27. Scale out your computing environment and process & analyse data in a federated environment ● Applications on Demand ● Federated High Throughput Computing ● Federated Cloud Compute IaaS and PaaS ● Processing of sensitive data ● Jupyter ● Scientific Workflow Management, Orchestration (DIRAC, PaaS Orchestration) ● Discipline-specific data analytics tools (2) Processing and Analysis
  • 28. Online scientific applications and application-hosting frameworks with computing and storage for compute-intensive data analysis (https://marketplace.egi.eu/42-applications-on-demand-beta). Provided through EOSC-hub: • Hosting platform, compute and storage, extendible with new applications, application-hosting frameworks, and HTC or cloud resources: custom applications can be executed on EGI Cloud Compute and High-Throughput Compute services and offered as scalable, online services to researchers worldwide • Application porting support To be funded in INFRAEOSC-04: • Porting of applications and support to end-users 28 Applications on Demand
  • 29. 29 Run computational jobs at scale on the EGI infrastructure. It allows you to analyse large datasets and execute thousands of parallel computing tasks. HTC is provided by a distributed network of computing centres, accessible via a standard interface and membership of a virtual organisation (https://marketplace.egi.eu/32-high-throughput- compute) Provided through EOSC-hub: • Technical support • Capacity via brokering to national HTC providers • Services to federate community-owned HTC clusters To be funded in INFRAEOSC-04: • Capacity for compute-intensive applications • Service enabling via porting of community applications Federated High Throughput Computing (HTC)
  • 30. 30 Execute compute- and data-intensive workloads (both batch and interactive) Host long-running services (e.g. web servers, databases or applications servers) Create disposable testing and development environments on virtual machines and scale your infrastructure needs (https://marketplace.egi.eu/31-cloud-compute). Provided through EOSC-Hub: • Multi-cloud IaaS with Single Sign-On (EGI Federated Cloud) • Run Docker containers (deploy and scale Docker containers on-demand) • Appliance Library to share and automatically distribute applications Orchestration to easily move applications across providers. • Unified web dashboard to interact with all providers. • Services to federate community-owned cloud resources • Technical support To be funded in INFRAEOSC-04: • Capacity for compute-intensive applications • Service enabling via porting of community applications Federated Computing IaaS and PaaS
  • 31. 31 Processing of sensitive data Provided through EOSC-Hub: • If access to data is restricted by National or European regulations or by other confidentiality policies, the sensitive data services provide: - A secure IT platform to store, process, analyse and share data in a secured environment - Provide secure, separated and private environments enforced via strong access rules - Provide consultation and technical support to make use of the Sensitive Data Service To be funded in INFRAEOSC-04: • Service provisioning and capacity on the Sensitive Data Services
  • 32. 32 Share documents with live code, equations, visualisations and explanatory text. Provided through EOSC-hub: ● Jupyter Notebook service with ● AoD integration ● Persistent storage ● Customized notebook environments ● Access to other EOSC services from the notebooks To be funded in INFRAEOSC-04: ● Community customisation & specific services instances. Jupyter Notebook
  • 33. 33 • DIRAC4EGI: Workload management service to distribute jobs and manage centrally thousands of computational tasks on cloud and HTC • TOSCA-based deployment orchestration on multiple IaaS Provided through EOSC-hub: ● Operations of of workflow management system and orchestrator ● Technical Support ● Compute infrastructure, brokering to national compute providers To be funded in INFRAEOSC-04: ● Community customisation & specific instances. Scientific Workflow Management and Orchestration
  • 34. 34 Discipline-specific data analytics 1/3 Who Service WeNMR. A worldwide e- Infrastructure for NMR spectroscopy and Structural biology Amber is a suite of programs that allow users to perform molecular dynamics simulations on biological systems HADDOCK is an information-driven flexible docking approach for the modelling of biomolecular complexes. The CS-ROSETTA web server generates 3D models of proteins. DISVIS allows visualising and quantifying the information content of distance restraints between macromolecular complexes. FANTEN is a user-friendly web tool for the determination of the anisotropy tensors and residual dipolar couplings. The GROMACS web server is an entry point for molecular dynamics on the grid. POWERFIT performs a full-exhaustive 6-dimensional cross-correlation search between the atomic structure and the density. The UNIO web server is an entry point for molecular dynamics on the grid. Besides the application software, the services also provide automated pre- and post-processing, the compute, storage and job scheduling and monitoring for running the application. ENES. Services for Climate Modeling in Europe The ENES Climate Analytics Service (ECAS) will enable scientific end-users to perform data analysis experiments on large volumes of climate data, by exploiting a PID-enabled, server-side, and parallel approach Compact Muon Solenoid (CMS) Dynamic On Demand Analysis Service (DODAS) provides dynamic generation of scalable, monitored HTCondor- based batch system clusters and Spark/Hadoop-based Big Data clusters instantiated on-demand over IaaS clouds
  • 35. 35 Who Service CLARIN (European Research Infrastructure for Language Resources and Technology) The Component MetaData Infrastructure provides a framework to describe and reuse existing metadata blueprints INCD (Portuguese National Infrastructure for Distributed Computation that provides scientific computing services for science) On-demand Operational Coastal Circulation Forecast Service (OPENCoastS) builds on-demand circulation forecast systems for selected sections of the Portuguese coast Earth Observation Data and Adding Value Services MEA is a geospatial data analysis tool empowered with OGC standard interfaces. EPOSAR allows for a systematic generation of ground displacement maps and time series. Sentinel Playground - provide access to complete archive of Sentinel-2 data and ESA Archive of Landsat 5,7 and 8. Datacube Data Analytics Service proposes a multi-sensor, -scale and -purpose datacube approach. Geohazards Exploitation Platform is focused on the integration of Ground Segment capabilities and ICT technologies to maximise the exploitation of EO data. OSS-X Sentinel Service is a web based system designed to provide EO data users with Search - Cataloguing - Order and Dissemination capabilities for the Sentinel products. EO Cloud is a cloud processing platform based on open source OpenStack technology. EODC SDIP provides cloud, high performance computing and data storage facilities. Discipline-specific data analytics 2/3
  • 36. 36 Discipline-specific data analytics 3/3 Who Service DARIAH (pan-European infrastructure for arts and humanities) DARIAH Science Gateway offers cloud-based services and applications to the humanities research communities IFREMER (operator of tools for observing and monitoring oceanographic databases) The INFRAMER platform provides users with marine data collections from state-of-the art integrators in the world. Data collections provided on the platform are public but might require specific license or citation agreement from the users. EISCAT (next generation incoherent scatter radar system) The EISCAT_3D portal provides services for data cataloguing, discovery and pre-defined analysis
  • 37. Manage, preserve and curate data according to domain specific policies and provide access to HTC, HPC and Cloud for the processing and analysis of data ● B2HANDLE ● B2SAFE ● European Trusted Digital Repositories (3) Data Management, Curation and Preservation
  • 38. Making science referenceable (https://www.eudat.eu/services/userdoc/b2handle) Provided through EOSC-Hub ● Distributed service for storing, managing and accessing persistent references (PIDs) to scientific products ○ Unified technical interface for minting PIDs and PID namespaces (prefixes) ○ Replicated PIDs for high availability and resolution, including reserve lookups ○ Easy integratable and client-side application support through a Python library To be funded in INFRAEOSC-04: ● Provisioning of community dedicated PID prefixes ● Provisioning of B2HANDLE service for minting PIDs 38 B2HANDLE
  • 39. 39 B2SAFE Supporting data Management Policies (https://www.eudat.eu/b2safe) Provided through EOSC-Hub: ● Service to implement data management policies in a distributed and federated data infrastructure ○ Enabling access to large scale storage and archiving facilities ○ Replication, persistent identifier and data curation policies to secure data for long term preservation according to domain specific policies; ○ Staging of data to HTC/HPC resources (EGI FedCloud, PRACE HPC, etc.) ○ Technical support on data management policies To be funded in INFRAEOSC-04: ● Procurement of large pledges of storage infrastructure to be federated in EOSC
  • 40. 40 European Trusted Digital Repositories Provided through EOSC-hub: ● European Trusted Digital Repositories (ETDR) allowing RIs to publish and manage data in: ○ Deposit data in repositories which are certified according to a requirements for trusted digital repositories (e.g. CoreTrustSeal, Data Seal of Approval, Nestor Seal or ISO16363) ○ Ensure reliability and durability, manage, share and curate data in a FAIR way ○ Consultancy to become an ETDR To be funded in INFRAEOSC-04: ● Technical support to ingest data in ETDR ● Service provisioning and resources in an ETDR
  • 41. Make digital objects (data, software and applications) identifiable and share them with other researchers ● Application Database ● B2DROP ● B2NOTE ● B2SHARE ● DataHub (4) Access, Deposition, Sharing
  • 42. 42 Share/Discover and Use of community-specific scientific software, applications and cloud virtual appliances (https://appdb.egi.eu/) EOSC-hub funded: ● Application Database platform operations ● Use to the service, including dashboard for managing VAs ● Technical support ● Support to packaging virtual appliances following security best practices Application Database
  • 43. 43 B2DROP Sync and share research data (https://www.eudat.eu/services/b2drop) Provided through EOSC-hub: ● Store and share data with colleagues and team members, including research data not finalised for publishing ○ Cloud storage to share data with fine-grained access controls ○ Synchronise multiple versions of data across different devices, including workflow and computing environments ○ Publish data via B2SHARE To be funded in INFRAEOSC-04: ● Provisioning and operation of a dedicated customized B2DROP instance (if required)
  • 44. 44 B2NOTE Use annotations to structure your data (https://b2note.eudat.eu/) Provided through EOSC-hub: ● Manage and share annotations on data with colleagues and team members ○ Annotations are keywords or commentaries attached to a object, that explains or classifies it. ○ B2NOTE annotation service is integrated with the B2SHARE service and technology ○ B2NOTE can be easily integrated with other community data repository services ○ Provide training on semantic annotations To be funded in INFRAEOSC-04: ● Technical support on the integration of B2NOTE annotation service into community services
  • 45. 45 Store and publish data (https://b2share.eudat.eu/) Provided through EOSC-hub: ● Data repository & publishing service (B2SHARE) allowing RIs to publish and manage data in a persistent way ○ Use of DataCite DOIs & EPIC PID ○ Domain specific metadata extensions ○ Manage the publish life cycle with version control ○ Community defined authorisation rules ○ Annotations via defined ontologies B2SHARE To be funded in INFRAEOSC-04: ● Customization and provisioning of a (dedicated) B2SHARE instance ● Definition of FAIR implementation guidelines (input to EOSC-hub)
  • 46. 46 Discovery, access and usage of reference open datasets and user data ● Federates existing data sources and data storage providers into one name space ● Brings data to the multiple hybrid clouds and HTC ○ Increased accessibility of data to users → Bring data to computing ○ Scalable federation of distributed data providers ○ Publishing/DOIs ○ Use of eduGAIN and federated AAI DataHub Provided through EOSC-Hub: ● Technology and its support ● Test infrastructure To be funded in INFRAEOSC-04: ● Storage capacity to scale up data infrastructure ● Dedicated support and service customization
  • 47. 47 EOSC-hub service catalogue mapping to FAIR Service F A I R B2Handle X X X B2Find X X X Marketplace X X X Application Database X B2SHARE X X X X B2DROP X DataHub X X X X European Trusted Digital Repositories X X X X Findable Accessible Interoperable Reusable Service F A I R Federated AAI X B2SAFE X B2NOTE X X Federated Cloud/HTC Jupyter Notebook Applications on Demand Workflow Management and orchestration Sensitive Data Services
  • 48. ● Federated AAI ● Monitoring and accounting ● SLA and order management ● Security incident response and security policies ● Technical support and training Federation services
  • 49. 49 EOSC-hub AAI Services for Trust and Identity Provided through EOSC-hub: ● Multi-tenant service for federated authentication and authorization supporting all main standards ○ Only one account needed for federated access to multiple heterogeneous (web and non-web) service providers using different technologies (SAML, OpenID Connect, OAuth 2.0, X509) ○ Use of federated IdPs in eduGAIN ○ Identity linking enables access to resources using different login credentials (institutional/social) ○ Aggregation and harmonisation of authorisation information from multiple sources To be funded by INFRAEOSC-04: ● Dedicated support
  • 50. 50 EOSC-hub AAI Architecture Secure: operates under strict security policies Simple: hides the complexity Low overhead: Easy integration of multiple IdPs and AAs Interoperable: AARC blueprint, eduGAIN REFEDS R&S and Sirtfi policies
  • 51. 51 • Only one account needed for federated access to multiple heterogeneous (web and non-web) service providers using different technologies (SAML, OpenID Connect, OAuth 2.0, X509) • Identity linking enables access to resources using different login credentials (institutional/social) • Aggregation and harmonisation of authorisation information from multiple sources • AAI is offered in two configurations - As a service: EOSC-hub AAI catch-all instance - Dedicated instance Capabilities
  • 52. 52 • Management of shared services of the Hub and related processes - Federated authentication and authentication - Marketplace (discovery, order management, SLA management) - Helpdesk for incident and problem management ▪ can be offered and branded as front desk of RI users - IT Security Management (e.g. coordinated incident response, security forensics/monitoring) - Service quality assurance (auditing) ▪ accounting and monitoring infrastructure - Service portfolio management • Maintenance of the EOSC-hub corpus of policies - data policies ← input from INFRAEOSC-04 - security policies ← input from INFRAEOSC-04 - standards roadmap ← input from INFRAEOSC-04 - FAIR implementation guidelines ← input from INFRAEOSC-04 Federated service management
  • 53. 53 Examples of use cases - Competence Centres Challenges Relevant EOSC-hub services ELIXIR CC ● Establish a federation of cloud providers to replicate ELIXIR Core Datasets and Applications ● Bring these cloud-data providers into EOSC ● Enable federated AAI across life science and EOSC services ● Federated Cloud ● AAI ● Operational policies ● Experience with Virtual Access ● Code of Conduct for sensitive data Fusion CC (ITER) ● Port fusion workflows to federated compute environment ● Federate and enable access to distributed datasets ● Application and data provenance ● AAI ● Data and compute federation (containers) ● Workflow management ● Monitoring, helpdesk, ● PIDs, ... Marine CC (Ifremer, Euro- Argo) ● Cloud-based data subscription and data delivery service (from EMSO, Argo, SeaDataNet, etc.) ● Enabling users’ simulations to run within custom environments on ‘subscribed data’ ● Operate the setup as an EOSC service ● Storage and compute clusters ● Data discovery and staging (B2Find, B2Stage) ● Jupyter service (24/7) ● FitSM (IT service management) EISCAT_3D CC ● Make EISCAT data accessible via a ‘data webshop’ ● Enable online data analytics for researchers (based on community and custom applications) ● Operate the data-compute portal as an EOSC service ● B2Share (metadata schema management) ● DIRAC file catalogue and application manager for researchers ● Federated compute sites (cloud) ● User authentication, authorisation (VOMS, Perun) ● FitSM (IT service management)
  • 54. 54 Examples of use cases - Competence Centres (cont) Challenges Relevant EOSC-hub services EPOS - ORFEUS CC ● Effective transfer and staging of big data ● Harmonised data management policies at seismic observatories ● Enable researchers to analyse data, create and publish ‘user-defined data products’ ● AAI ● Data staging and transfer services ● Federated compute services ● Jupyter (data access and analytics environment) ● Data Management good practices Radio Astronomy CC (LOFAR→ SKA) ● Enable researchers to find, access and process data from the LOFAR Telescope ● Support application developers in deploying workflows for researchers ● Support research users in data analytics on federation of compute clusters ● B2Find - B2Share ● B2Stage ● B2Safe ● B2Handle (PIDs) ● Jupyter ● Federated compute and storage resources ICOS-eLTER CC ● Enable researchers to find, access and process data from ICOS and eLTER ● Integrate ICOS Portal and analysis tools with large-scale storage and compute resources ● Support research users in data analytics on federation of compute clusters ● B2Safe ● B2Find ● B2Stage ● Federated cloud Disaster Mitigation Plus CC ● Setup simulation web portals for simulation of natural hazards (storm surge, dust transportation, forest fire, flood) ● Federate environmental data from agencies in Asia-Pacific region ● Federated compute resources (HTC and cloud) ● Operational tools ● FitSM