SlideShare uma empresa Scribd logo
1 de 17
Baixar para ler offline
e-BioGrid
E-Science infrastructure for life
 science research


E-BioGrid workshop, November 10, 2011
Introduction
Big Grid infrastructure

High-performance computing and storage resources,

Grid – Life Science Grid
High Performance Cloud
Hadoop (soon)

Non-Big Grid but available via NWO/NCF:

Huygens, LISA, GPU
How to apply for access?


All applications go into the NWO/NCF
IRIS system.

Basically: specify what you need, why
And give an estimate how much you need.

All applications go to Big Grid when
Big Grid infrastructure is involved.      Please contact us for assistance.

For Huygens and Lisa, NWO/NCF will        We are working to simplify
consider all applications
                                          this procedure.
What does SARA do?

SARA doesn’t own the systems.
SARA doesn’t decide on user access.
SARA doesn’t host websites, small scale services, wiki’s etc.

SARA maintains HPC systems, provides assistance and consultancy.

SARA works in scientific projects like eBioGrid to assist in the use
of HPC hardware and e-science environments.

SARA works on parallelization projects (funded by NWO):
parallelize your software for use on HPC hardware.
The Life Science Grid
              WHAT IT IS
            •Several clusters at academic medical centers
            and universities.
            •Open to all life scientists based in the
            Netherlands.
            •Clusters can be used separately or together
            by using Grid middleware.
            •Currently more than 3700 job slots for
            concurrent processing.
            •Distributive storage capabilities and
            automatic replication of data.
            •Maintained and supported by SARA.
The Life Science Grid sites

LUMC – Leiden
WUR – Wageningen
UU – Utrecht
NKI – Amsterdam
AMC – Amsterdam
Radboud Universiteit – Nijmegen
ErasmusMC – Rotterdam
Technische Universiteit - Delft
Rijksuniversiteit Groningen
Keygene - Wageningen

Each of these clusters have either 16 or 32 cores and 18 Tb of storage space.
Grid nodes
Currently 6 small clusters :16 job slots each, soon to be
    upgraded
5 clusters: 32 job slots each

32 job slot each- 20TB storage

All clusters run CentOS 5– 64 bits

Gina cluster SARA 2800 job slots
Philips             1470
Nikhef             2160
Groningen          164
High Performance Cloud

19 nodes of 32 cores each (608 cores)

Each node has 256 GB RAM
400 TB storage.

Nodes are connected by four 10 Gb
  interfaces to a non-blocking switch.
So maximum 40 GB access to storage
  (per node).
High Performance Cloud

When to use cloud?

Start up your own Virtual Machines. Be your
  own boss. Users have their own Virtual
  Cluster, running their OS and software of
  choice.

Expand when you need to. You must be able
  to organize system administration
  yourself.
Huygens National Supercomputer
Huygens is an IBM pSeries 575 system.

The number of IBM Power6 cores is 3456.
The total peak performance is 65 Tflop/s.
The total memory is 15.75 TB.
The inter-node InfiniBand interconnect is 160 Gbit/s.
The net disk space is 700 TB.

The system runs Linux (SLES11 SP1)
Huygens: when to use

Often used for large scale simulations

Parallel systems with interdependencies and a need
  for high speed interconnects.

Software typically uses MPI or openMP.
Parallel jobs communicate heavily with each other.

Existing sofware is often ported in NWO funded
parallelization projects.
LISA: Description

Total number of cores 4480
Total amount of memory12 TB
Total peak performance20 TFlop/sec
Disk space 48 TB
Operating systemDebian Linux AMD64 OS

Affiliates of UvA and VU can use this system
   directly.

LISA is a popular PBS cluster.
Hadoop (soon to come)
Hadoop (soon to come)
Finally

Which infrastructure to choose for your problem?
                      Ask eBioGrid.



How to get access?
                         NWO/NCF Iris system
                      Ask eBioGrid/SARA for help.



How to get assistance?
                     Ask eBioGrid for support.

Mais conteúdo relacionado

Mais procurados

Data-intensive bioinformatics on HPC and Cloud
Data-intensive bioinformatics on HPC and CloudData-intensive bioinformatics on HPC and Cloud
Data-intensive bioinformatics on HPC and CloudOla Spjuth
 
Interoperability and scalability with microservices in science
Interoperability and scalability with microservices in scienceInteroperability and scalability with microservices in science
Interoperability and scalability with microservices in scienceOla Spjuth
 
The Tale of SANSA Spark - ISWC 2017 Demo
The Tale of SANSA Spark - ISWC 2017 DemoThe Tale of SANSA Spark - ISWC 2017 Demo
The Tale of SANSA Spark - ISWC 2017 DemoGezim Sejdiu
 
Basic Hadoop Architecture V1 vs V2
Basic  Hadoop Architecture  V1 vs V2Basic  Hadoop Architecture  V1 vs V2
Basic Hadoop Architecture V1 vs V2VIVEKVANAVAN
 
Data-intensive applications on cloud computing resources: Applications in lif...
Data-intensive applications on cloud computing resources: Applications in lif...Data-intensive applications on cloud computing resources: Applications in lif...
Data-intensive applications on cloud computing resources: Applications in lif...Ola Spjuth
 
Accumulo: A Quick Introduction
Accumulo: A Quick IntroductionAccumulo: A Quick Introduction
Accumulo: A Quick IntroductionJames Salter
 

Mais procurados (8)

Data-intensive bioinformatics on HPC and Cloud
Data-intensive bioinformatics on HPC and CloudData-intensive bioinformatics on HPC and Cloud
Data-intensive bioinformatics on HPC and Cloud
 
Interoperability and scalability with microservices in science
Interoperability and scalability with microservices in scienceInteroperability and scalability with microservices in science
Interoperability and scalability with microservices in science
 
The Tale of SANSA Spark - ISWC 2017 Demo
The Tale of SANSA Spark - ISWC 2017 DemoThe Tale of SANSA Spark - ISWC 2017 Demo
The Tale of SANSA Spark - ISWC 2017 Demo
 
Hobbes
HobbesHobbes
Hobbes
 
Hadoop
HadoopHadoop
Hadoop
 
Basic Hadoop Architecture V1 vs V2
Basic  Hadoop Architecture  V1 vs V2Basic  Hadoop Architecture  V1 vs V2
Basic Hadoop Architecture V1 vs V2
 
Data-intensive applications on cloud computing resources: Applications in lif...
Data-intensive applications on cloud computing resources: Applications in lif...Data-intensive applications on cloud computing resources: Applications in lif...
Data-intensive applications on cloud computing resources: Applications in lif...
 
Accumulo: A Quick Introduction
Accumulo: A Quick IntroductionAccumulo: A Quick Introduction
Accumulo: A Quick Introduction
 

Destaque

BlueBeauty1
BlueBeauty1BlueBeauty1
BlueBeauty1yoda2486
 
e-BioGrid_NBIC Conference 2011 april 20
e-BioGrid_NBIC Conference 2011 april 20e-BioGrid_NBIC Conference 2011 april 20
e-BioGrid_NBIC Conference 2011 april 20INooren
 
Resources o sushanta de
Resources o sushanta deResources o sushanta de
Resources o sushanta deSushanta De
 
P R O V I N S S I R O C K 10
P R O V I N S S I R O C K 10P R O V I N S S I R O C K 10
P R O V I N S S I R O C K 10phakanen
 
A Place Called Earth
A Place Called EarthA Place Called Earth
A Place Called Earthguestbb72be1
 
Capturing The Impact Of Libraries
Capturing The Impact Of LibrariesCapturing The Impact Of Libraries
Capturing The Impact Of Librariesguest79eb14
 
Multilingual Communication Services
Multilingual Communication ServicesMultilingual Communication Services
Multilingual Communication Servicesrspond62
 
P R O V I N S S I R O C K 2009
P R O V I N S S I R O C K 2009P R O V I N S S I R O C K 2009
P R O V I N S S I R O C K 2009phakanen
 
Minimum uncertainty coherent states attached to nondegenerate parametric ampl...
Minimum uncertainty coherent states attached to nondegenerate parametric ampl...Minimum uncertainty coherent states attached to nondegenerate parametric ampl...
Minimum uncertainty coherent states attached to nondegenerate parametric ampl...Sergio Floquet
 
Minimum uncertainty coherent states attached to nondegenerate parametric ampl...
Minimum uncertainty coherent states attached to nondegenerate parametric ampl...Minimum uncertainty coherent states attached to nondegenerate parametric ampl...
Minimum uncertainty coherent states attached to nondegenerate parametric ampl...Sergio Floquet
 
Tugas kelompok vi kls mak pasca unhas (decision making with strategic emphasis)
Tugas kelompok vi kls mak pasca unhas (decision making with strategic emphasis)Tugas kelompok vi kls mak pasca unhas (decision making with strategic emphasis)
Tugas kelompok vi kls mak pasca unhas (decision making with strategic emphasis)Arfandi Mappasoro
 
Tugas kelompok vi kls mak pasca unhas (decision making with strategic emphasis)
Tugas kelompok vi kls mak pasca unhas (decision making with strategic emphasis)Tugas kelompok vi kls mak pasca unhas (decision making with strategic emphasis)
Tugas kelompok vi kls mak pasca unhas (decision making with strategic emphasis)Arfandi Mappasoro
 
Intro To Computers PPT w SaraBrightman song OFFICE SAT_PM SPR2009.PPT
Intro To Computers PPT w SaraBrightman song OFFICE SAT_PM SPR2009.PPTIntro To Computers PPT w SaraBrightman song OFFICE SAT_PM SPR2009.PPT
Intro To Computers PPT w SaraBrightman song OFFICE SAT_PM SPR2009.PPTyoda2486
 
Sushanta de's blog at google
Sushanta de's blog at googleSushanta de's blog at google
Sushanta de's blog at googleSushanta De
 
identity business communication processes quality costs - a brief description...
identity business communication processes quality costs - a brief description...identity business communication processes quality costs - a brief description...
identity business communication processes quality costs - a brief description...Marc Rosenlöcher
 
Entrenamiento mayoristas
Entrenamiento mayoristasEntrenamiento mayoristas
Entrenamiento mayoristasolivernoeml
 

Destaque (18)

BlueBeauty1
BlueBeauty1BlueBeauty1
BlueBeauty1
 
e-BioGrid_NBIC Conference 2011 april 20
e-BioGrid_NBIC Conference 2011 april 20e-BioGrid_NBIC Conference 2011 april 20
e-BioGrid_NBIC Conference 2011 april 20
 
Resources o sushanta de
Resources o sushanta deResources o sushanta de
Resources o sushanta de
 
P R O V I N S S I R O C K 10
P R O V I N S S I R O C K 10P R O V I N S S I R O C K 10
P R O V I N S S I R O C K 10
 
A Place Called Earth
A Place Called EarthA Place Called Earth
A Place Called Earth
 
Capturing The Impact Of Libraries
Capturing The Impact Of LibrariesCapturing The Impact Of Libraries
Capturing The Impact Of Libraries
 
Multilingual Communication Services
Multilingual Communication ServicesMultilingual Communication Services
Multilingual Communication Services
 
P R O V I N S S I R O C K 2009
P R O V I N S S I R O C K 2009P R O V I N S S I R O C K 2009
P R O V I N S S I R O C K 2009
 
Minimum uncertainty coherent states attached to nondegenerate parametric ampl...
Minimum uncertainty coherent states attached to nondegenerate parametric ampl...Minimum uncertainty coherent states attached to nondegenerate parametric ampl...
Minimum uncertainty coherent states attached to nondegenerate parametric ampl...
 
Football
FootballFootball
Football
 
Minimum uncertainty coherent states attached to nondegenerate parametric ampl...
Minimum uncertainty coherent states attached to nondegenerate parametric ampl...Minimum uncertainty coherent states attached to nondegenerate parametric ampl...
Minimum uncertainty coherent states attached to nondegenerate parametric ampl...
 
Tugas kelompok vi kls mak pasca unhas (decision making with strategic emphasis)
Tugas kelompok vi kls mak pasca unhas (decision making with strategic emphasis)Tugas kelompok vi kls mak pasca unhas (decision making with strategic emphasis)
Tugas kelompok vi kls mak pasca unhas (decision making with strategic emphasis)
 
Monomyth
MonomythMonomyth
Monomyth
 
Tugas kelompok vi kls mak pasca unhas (decision making with strategic emphasis)
Tugas kelompok vi kls mak pasca unhas (decision making with strategic emphasis)Tugas kelompok vi kls mak pasca unhas (decision making with strategic emphasis)
Tugas kelompok vi kls mak pasca unhas (decision making with strategic emphasis)
 
Intro To Computers PPT w SaraBrightman song OFFICE SAT_PM SPR2009.PPT
Intro To Computers PPT w SaraBrightman song OFFICE SAT_PM SPR2009.PPTIntro To Computers PPT w SaraBrightman song OFFICE SAT_PM SPR2009.PPT
Intro To Computers PPT w SaraBrightman song OFFICE SAT_PM SPR2009.PPT
 
Sushanta de's blog at google
Sushanta de's blog at googleSushanta de's blog at google
Sushanta de's blog at google
 
identity business communication processes quality costs - a brief description...
identity business communication processes quality costs - a brief description...identity business communication processes quality costs - a brief description...
identity business communication processes quality costs - a brief description...
 
Entrenamiento mayoristas
Entrenamiento mayoristasEntrenamiento mayoristas
Entrenamiento mayoristas
 

Semelhante a 2011 11-10 e-bio-grid_workshop introduction

Computational infrastructure for NGS data analysis
Computational infrastructure for NGS data analysisComputational infrastructure for NGS data analysis
Computational infrastructure for NGS data analysiscursoNGS
 
Designing High-Performance and Scalable Middleware for HPC, AI and Data Science
Designing High-Performance and Scalable Middleware for HPC, AI and Data ScienceDesigning High-Performance and Scalable Middleware for HPC, AI and Data Science
Designing High-Performance and Scalable Middleware for HPC, AI and Data ScienceObject Automation
 
Big Data Meets HPC - Exploiting HPC Technologies for Accelerating Big Data Pr...
Big Data Meets HPC - Exploiting HPC Technologies for Accelerating Big Data Pr...Big Data Meets HPC - Exploiting HPC Technologies for Accelerating Big Data Pr...
Big Data Meets HPC - Exploiting HPC Technologies for Accelerating Big Data Pr...inside-BigData.com
 
ABCI: AI Bridging Cloud Infrastructure for Scalable AI/Big Data
ABCI: AI Bridging Cloud Infrastructure for Scalable AI/Big DataABCI: AI Bridging Cloud Infrastructure for Scalable AI/Big Data
ABCI: AI Bridging Cloud Infrastructure for Scalable AI/Big DataHitoshi Sato
 
Designing High performance & Scalable Middleware for HPC
Designing High performance & Scalable Middleware for HPCDesigning High performance & Scalable Middleware for HPC
Designing High performance & Scalable Middleware for HPCObject Automation
 
A Library for Emerging High-Performance Computing Clusters
A Library for Emerging High-Performance Computing ClustersA Library for Emerging High-Performance Computing Clusters
A Library for Emerging High-Performance Computing ClustersIntel® Software
 
How to Design Scalable HPC, Deep Learning, and Cloud Middleware for Exascale ...
How to Design Scalable HPC, Deep Learning, and Cloud Middleware for Exascale ...How to Design Scalable HPC, Deep Learning, and Cloud Middleware for Exascale ...
How to Design Scalable HPC, Deep Learning, and Cloud Middleware for Exascale ...inside-BigData.com
 
Panda scalable hpc_bestpractices_tue100418
Panda scalable hpc_bestpractices_tue100418Panda scalable hpc_bestpractices_tue100418
Panda scalable hpc_bestpractices_tue100418inside-BigData.com
 
Designing Scalable HPC, Deep Learning and Cloud Middleware for Exascale Systems
Designing Scalable HPC, Deep Learning and Cloud Middleware for Exascale SystemsDesigning Scalable HPC, Deep Learning and Cloud Middleware for Exascale Systems
Designing Scalable HPC, Deep Learning and Cloud Middleware for Exascale Systemsinside-BigData.com
 
Accelerating Apache Hadoop through High-Performance Networking and I/O Techno...
Accelerating Apache Hadoop through High-Performance Networking and I/O Techno...Accelerating Apache Hadoop through High-Performance Networking and I/O Techno...
Accelerating Apache Hadoop through High-Performance Networking and I/O Techno...DataWorks Summit/Hadoop Summit
 
Scalable and Distributed DNN Training on Modern HPC Systems
Scalable and Distributed DNN Training on Modern HPC SystemsScalable and Distributed DNN Training on Modern HPC Systems
Scalable and Distributed DNN Training on Modern HPC Systemsinside-BigData.com
 
High Performance Cyberinfrastructure Enabling Data-Driven Science in the Biom...
High Performance Cyberinfrastructure Enabling Data-Driven Science in the Biom...High Performance Cyberinfrastructure Enabling Data-Driven Science in the Biom...
High Performance Cyberinfrastructure Enabling Data-Driven Science in the Biom...Larry Smarr
 
Apache Spark 101 - Demi Ben-Ari
Apache Spark 101 - Demi Ben-AriApache Spark 101 - Demi Ben-Ari
Apache Spark 101 - Demi Ben-AriDemi Ben-Ari
 
Tips Tricks and Tactics with Cells and Scaling OpenStack - May, 2015
Tips Tricks and Tactics with Cells and Scaling OpenStack - May, 2015Tips Tricks and Tactics with Cells and Scaling OpenStack - May, 2015
Tips Tricks and Tactics with Cells and Scaling OpenStack - May, 2015Belmiro Moreira
 
Designing HPC & Deep Learning Middleware for Exascale Systems
Designing HPC & Deep Learning Middleware for Exascale SystemsDesigning HPC & Deep Learning Middleware for Exascale Systems
Designing HPC & Deep Learning Middleware for Exascale Systemsinside-BigData.com
 
Setting up repositories
Setting up repositoriesSetting up repositories
Setting up repositoriesIryna Kuchma
 
Lessons Learned on Benchmarking Big Data Platforms
Lessons Learned on Benchmarking  Big Data PlatformsLessons Learned on Benchmarking  Big Data Platforms
Lessons Learned on Benchmarking Big Data Platformst_ivanov
 
Accelerate Big Data Processing with High-Performance Computing Technologies
Accelerate Big Data Processing with High-Performance Computing TechnologiesAccelerate Big Data Processing with High-Performance Computing Technologies
Accelerate Big Data Processing with High-Performance Computing TechnologiesIntel® Software
 

Semelhante a 2011 11-10 e-bio-grid_workshop introduction (20)

Computational infrastructure for NGS data analysis
Computational infrastructure for NGS data analysisComputational infrastructure for NGS data analysis
Computational infrastructure for NGS data analysis
 
Designing High-Performance and Scalable Middleware for HPC, AI and Data Science
Designing High-Performance and Scalable Middleware for HPC, AI and Data ScienceDesigning High-Performance and Scalable Middleware for HPC, AI and Data Science
Designing High-Performance and Scalable Middleware for HPC, AI and Data Science
 
Big Data Meets HPC - Exploiting HPC Technologies for Accelerating Big Data Pr...
Big Data Meets HPC - Exploiting HPC Technologies for Accelerating Big Data Pr...Big Data Meets HPC - Exploiting HPC Technologies for Accelerating Big Data Pr...
Big Data Meets HPC - Exploiting HPC Technologies for Accelerating Big Data Pr...
 
ABCI: AI Bridging Cloud Infrastructure for Scalable AI/Big Data
ABCI: AI Bridging Cloud Infrastructure for Scalable AI/Big DataABCI: AI Bridging Cloud Infrastructure for Scalable AI/Big Data
ABCI: AI Bridging Cloud Infrastructure for Scalable AI/Big Data
 
Designing High performance & Scalable Middleware for HPC
Designing High performance & Scalable Middleware for HPCDesigning High performance & Scalable Middleware for HPC
Designing High performance & Scalable Middleware for HPC
 
A Library for Emerging High-Performance Computing Clusters
A Library for Emerging High-Performance Computing ClustersA Library for Emerging High-Performance Computing Clusters
A Library for Emerging High-Performance Computing Clusters
 
How to Design Scalable HPC, Deep Learning, and Cloud Middleware for Exascale ...
How to Design Scalable HPC, Deep Learning, and Cloud Middleware for Exascale ...How to Design Scalable HPC, Deep Learning, and Cloud Middleware for Exascale ...
How to Design Scalable HPC, Deep Learning, and Cloud Middleware for Exascale ...
 
Panda scalable hpc_bestpractices_tue100418
Panda scalable hpc_bestpractices_tue100418Panda scalable hpc_bestpractices_tue100418
Panda scalable hpc_bestpractices_tue100418
 
Designing Scalable HPC, Deep Learning and Cloud Middleware for Exascale Systems
Designing Scalable HPC, Deep Learning and Cloud Middleware for Exascale SystemsDesigning Scalable HPC, Deep Learning and Cloud Middleware for Exascale Systems
Designing Scalable HPC, Deep Learning and Cloud Middleware for Exascale Systems
 
Accelerating Apache Hadoop through High-Performance Networking and I/O Techno...
Accelerating Apache Hadoop through High-Performance Networking and I/O Techno...Accelerating Apache Hadoop through High-Performance Networking and I/O Techno...
Accelerating Apache Hadoop through High-Performance Networking and I/O Techno...
 
Scalable and Distributed DNN Training on Modern HPC Systems
Scalable and Distributed DNN Training on Modern HPC SystemsScalable and Distributed DNN Training on Modern HPC Systems
Scalable and Distributed DNN Training on Modern HPC Systems
 
High Performance Cyberinfrastructure Enabling Data-Driven Science in the Biom...
High Performance Cyberinfrastructure Enabling Data-Driven Science in the Biom...High Performance Cyberinfrastructure Enabling Data-Driven Science in the Biom...
High Performance Cyberinfrastructure Enabling Data-Driven Science in the Biom...
 
Apache Spark 101 - Demi Ben-Ari
Apache Spark 101 - Demi Ben-AriApache Spark 101 - Demi Ben-Ari
Apache Spark 101 - Demi Ben-Ari
 
Tips Tricks and Tactics with Cells and Scaling OpenStack - May, 2015
Tips Tricks and Tactics with Cells and Scaling OpenStack - May, 2015Tips Tricks and Tactics with Cells and Scaling OpenStack - May, 2015
Tips Tricks and Tactics with Cells and Scaling OpenStack - May, 2015
 
Empower Data-Driven Organizations
Empower Data-Driven OrganizationsEmpower Data-Driven Organizations
Empower Data-Driven Organizations
 
Current Trends in HPC
Current Trends in HPCCurrent Trends in HPC
Current Trends in HPC
 
Designing HPC & Deep Learning Middleware for Exascale Systems
Designing HPC & Deep Learning Middleware for Exascale SystemsDesigning HPC & Deep Learning Middleware for Exascale Systems
Designing HPC & Deep Learning Middleware for Exascale Systems
 
Setting up repositories
Setting up repositoriesSetting up repositories
Setting up repositories
 
Lessons Learned on Benchmarking Big Data Platforms
Lessons Learned on Benchmarking  Big Data PlatformsLessons Learned on Benchmarking  Big Data Platforms
Lessons Learned on Benchmarking Big Data Platforms
 
Accelerate Big Data Processing with High-Performance Computing Technologies
Accelerate Big Data Processing with High-Performance Computing TechnologiesAccelerate Big Data Processing with High-Performance Computing Technologies
Accelerate Big Data Processing with High-Performance Computing Technologies
 

Último

"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfRankYa
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 

Último (20)

"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 

2011 11-10 e-bio-grid_workshop introduction

  • 1. e-BioGrid E-Science infrastructure for life science research E-BioGrid workshop, November 10, 2011 Introduction
  • 2. Big Grid infrastructure High-performance computing and storage resources, Grid – Life Science Grid High Performance Cloud Hadoop (soon) Non-Big Grid but available via NWO/NCF: Huygens, LISA, GPU
  • 3.
  • 4. How to apply for access? All applications go into the NWO/NCF IRIS system. Basically: specify what you need, why And give an estimate how much you need. All applications go to Big Grid when Big Grid infrastructure is involved. Please contact us for assistance. For Huygens and Lisa, NWO/NCF will We are working to simplify consider all applications this procedure.
  • 5. What does SARA do? SARA doesn’t own the systems. SARA doesn’t decide on user access. SARA doesn’t host websites, small scale services, wiki’s etc. SARA maintains HPC systems, provides assistance and consultancy. SARA works in scientific projects like eBioGrid to assist in the use of HPC hardware and e-science environments. SARA works on parallelization projects (funded by NWO): parallelize your software for use on HPC hardware.
  • 6. The Life Science Grid WHAT IT IS •Several clusters at academic medical centers and universities. •Open to all life scientists based in the Netherlands. •Clusters can be used separately or together by using Grid middleware. •Currently more than 3700 job slots for concurrent processing. •Distributive storage capabilities and automatic replication of data. •Maintained and supported by SARA.
  • 7. The Life Science Grid sites LUMC – Leiden WUR – Wageningen UU – Utrecht NKI – Amsterdam AMC – Amsterdam Radboud Universiteit – Nijmegen ErasmusMC – Rotterdam Technische Universiteit - Delft Rijksuniversiteit Groningen Keygene - Wageningen Each of these clusters have either 16 or 32 cores and 18 Tb of storage space.
  • 8. Grid nodes Currently 6 small clusters :16 job slots each, soon to be upgraded 5 clusters: 32 job slots each 32 job slot each- 20TB storage All clusters run CentOS 5– 64 bits Gina cluster SARA 2800 job slots Philips 1470 Nikhef 2160 Groningen 164
  • 9. High Performance Cloud 19 nodes of 32 cores each (608 cores) Each node has 256 GB RAM 400 TB storage. Nodes are connected by four 10 Gb interfaces to a non-blocking switch. So maximum 40 GB access to storage (per node).
  • 10. High Performance Cloud When to use cloud? Start up your own Virtual Machines. Be your own boss. Users have their own Virtual Cluster, running their OS and software of choice. Expand when you need to. You must be able to organize system administration yourself.
  • 11. Huygens National Supercomputer Huygens is an IBM pSeries 575 system. The number of IBM Power6 cores is 3456. The total peak performance is 65 Tflop/s. The total memory is 15.75 TB. The inter-node InfiniBand interconnect is 160 Gbit/s. The net disk space is 700 TB. The system runs Linux (SLES11 SP1)
  • 12. Huygens: when to use Often used for large scale simulations Parallel systems with interdependencies and a need for high speed interconnects. Software typically uses MPI or openMP. Parallel jobs communicate heavily with each other. Existing sofware is often ported in NWO funded parallelization projects.
  • 13. LISA: Description Total number of cores 4480 Total amount of memory12 TB Total peak performance20 TFlop/sec Disk space 48 TB Operating systemDebian Linux AMD64 OS Affiliates of UvA and VU can use this system directly. LISA is a popular PBS cluster.
  • 14.
  • 17. Finally Which infrastructure to choose for your problem? Ask eBioGrid. How to get access? NWO/NCF Iris system Ask eBioGrid/SARA for help. How to get assistance? Ask eBioGrid for support.