Science + Computing believe "Everyone's entitled to power"

1. science + computing ag
IT-Dienstleistungen und Software für anspruchsvolle Rechnernetze
Tübingen | München | Berlin | Düsseldorf
RWTH Aachen Compute Cluster is Intel Cluster Ready
Jan Wender

2. Seite 2
<Jan Wender> <RWTH Aachen Compute Cluster> | <2013-06-19>
RWTH Aachen Compute Cluster

3. Seite 3
<Jan Wender> <RWTH Aachen Compute Cluster> | <2013-06-19>
Gliederungspunkt
science+computing at a glance
Founded in 1989
Sites Tübingen
München
Berlin
Düsseldorf
Employees 270
Shareholder Bull S.A. (100%)
Revenue 10/11 27 Mio. Euro
Partner Daikin Industries, Japan
NICE srl, Italien
Exa Corporation, USA
Platform Computing, Kanada

4. Seite 4
<Jan Wender> <RWTH Aachen Compute Cluster> | <2013-06-19>
Customers of s+c
Bremen, Hamburg
Beelen
Duisburg
Geschäftsstelle
Düsseldorf
Aachen
Alzenau
Zentrale
Tübingen
Stuttgart
Mannheim
Servicestandort
Frankfurt
Servicestandort
Ingolstadt
Wolfsburg
Köln
Geschäftsstelle
München
Geschäftsstelle
Berlin

5. Seite 5
<Jan Wender> <RWTH Aachen Compute Cluster> | <2013-06-19>

6. 6© Bull, 2013
Mastering Value Chain for Critical Processes
Manage explosion in
processing needs
INNOVATE
Support shift
towards Cloud
OPTIMIZE
Drive digital
transformation
INTEGRATE
Guarantee
trust
SECURE
Smart transportation
e-Government
Smart Grid
e-Banking
Cyberdefense
Mobile services
From infrastructures to business applications: design, build and operate powerful and trusted solutions
Computer manufacturer Integrator / Outsourcer Service provider Solution provider
Security provider and operator
SAP Quality Award

7. 7© Bull, 2013
Infrastructure
Bull: from Supercomputers to Cloud Computing
Expertise
& services
Servers
Software
• Data Center design
• Mobile Data Center
• Water-Cooling
• Full range development from
ASICs to boards, blades,
racks
• Support for accelerators
• Open, scalable, reliable SW
• Development Environment
• Linux, OpenMPI, Lustre, Slurm
• Administration & monitoring
• HPC Systems Architecture
• Applications & Performance
• Energy Efficiency
• Data Management
• HPC Cloud

8. 8© Bull, 2013
Pervasive Extreme Computing
HPC for every user
with public/private HPC cloud
Applications optimized
for hyper-parallel
supercomputers
Production ready
supercomputers
Data Centers for all
organizations
b u llx s u p e r c o m p u t e r s u it ebullx supercomputer suite

9. Seite 9
<Jan Wender> <RWTH Aachen Compute Cluster> | <2013-06-19>
Cluster Architecture
1350 nodes 350 nodes
8 nodes

10. Seite 10
<Jan Wender> <RWTH Aachen Compute Cluster> | <2013-06-19>
▪ Matlab
▪ MARC/Mentat
▪ NAG
▪ Adams
▪ Nastran/Patran
▪ Portland Group Compiler
▪ Intel Compiler
▪ ProEngineer
▪ Solidworks
▪ SPSS
▪ StarCD
▪ Turbomole
▪ Spartan
Requirements
Applications
▪ Abaqus
▪ Hyperworks
▪ Ansys
▪ LS-Dyna
▪ CFX
▪ Comsol
▪ EnSight
▪ Fluent
▪ Gaussian
▪ GaussView
▪ ICEM-CFD
▪ Maple
▪ Mathematica

11. Seite 11
<Jan Wender> <RWTH Aachen Compute Cluster> | <2013-06-19>
▪ Matlab
▪ MARC/Mentat
▪ NAG
▪ Adams
▪ Nastran/Patran
▪ Portland Group Compiler
▪ Intel Compiler
▪ ProEngineer
▪ Solidworks
▪ SPSS
▪ StarCD
▪ Turbomole
▪ Spartan
Requirements
Applications
▪ Abaqus
▪ Hyperworks
▪ Ansys
▪ LS-Dyna
▪ CFX
▪ Comsol
▪ EnSight
▪ Fluent
▪ Gaussian
▪ GaussView
▪ ICEM-CFD
▪ Maple
▪ Mathematica

12. Seite 12
<Jan Wender> <RWTH Aachen Compute Cluster> | <2013-06-19>
Intel Cluster Ready

13. Seite 13
<Jan Wender> <RWTH Aachen Compute Cluster> | <2013-06-19>
Deployment Process

14. Seite 14
<Jan Wender> <RWTH Aachen Compute Cluster> | <2013-06-19>
Factory Pre-Check
Setup headnode same as on site
Install all nodes rack per rack
Cluster-Check each rack before shipment

15. Seite 15
<Jan Wender> <RWTH Aachen Compute Cluster> | <2013-06-19>
On-Site Checks
Reuse factory checks
Check larger parts
Photograph:D

16. Seite 16
<Jan Wender> <RWTH Aachen Compute Cluster> | <2013-06-19>
Divide and Conquer
64 nodes: 0.58 hours
128 nodes: 0.78 hours
256 nodes: 1.57 hours
320 nodes: 1.92 hours
1700 nodes: ? Way too long!
http://software.intel.com/en-us/articles/intel-cluster-checker-18-execution-time/

17. Seite 17
<Jan Wender> <RWTH Aachen Compute Cluster> | <2013-06-19>
Divide and Conquer
http://software.intel.com/en-us/articles/partner-newsletter-Q2-2012-intel-cluster-ready-articles-2/#scaling
Certify sub-clusters
Certify some nodes from all sub-clusters

18. Seite 18
<Jan Wender> <RWTH Aachen Compute Cluster> | <2013-06-19>
Life is a Batch
http://software.intel.com/en-us/articles/partner-newsletter-Q2-2012-intel-cluster-ready-articles-3/#automating
#!/bin/bash #SBATCH -J ClusterChecker
#SBATCH -F /etc/intel/clck/nodelist
#SBATCH -t 10 #Max time, adjust for larger nodes
#SBATCH -p clck
#SBATCH --error=auto-clck.err –output=auto-clck.out
/usr/local/clck.sh
Use workload management system for user-friendly
checking and automation
Photograph:D

19. Seite 19
<Jan Wender> <RWTH Aachen Compute Cluster> | <2013-06-19>
Certification

20. Seite 20
<Jan Wender> <RWTH Aachen Compute Cluster> | <2013-06-19>
Do
Check the cluster early
Check the cluster automatically
Use the batch system to coordinate with users jobs
Photograph:D