SURFsara Cloud explained

1. — experiences with OpenNebula 3.X
HPC Cloud at SURFsara
Ander Astudillo <ander.astudillo@surfsara.nl>
Lykle Voort <lykle.voort@surfsara.nl>
OpenNebula Tech Day
Ede (The Netherlands)
26th March 2014
#

3. e-Infrastructure landscape
3
Cartesius (National Supercomputer)
Bull bullx, 13984 cores,
41.75 TB memory,
2.4 PB disk,
271 TFlop/s
LISA (National compute cluster)
Dell cluster, 6528 cores,
16 TB of memory,
46 TFlop/s
Grid
5000 cores,
4 PB disk,
6 PB tape
11 sites
Visualization
Collaboratorium
Remote visualization
Render cluster
Network
SURFnet7
GLIF
NetherLight
Innovative infrastructures
Hadoop
GPU cluster
BeeHub
HPC Cloud

4. Agenda
1.- SURFsara’s HPC Cloud service
2.- User experience
3.- SURFsara’s HPC Cloud implementation

5. What do we (SURFsara) want to offer?
5
Services for scientists
…scientists ⇏ systems gurus
… complex users’ problems
• Data: big, dirty, non-structured…
• Computation: complex (e.g.: modeling, simulation)
• Libraries nightmare
• 3rd party, incompatibility, maintenance…
… flexibility
… trial and error
… test
… cooperate
… share
… show
… scratch … privacy
1.- Our service

6. Where does the HPC Cloud fit?
61.- Our service

7. What does our HPC Cloud offer?
7
Your own world
In a jar
1.- Our service
IaaS:
Network filter

8. What does a user see?
81.- Our service

9. User experience

10. Our decisions
102.- User experience
HPC
• Big nodes
• Fast interconnect
• MPI-alike computation
• Own flexibility
Cloud light
• Smaller nodes
• CPU overcommit
• (Interactive) services
• Projects
• Documentation
• System load
• Network filters
• Dynamic DNS
• VirDir
• Image upload
• Wizard
tweaks

11. Accounting
112.- User experience
Per project
User accounts
CPU time
Images storage
VirDir

12. Accounting (& figures)
122.- User experience
Per project
User accounts
CPU time
Images storage
VirDir
180+ projects
active: 110+
370+ users
active: 240+
Since 2009 until March 2014:
300+ requests
32.000+ VM
130+ TB in use
850+ years
3.700+ images

13. User applications
132.- User experience
• Profit from cloud elasticity
• Provide own service to own users
• Software that requires licenses
• Workflows
• Training
• Intensive compute
Fields:
• Biology
• Genetics
• Informatics
• Chemistry
• Ecology
• Linguistics
• Robotics
• Business
• Social sciences
• Engineering
• Humanities

14. User applications
142.- User experience
• High-memory nodes
• Database as a Service
Experimental additions:

15. SURFsara’s HPC Cloud
implementation

16. Hardware
163.- Implementation
30 HPC nodes
19× 32-core Intel Xeon-E7
11× 32-core Intel Xeon-E5
256 GB RAM
1 TByte local disk
Ethernet 2×10GE
Each new HPC node
delivers 12K SPECints
under ideal circumstances
10 light nodes
8 cores AMD Opteron 6212
64 GB RAM
6 TByte local disk
Ethernet 1×10GE
Network
144 ports 10GE, 1-hop
Storage
800TB shared
(Arista DCS-7504)

17. 800TB
Shared
Storage
2×10Gbps
4
Service
Nodes
Virtualised
Services
30 large
compute
nodes
....
..
10 light
compute
nodes
Network overview
3.- Implementation
4×10Gbps

18. Software
3.- Implementation

19. Groups’ network isolation
3.- Implementation

20. The good
3.- Implementation
• Live migration
• HUGE disks possible
• Security
• Ease of use

21. Ander Astudillo
<ander.astudillo@surfsara.nl>
Lykle Voort
<lykle.voort@surfsara.nl>
Credits
Images: Wikipedia, Science Park
Front slide photo: dvanzuijlekom in Flicker
Slides: SURFsara colleagues