Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
OpenSolaris Clusters And Clouds From Your Laptop
1. OpenSolaris: Clusters and Clouds
from your Laptop
Bogdan Vasiliu
Cloud and HPC Infrastructure Management, Sun Microsystems
2. New England
OpenSolaris
Users Group
Sun HPC Software, Developer Edition for OpenSolaris
Why it is important for you
What it is
How it works
New England OpenSolaris Users Group | Boston University Edition 2
3. New England
OpenSolaris
Users Group
Sun HPC Software, Developer Edition for OpenSolaris
Why it is important for you
What it is
How it works
New England OpenSolaris Users Group | Boston University Edition 3
4. New England
OpenSolaris
Users Group
You ...
... are a developer
... have a deadline for an application
... don't have time and resources to set up a development
environment
... want to start your application on tens/hundreds of nodes
... plan to deliver the final application/results in weeks not
months or years
New England OpenSolaris Users Group | Boston University Edition 4
5. New England
OpenSolaris
Users Group
Sun HPC Software, Developer Edition for OpenSolaris
Why it is important for you
What it is
How it works
New England OpenSolaris Users Group | Boston University Edition 5
6. New England
OpenSolaris
Users Group
Welcome to the Sun HPC Software, Developer
Edition for OpenSolaris
Virtual Software Appliance
OpenSolaris based
Integrated development environment
Distributed resource management
Cloud connectivity
New England OpenSolaris Users Group | Boston University Edition 6
7. New England
OpenSolaris
Users Group
Developer Architecture
Developer Components
Virtual Machine Image Amazon Machine Images
(VirtualBox or VMware) (AMIs)
Example Programs C, C++, Fortran Example Programs Development Tools
Sun HPC ClusterTools
Development Tools Sun HPC ClusterTools Sun Studio
DRM SGE/SDM
DRM Sun Grid Engine/Service Domain Manager (SGE/SDM) Operating System
OpenSolaris
Operating System
AMIs under the control of
OpenSolaris Global Zone Local Zone 1 Local Zone 2 Drivers, etc.
OpenVPN, Tun/Tap drivers Amazon EC2 AMI tools
Drivers, etc. Amazon EC2 AMI tools OpenVPN, Tun/Tap drivers
SGE&SDM
Sun Component 3rd Party Open Source or Commercial
Amazon Cloud
New England OpenSolaris Users Group | Boston University Edition 7
8. New England
OpenSolaris
Users Group
Sun HPC Software, Developer Edition for OpenSolaris
Why it is important for you
What it is
How it works
New England OpenSolaris Users Group | Boston University Edition 8
9. New England
OpenSolaris
Users Group
Developer Interface
Cloud (Amazon EC2) Connectivity via Service Domain Manager
DRM (Sun Grid Engine)
Development Tools (Sun Studio&HPC Cluster Tools)
New England OpenSolaris Users Group | Boston University Edition 9
10. New England
OpenSolaris
Users Group
Sun HPC Software, Developer Edition for OpenSolaris
DRM (Sun Grid Engine)
New England OpenSolaris Users Group | Boston University Edition 10
11. New England
OpenSolaris
Users Group
Sun Grid Engine – Job Submission
New England OpenSolaris Users Group | Boston University Edition 11
12. New England
OpenSolaris
Users Group
Sun Grid Engine – Job Control
New England OpenSolaris Users Group | Boston University Edition 12
13. New England
OpenSolaris
Users Group
Sun HPC Software, Developer Edition for OpenSolaris
Development Tools (Sun Studio & HPC ClusterTools)
New England OpenSolaris Users Group | Boston University Edition 13
14. New England
OpenSolaris
Users Group
Sun Studio – Code Development (IDE)
New England OpenSolaris Users Group | Boston University Edition 14
15. New England
OpenSolaris
Users Group
Sun Studio – Profiling (DTrace Plugin)
New England OpenSolaris Users Group | Boston University Edition 15
16. New England
OpenSolaris
Users Group
Sun Studio – Profiling (DLight Plugin)
New England OpenSolaris Users Group | Boston University Edition 16
17. New England
OpenSolaris
Users Group
Sun Studio – Profiling (Performance Analyzer)
New England OpenSolaris Users Group | Boston University Edition 17
18. New England
OpenSolaris
Users Group
Sun Studio – Profiling (Performance Analyzer)
New England OpenSolaris Users Group | Boston University Edition 18
19. New England
OpenSolaris
Users Group
Sun HPC Software, Developer Edition for OpenSolaris
Cloud Connectivity via Service Domain Manager
New England OpenSolaris Users Group | Boston University Edition 19
20. New England
OpenSolaris
Users Group
Predefined Example Programs
Sun Studio SGE plugin Predefined SGE jobs
New England OpenSolaris Users Group | Boston University Edition 20
21. New England
OpenSolaris
Users Group
Cloud Connectivity via SDM Cloud Adapter
Cloud Connection Initialization
New England OpenSolaris Users Group | Boston University Edition 21
22. New England
OpenSolaris
Users Group
Cloud Connectivity: Initial Setup
No. of cloud based hosts
New England OpenSolaris Users Group | Boston University Edition 22
23. New England
OpenSolaris
Users Group
Cloud Connectivity: Cloud and local zones based hosts
Local Zones based hosts
Cloud based hosts
New England OpenSolaris Users Group | Boston University Edition 23
24. New England
OpenSolaris
Users Group
Cloud Connectivity: Amazon EC2 AMIs
New England OpenSolaris Users Group | Boston University Edition 24
25. New England
OpenSolaris
Users Group
Cloud Connectivity: Submit SGE jobs to cloud
Cloud based Parallel Environment
New England OpenSolaris Users Group | Boston University Edition 25
26. New England
OpenSolaris
Users Group
Cloud Connectivity: SGE Jobs Running in the Cloud
Cloud based Parallel Job
New England OpenSolaris Users Group | Boston University Edition 26
27. New England
OpenSolaris
Users Group
Cloud Connectivity: SGE Job Results
New England OpenSolaris Users Group | Boston University Edition 27
28. New England
OpenSolaris
Users Group
Take aways
No need for tedious configuration
Turnkey development environment ready to go
Focus on creativity, not system management
Easy to use
Ready for cloud
Use it now
New England OpenSolaris Users Group | Boston University Edition 28
29. New England
OpenSolaris
Users Group
How to get started
Product page:
http://www.sun.com/software/products/hpcsoftware/hpcdev/solaris/index.jsp
Free Download:
https://www.sun.com/HPCOSDE-1.0
Documentation wiki:
https://wikis.sun.com/display/hpc/Sun+HPC+Software,+Solaris+Developer+Ed
ition+1.0
Community page:
http://www.opensolaris.org/os/project/hpc-stack/
Support by community/Sun HPC SW Engineering:
hpcdistro-support@opensolaris.org
HPC Developer Community discussion:
hpcdev-discuss@opensolaris.org
Order free DVDs:
https://dct.sun.com/dct/forms/reg_us_2406_149_0.jsp
Screencasts:
http://channelsun.sun.com/video/systems/hpc/1659839071/sun+hpc+develope
r+software+for+opensolaris+screencasts+pt.+1/33387704001
New England OpenSolaris Users Group | Boston University Edition 29
30. HPC Development on OpenSolaris for
Cloud Environments
Bogdan Vasiliu
bogdan.vasiliu@sun.com