SlideShare uma empresa Scribd logo
1 de 18
www.univa.com
www.univa.com
Ian Lumb
Solutions Architect
SUSE, Booth #1681
SC17, Denver, CO
November 15, 2017
Beyond Workload
Monitoring and Reporting
for SUSE Linux Clusters:
Taking Action with
Dynamic Rules
www.univa.com
❑ Metrics for monitoring and reporting upon workloads
❑ Rule-based alerts
❑ Highly dynamic use cases
❑ Just-released capabilities
❑ Q&A
2
Agenda
www.univa.com
3
Unisight 4.0
▪ Completely refactored implementation
▪ Monitors and reports upon Univa Grid Engine workloads
▪ Integrates with Univa Grid Engine add-ons
▪ Included with an existing license for Univa Grid Engine
www.univa.com
4
Unisight 4.1
▪ Compare multiple values from an attribute in an object
▪ e.g., compare ‘running’ and ‘pending’ jobs on the same graph
▪ Collect metrics automatically for NVIDIA GPUs
▪ Makes use of the Univa Grid Engine custom load sensor
▪ Create tables and charts for Docker-enabled hosts and recently
used Docker images
▪ Requires use of Docker-enabled Univa Grid Engine
▪ Import legacy reporting or accounting files
▪ Requires Univa Grid Engine 8.2.x or more recent
▪ Automatically detect and use added/removed complex entries
▪ Based on interaction with one or more Univa Grid Engine clusters
▪ (Site-defined) complexes can be used in Unisight filters, tables & charts
www.univa.com
5
Unisight 4.2
▪ Built-in dashboard charts for cluster and job efficiency
▪ For each job: CPU Time / ( Wallclock Time * Slots )
o May be normalized
▪ Job details including pending reasons
▪ ~ “qstat –j <JOBID>” + “qalter –w p <JOBID>”
▪ Additional types of charts
▪ e.g., bar
▪ Alerting rules – for admins only in this release
▪ New screen added to support this capability
▪ Any data available via Unisight can be used in these rules
▪ Actions include the ability to alert the admin via the Unisight UI, email
or Slack
www.univa.com
6
Unisight 4.3
▪ Dynamic rules
▪ Data known to Unisight can be framed as a variable
▪ Rule handlers includes a chaining capability
▪ Concurrently pending jobs as a function of time
▪ Concurrent license utilization as a function of time
▪ CPU efficiency as a function of time
▪ Memory utilization displayed in different units
www.univa.comwww.univa.com
www.univa.comwww.univa.com
www.univa.comwww.univa.com
www.univa.com
Rules Engine
Demos
www.univa.com
11
www.univa.com
12
www.univa.com
13
www.univa.com
14
www.univa.com
15
16
Unisight Prerequisites
▪ Supported operating systems
▪ 64-bit SUSE Linux Enterprise Server 12 and 11 SP4
▪ Network configuration
▪ MongoDB, port: 57017
▪ UniSight REST API, port: 8080, 8443
▪ Web GUI, port: 3003
Ports can be changed from the default values
▪ Hardware
▪ Each component can be installed on different machines
▪ For a single machine install
o Quad core system with 8 GB RAM and 100 GB disk
www.univa.com
www.univa.com
17
Next steps …
▪ Unisight 4.3 is available to Univa
Grid Engine and SUSE customers
▪ So …
www.univa.com
www.univa.com
18
THANK YOU
Ian Lumb
ilumb@univa.com
Solutions Architect

Mais conteúdo relacionado

Mais de Ian Lumb

High Performance Computing in the Cloud?
High Performance Computing in the Cloud?High Performance Computing in the Cloud?
High Performance Computing in the Cloud?Ian Lumb
 
VoDcast Slides: The Rise in Popularity of Apache Spark
VoDcast Slides: The Rise in Popularity of Apache SparkVoDcast Slides: The Rise in Popularity of Apache Spark
VoDcast Slides: The Rise in Popularity of Apache SparkIan Lumb
 
Bright Topics Webinar April 15, 2015 - Modernized Monitoring for Cluster and ...
Bright Topics Webinar April 15, 2015 - Modernized Monitoring for Cluster and ...Bright Topics Webinar April 15, 2015 - Modernized Monitoring for Cluster and ...
Bright Topics Webinar April 15, 2015 - Modernized Monitoring for Cluster and ...Ian Lumb
 
Utilizing Public AND Private Clouds with Bright Cluster Manager
Utilizing Public AND Private Clouds with Bright Cluster ManagerUtilizing Public AND Private Clouds with Bright Cluster Manager
Utilizing Public AND Private Clouds with Bright Cluster ManagerIan Lumb
 
How to Upgrade Your Hadoop Stack in 1 Step -- with Zero Downtime
How to Upgrade Your Hadoop Stack in 1 Step -- with Zero DowntimeHow to Upgrade Your Hadoop Stack in 1 Step -- with Zero Downtime
How to Upgrade Your Hadoop Stack in 1 Step -- with Zero DowntimeIan Lumb
 
Bright Cluster Manager: A Comprehensive, Integrated Management Solution for P...
Bright Cluster Manager: A Comprehensive, Integrated Management Solution for P...Bright Cluster Manager: A Comprehensive, Integrated Management Solution for P...
Bright Cluster Manager: A Comprehensive, Integrated Management Solution for P...Ian Lumb
 

Mais de Ian Lumb (6)

High Performance Computing in the Cloud?
High Performance Computing in the Cloud?High Performance Computing in the Cloud?
High Performance Computing in the Cloud?
 
VoDcast Slides: The Rise in Popularity of Apache Spark
VoDcast Slides: The Rise in Popularity of Apache SparkVoDcast Slides: The Rise in Popularity of Apache Spark
VoDcast Slides: The Rise in Popularity of Apache Spark
 
Bright Topics Webinar April 15, 2015 - Modernized Monitoring for Cluster and ...
Bright Topics Webinar April 15, 2015 - Modernized Monitoring for Cluster and ...Bright Topics Webinar April 15, 2015 - Modernized Monitoring for Cluster and ...
Bright Topics Webinar April 15, 2015 - Modernized Monitoring for Cluster and ...
 
Utilizing Public AND Private Clouds with Bright Cluster Manager
Utilizing Public AND Private Clouds with Bright Cluster ManagerUtilizing Public AND Private Clouds with Bright Cluster Manager
Utilizing Public AND Private Clouds with Bright Cluster Manager
 
How to Upgrade Your Hadoop Stack in 1 Step -- with Zero Downtime
How to Upgrade Your Hadoop Stack in 1 Step -- with Zero DowntimeHow to Upgrade Your Hadoop Stack in 1 Step -- with Zero Downtime
How to Upgrade Your Hadoop Stack in 1 Step -- with Zero Downtime
 
Bright Cluster Manager: A Comprehensive, Integrated Management Solution for P...
Bright Cluster Manager: A Comprehensive, Integrated Management Solution for P...Bright Cluster Manager: A Comprehensive, Integrated Management Solution for P...
Bright Cluster Manager: A Comprehensive, Integrated Management Solution for P...
 

Último

HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comFatema Valibhai
 
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...stazi3110
 
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...OnePlan Solutions
 
why an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdfwhy an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdfjoe51371421
 
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AISyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AIABDERRAOUF MEHENNI
 
Software Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsSoftware Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsArshad QA
 
Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...OnePlan Solutions
 
How To Use Server-Side Rendering with Nuxt.js
How To Use Server-Side Rendering with Nuxt.jsHow To Use Server-Side Rendering with Nuxt.js
How To Use Server-Side Rendering with Nuxt.jsAndolasoft Inc
 
Salesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantSalesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantAxelRicardoTrocheRiq
 
Unlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language ModelsUnlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language Modelsaagamshah0812
 
A Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxA Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxComplianceQuest1
 
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...harshavardhanraghave
 
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdfThe Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdfkalichargn70th171
 
Hand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxHand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxbodapatigopi8531
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...ICS
 
Test Automation Strategy for Frontend and Backend
Test Automation Strategy for Frontend and BackendTest Automation Strategy for Frontend and Backend
Test Automation Strategy for Frontend and BackendArshad QA
 
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...gurkirankumar98700
 
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfkalichargn70th171
 

Último (20)

HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.com
 
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
 
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
 
why an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdfwhy an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdf
 
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AISyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
 
Software Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsSoftware Quality Assurance Interview Questions
Software Quality Assurance Interview Questions
 
Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...
 
How To Use Server-Side Rendering with Nuxt.js
How To Use Server-Side Rendering with Nuxt.jsHow To Use Server-Side Rendering with Nuxt.js
How To Use Server-Side Rendering with Nuxt.js
 
Salesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantSalesforce Certified Field Service Consultant
Salesforce Certified Field Service Consultant
 
Exploring iOS App Development: Simplifying the Process
Exploring iOS App Development: Simplifying the ProcessExploring iOS App Development: Simplifying the Process
Exploring iOS App Development: Simplifying the Process
 
Unlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language ModelsUnlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language Models
 
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS LiveVip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
 
A Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxA Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docx
 
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
 
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdfThe Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
 
Hand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxHand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptx
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
 
Test Automation Strategy for Frontend and Backend
Test Automation Strategy for Frontend and BackendTest Automation Strategy for Frontend and Backend
Test Automation Strategy for Frontend and Backend
 
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
 
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
 

Beyond Workload Monitoring and Reporting for SUSE Linux Clusters: Taking Action with Dynamic Rules

  • 1. www.univa.com www.univa.com Ian Lumb Solutions Architect SUSE, Booth #1681 SC17, Denver, CO November 15, 2017 Beyond Workload Monitoring and Reporting for SUSE Linux Clusters: Taking Action with Dynamic Rules
  • 2. www.univa.com ❑ Metrics for monitoring and reporting upon workloads ❑ Rule-based alerts ❑ Highly dynamic use cases ❑ Just-released capabilities ❑ Q&A 2 Agenda
  • 3. www.univa.com 3 Unisight 4.0 ▪ Completely refactored implementation ▪ Monitors and reports upon Univa Grid Engine workloads ▪ Integrates with Univa Grid Engine add-ons ▪ Included with an existing license for Univa Grid Engine
  • 4. www.univa.com 4 Unisight 4.1 ▪ Compare multiple values from an attribute in an object ▪ e.g., compare ‘running’ and ‘pending’ jobs on the same graph ▪ Collect metrics automatically for NVIDIA GPUs ▪ Makes use of the Univa Grid Engine custom load sensor ▪ Create tables and charts for Docker-enabled hosts and recently used Docker images ▪ Requires use of Docker-enabled Univa Grid Engine ▪ Import legacy reporting or accounting files ▪ Requires Univa Grid Engine 8.2.x or more recent ▪ Automatically detect and use added/removed complex entries ▪ Based on interaction with one or more Univa Grid Engine clusters ▪ (Site-defined) complexes can be used in Unisight filters, tables & charts
  • 5. www.univa.com 5 Unisight 4.2 ▪ Built-in dashboard charts for cluster and job efficiency ▪ For each job: CPU Time / ( Wallclock Time * Slots ) o May be normalized ▪ Job details including pending reasons ▪ ~ “qstat –j <JOBID>” + “qalter –w p <JOBID>” ▪ Additional types of charts ▪ e.g., bar ▪ Alerting rules – for admins only in this release ▪ New screen added to support this capability ▪ Any data available via Unisight can be used in these rules ▪ Actions include the ability to alert the admin via the Unisight UI, email or Slack
  • 6. www.univa.com 6 Unisight 4.3 ▪ Dynamic rules ▪ Data known to Unisight can be framed as a variable ▪ Rule handlers includes a chaining capability ▪ Concurrently pending jobs as a function of time ▪ Concurrent license utilization as a function of time ▪ CPU efficiency as a function of time ▪ Memory utilization displayed in different units
  • 16. 16 Unisight Prerequisites ▪ Supported operating systems ▪ 64-bit SUSE Linux Enterprise Server 12 and 11 SP4 ▪ Network configuration ▪ MongoDB, port: 57017 ▪ UniSight REST API, port: 8080, 8443 ▪ Web GUI, port: 3003 Ports can be changed from the default values ▪ Hardware ▪ Each component can be installed on different machines ▪ For a single machine install o Quad core system with 8 GB RAM and 100 GB disk www.univa.com
  • 17. www.univa.com 17 Next steps … ▪ Unisight 4.3 is available to Univa Grid Engine and SUSE customers ▪ So … www.univa.com