SlideShare a Scribd company logo
1 of 21
Advanced
Automated Analytics
Using OSS Tools
Presented By Theo Laughner – TVA
Author Fred Elmendorf – GPA
2016 FALLS Users’ Group
Presentation Overview
• Open Source Software (OSS) Approach
• Building Blocks of an Automated System
• Examples and Use Cases
• Food for Thought
• Questions
Open Source Software (OSS) Approach
• Stimulates innovation
• Encourages and facilitates collaboration
• Reduces time to deployment
• Reduces cycle time for improvements
• Lowers total cost of ownership
• Accelerates development
• Avoids vendor lock-in
• Lowers on-going software maintenance costs
• Improves code quality
• Improves security through community review
The Open Source Tool Suite
Building Blocks of an Automated System
• Get the data
• Analyze the data
• Visualize the data
Get the Data
• Physical transport of data from field device to a central repository
• Can be anything from disk copy to fiber network
• Determines the periodicity of data processing
• An OSS project called openMIC can be used to fully automate this
step
• https://github.com/GridProtectionAlliance/openMIC
openMIC – Meter Information Collector
• Schedules device
interrogation and
manages the returned
data
• Via IP
• Via Modem
(RAS & FTP)
• Via ModBus
• Logs and reports meter
problems
• Includes a mobile-ready
web app to configure
openMIC and view
device interrogation
statistics
Analyze the Data
• Process the data as quickly as it is available
• No manual interaction to complete the task
• Send appropriate notifications immediately
• Build a database for visualization and analysis
• openXDA can be used to accomplish this step
• Project contributions from EPRI and direct from utilities
• https://github.com/GridProtectionAlliance/openXDA
openXDA – eXtensible Disturbance Analytics
• Automatically processes and analyzes event
files from disturbance monitoring equipment
such as DFRs and PQ monitors
• Loads this file-based data into an enterprise
grade relational database
• Enables on-the-fly analytics such as single and
double-ended fault location, voltage
sag and swell analysis, breaker timing
evaluation, among others.
• Supports both open source and proprietary
analytics
• The data layer for Open PQ Dashboard and
openSEE
openXDA Inputs
• Power System Configuration Data
• Meter name and location
• Meter channel definitions (for fault location)
• Line parameters (for fault location)
• Waveform Data
• COMTRADE
• PQDIF
• EMAX (native format)
• SEL .eve (SEL-251, SEL-351, Sel-421 relays)
• SEL .cev format under development
openXDA – Recent Community Activities
• Breaker Timing at GTC
• Ability to apply fault determination logic executed externally to
openXDA
• Increased flexibility regarding required data:
• No longer requires all three phases
• Accepts magnitude and duration only files such as ION 8650-C data
• Cap Bank monitoring research at TVA
Visualize the Data
• A Web based dashboard can be available company wide
• Secured by user credentials
• Visualize entire fleet of devices regardless of brand or type
• Intuitive displays:
• Geographic
• Annunciation panel
• Historical performance
• Details by day, site, device, channel
• Animation for a specific value over 24 hours
• Weather data overlays
• Real-time ModBus data
• Open PQ Dashboard can be used to accomplish this step
• Open PQ Dashboard was initiated by the Electric Power Research Institute
• https://github.com/GridProtectionAlliance/PQDashboard
EPRI Open PQ Dashboard
• A web-based enterprise dashboard that nicely complements traditional vendor-
provided waveform analysis tools
• Displays the results of the analytics that run automatically in openXDA
• Provides drill-down from wide-area displays to full resolution waveforms
Version 1.0.3
Examples and Use Cases
Automated Analytics in Production
• Fault presence, and type
• Single and double ended fault distance
• Standard Power Quality parameters such as sag, swell, etc.
• Breaker timing assessment
• Historical trend performance
• Data quality:
• Completeness
• Correctness
• Reasonableness
Examples and Use Cases
External Analytic Integration
• Incipient cable fault analysis
• Capacitor switching transient analysis
Automated Analytics in Development
• Advanced breaker operation analysis
• Capacitor health assessment
Automated Lightning Correlation
• A number of utilities have expressed need
• Once the time and location are determined, the automated analytic
process can easily interrogate a lightning source such as the TXD-100
and include the results in the database for use in visualizations
• Prerequisites include:
• Geospatial information for power system structures
• Access to lightning data source
Example Lightning Integration at TVA
Food for Thought – OSS Building Blocks
• Functional and deployed in operational systems
• Facilitate fully automated advanced analytic systems to perform any
analysis appropriate for the type of data available.
• Provide dramatically improved access to information compared to
manual methods.
• What we see today, it is only the tip of the iceberg.
• Other functions such as data quality, device availability, and device
performance are also being applied in this environment.
Food for Thought - Conclusions
• OSS is a good environment to
accelerate power system
tools
• Building blocks exist to build
a fully automated end-to-end
system
• Any appropriate analytic can
be added
• Automated lightning and
weather correlation can be
included
Food for Thought – References
• BSD License https://en.wikipedia.org/wiki/BSD_licenses
• MIT License https://en.wikipedia.org/wiki/MIT_License
• openMIC https://github.com/GridProtectionAlliance/openMIC
• openXDA http://gridprotectionalliance.org/products.asp#XDA
• PQDashboard
https://github.com/GridProtectionAlliance/PQDashboard
• OSI https://opensource.com/resources/what-open-source
Thank You!
Fred Elmendorf
Grid Protection Alliance
http://gridrpotectionalliance.org

More Related Content

What's hot

GSM UMTS LTE Site Commissioning software
GSM UMTS LTE Site Commissioning softwareGSM UMTS LTE Site Commissioning software
GSM UMTS LTE Site Commissioning softwareAhmet Ozturk
 
Automating the cip compliance test lab
Automating the cip compliance test labAutomating the cip compliance test lab
Automating the cip compliance test labChuck Reynolds
 
Virtual Gov Day - IT Operations Breakout - Jennifer Green, R&D Scientist, Los...
Virtual Gov Day - IT Operations Breakout - Jennifer Green, R&D Scientist, Los...Virtual Gov Day - IT Operations Breakout - Jennifer Green, R&D Scientist, Los...
Virtual Gov Day - IT Operations Breakout - Jennifer Green, R&D Scientist, Los...Splunk
 
Apache Apex - Hadoop Users Group
Apache Apex - Hadoop Users GroupApache Apex - Hadoop Users Group
Apache Apex - Hadoop Users GroupPramod Immaneni
 
GPEH, PCHR, CHR, MR, SIG, CTUM, CELL TRACE, UETR Parsers - Innovile
GPEH, PCHR, CHR, MR, SIG, CTUM, CELL TRACE, UETR Parsers - InnovileGPEH, PCHR, CHR, MR, SIG, CTUM, CELL TRACE, UETR Parsers - Innovile
GPEH, PCHR, CHR, MR, SIG, CTUM, CELL TRACE, UETR Parsers - InnovileAhmet Ozturk
 
Database ingest with Apache NiFi and MiNiFi
Database ingest with Apache NiFi and MiNiFiDatabase ingest with Apache NiFi and MiNiFi
Database ingest with Apache NiFi and MiNiFiLucian Neghina
 
Prototype Implementation of a Demand Driven Network Monitoring Architecture
Prototype Implementation of a Demand Driven Network Monitoring ArchitecturePrototype Implementation of a Demand Driven Network Monitoring Architecture
Prototype Implementation of a Demand Driven Network Monitoring ArchitectureAugusto Ciuffoletti
 
Supersonic, Subatomic, Kubernetes Native Java : Microservices Day Dallas
Supersonic, Subatomic, Kubernetes Native Java : Microservices Day DallasSupersonic, Subatomic, Kubernetes Native Java : Microservices Day Dallas
Supersonic, Subatomic, Kubernetes Native Java : Microservices Day DallasJeremy Davis
 
Accela NSN Site NodeB Rehome
Accela NSN Site NodeB RehomeAccela NSN Site NodeB Rehome
Accela NSN Site NodeB RehomeAhmet Ozturk
 
Monitoring Docker Containers and Dockererized Application
Monitoring Docker Containers and Dockererized ApplicationMonitoring Docker Containers and Dockererized Application
Monitoring Docker Containers and Dockererized ApplicationRahul Krishna Upadhyaya
 
Apache Apex Meetup at Cask
Apache Apex Meetup at CaskApache Apex Meetup at Cask
Apache Apex Meetup at CaskApache Apex
 
Air Quality Data Acquisition and Management Systems
Air Quality Data Acquisition and Management SystemsAir Quality Data Acquisition and Management Systems
Air Quality Data Acquisition and Management SystemsAgilaire LLC
 
Orbit GSM UMTS LTE parser platform - ETL tool
Orbit GSM UMTS LTE parser platform - ETL toolOrbit GSM UMTS LTE parser platform - ETL tool
Orbit GSM UMTS LTE parser platform - ETL toolAhmet Ozturk
 
Transparency-Enhancing Toolset beta - TET 2.0 overview
Transparency-Enhancing Toolset beta - TET 2.0 overviewTransparency-Enhancing Toolset beta - TET 2.0 overview
Transparency-Enhancing Toolset beta - TET 2.0 overviewArkadiusz Stasiewicz
 
AWS Loft Talk: Behind the Scenes with SignalFx
AWS Loft Talk: Behind the Scenes with SignalFxAWS Loft Talk: Behind the Scenes with SignalFx
AWS Loft Talk: Behind the Scenes with SignalFxSignalFx
 
Agilaire 8872 Data Logger
Agilaire 8872 Data LoggerAgilaire 8872 Data Logger
Agilaire 8872 Data LoggerAgilaire LLC
 

What's hot (18)

GSM UMTS LTE Site Commissioning software
GSM UMTS LTE Site Commissioning softwareGSM UMTS LTE Site Commissioning software
GSM UMTS LTE Site Commissioning software
 
Automating the cip compliance test lab
Automating the cip compliance test labAutomating the cip compliance test lab
Automating the cip compliance test lab
 
Virtual Gov Day - IT Operations Breakout - Jennifer Green, R&D Scientist, Los...
Virtual Gov Day - IT Operations Breakout - Jennifer Green, R&D Scientist, Los...Virtual Gov Day - IT Operations Breakout - Jennifer Green, R&D Scientist, Los...
Virtual Gov Day - IT Operations Breakout - Jennifer Green, R&D Scientist, Los...
 
Apache Apex - Hadoop Users Group
Apache Apex - Hadoop Users GroupApache Apex - Hadoop Users Group
Apache Apex - Hadoop Users Group
 
GPEH, PCHR, CHR, MR, SIG, CTUM, CELL TRACE, UETR Parsers - Innovile
GPEH, PCHR, CHR, MR, SIG, CTUM, CELL TRACE, UETR Parsers - InnovileGPEH, PCHR, CHR, MR, SIG, CTUM, CELL TRACE, UETR Parsers - Innovile
GPEH, PCHR, CHR, MR, SIG, CTUM, CELL TRACE, UETR Parsers - Innovile
 
Database ingest with Apache NiFi and MiNiFi
Database ingest with Apache NiFi and MiNiFiDatabase ingest with Apache NiFi and MiNiFi
Database ingest with Apache NiFi and MiNiFi
 
Cloud Architecture
Cloud ArchitectureCloud Architecture
Cloud Architecture
 
Prototype Implementation of a Demand Driven Network Monitoring Architecture
Prototype Implementation of a Demand Driven Network Monitoring ArchitecturePrototype Implementation of a Demand Driven Network Monitoring Architecture
Prototype Implementation of a Demand Driven Network Monitoring Architecture
 
Supersonic, Subatomic, Kubernetes Native Java : Microservices Day Dallas
Supersonic, Subatomic, Kubernetes Native Java : Microservices Day DallasSupersonic, Subatomic, Kubernetes Native Java : Microservices Day Dallas
Supersonic, Subatomic, Kubernetes Native Java : Microservices Day Dallas
 
Accela NSN Site NodeB Rehome
Accela NSN Site NodeB RehomeAccela NSN Site NodeB Rehome
Accela NSN Site NodeB Rehome
 
SFScon19 - Francesco La Spina -7 Steps to Industry 40
SFScon19 - Francesco La Spina -7 Steps to Industry 40SFScon19 - Francesco La Spina -7 Steps to Industry 40
SFScon19 - Francesco La Spina -7 Steps to Industry 40
 
Monitoring Docker Containers and Dockererized Application
Monitoring Docker Containers and Dockererized ApplicationMonitoring Docker Containers and Dockererized Application
Monitoring Docker Containers and Dockererized Application
 
Apache Apex Meetup at Cask
Apache Apex Meetup at CaskApache Apex Meetup at Cask
Apache Apex Meetup at Cask
 
Air Quality Data Acquisition and Management Systems
Air Quality Data Acquisition and Management SystemsAir Quality Data Acquisition and Management Systems
Air Quality Data Acquisition and Management Systems
 
Orbit GSM UMTS LTE parser platform - ETL tool
Orbit GSM UMTS LTE parser platform - ETL toolOrbit GSM UMTS LTE parser platform - ETL tool
Orbit GSM UMTS LTE parser platform - ETL tool
 
Transparency-Enhancing Toolset beta - TET 2.0 overview
Transparency-Enhancing Toolset beta - TET 2.0 overviewTransparency-Enhancing Toolset beta - TET 2.0 overview
Transparency-Enhancing Toolset beta - TET 2.0 overview
 
AWS Loft Talk: Behind the Scenes with SignalFx
AWS Loft Talk: Behind the Scenes with SignalFxAWS Loft Talk: Behind the Scenes with SignalFx
AWS Loft Talk: Behind the Scenes with SignalFx
 
Agilaire 8872 Data Logger
Agilaire 8872 Data LoggerAgilaire 8872 Data Logger
Agilaire 8872 Data Logger
 

Viewers also liked

2008. Next Generation OSS. Bartacek and Straka
2008. Next Generation OSS. Bartacek and Straka2008. Next Generation OSS. Bartacek and Straka
2008. Next Generation OSS. Bartacek and StrakaEmeldi Group
 
Analyzing telecommunications data for improved customer experience
Analyzing telecommunications data for improved customer experienceAnalyzing telecommunications data for improved customer experience
Analyzing telecommunications data for improved customer experienceComarch
 
Lightning and Power Systems in the 21st Century
Lightning and Power Systems in the 21st CenturyLightning and Power Systems in the 21st Century
Lightning and Power Systems in the 21st CenturyGrid Protection Alliance
 
Building Operational Intelligence in Telecom with IBM ODM @Claro
Building Operational Intelligence in Telecom with IBM ODM @ClaroBuilding Operational Intelligence in Telecom with IBM ODM @Claro
Building Operational Intelligence in Telecom with IBM ODM @ClaroIcaro Tech
 
02 mc will v6 operation and support system(by song yongliang&zhao chunping)
02 mc will v6 operation and support system(by song yongliang&zhao chunping)02 mc will v6 operation and support system(by song yongliang&zhao chunping)
02 mc will v6 operation and support system(by song yongliang&zhao chunping)Kao Hul
 
Case Study - BSS Transformation
Case Study - BSS TransformationCase Study - BSS Transformation
Case Study - BSS TransformationJames Burns
 
Comarch Telecom Brunch - KPN case study
Comarch Telecom Brunch - KPN case studyComarch Telecom Brunch - KPN case study
Comarch Telecom Brunch - KPN case studyComarch
 
Intelligent traffic signal control system using embedded system
Intelligent traffic signal control system using embedded systemIntelligent traffic signal control system using embedded system
Intelligent traffic signal control system using embedded systemAlexander Decker
 
Dynamic lightning protection system
Dynamic lightning protection systemDynamic lightning protection system
Dynamic lightning protection systemRahul Goyal
 
How network operators improve their efficiency and prepare for market consoli...
How network operators improve their efficiency and prepare for market consoli...How network operators improve their efficiency and prepare for market consoli...
How network operators improve their efficiency and prepare for market consoli...Comarch
 
Smart Grid Overvoltage Protection
Smart Grid Overvoltage ProtectionSmart Grid Overvoltage Protection
Smart Grid Overvoltage ProtectionMike Nager
 
Enterprise architecture supporting decision making process
Enterprise architecture supporting decision making processEnterprise architecture supporting decision making process
Enterprise architecture supporting decision making processDr. Fahim K Sufi
 
How will virtual networks, controlled by software, impact OSS systems?
How will virtual networks, controlled by software, impact OSS systems?How will virtual networks, controlled by software, impact OSS systems?
How will virtual networks, controlled by software, impact OSS systems?Comarch
 
Ppt of 132kv gss sitapura jaipur
Ppt of 132kv gss sitapura jaipurPpt of 132kv gss sitapura jaipur
Ppt of 132kv gss sitapura jaipurkishankky
 
Summer Training Presentation, DLW Varanasi
Summer Training Presentation, DLW VaranasiSummer Training Presentation, DLW Varanasi
Summer Training Presentation, DLW VaranasiSHAILESH SHUKLA
 
Smart Traffic Light Controller
Smart Traffic Light ControllerSmart Traffic Light Controller
Smart Traffic Light ControllerHimanshi_Sharma
 

Viewers also liked (20)

2008. Next Generation OSS. Bartacek and Straka
2008. Next Generation OSS. Bartacek and Straka2008. Next Generation OSS. Bartacek and Straka
2008. Next Generation OSS. Bartacek and Straka
 
Analyzing telecommunications data for improved customer experience
Analyzing telecommunications data for improved customer experienceAnalyzing telecommunications data for improved customer experience
Analyzing telecommunications data for improved customer experience
 
Lightning and Power Systems in the 21st Century
Lightning and Power Systems in the 21st CenturyLightning and Power Systems in the 21st Century
Lightning and Power Systems in the 21st Century
 
Dauleshupadhyay
DauleshupadhyayDauleshupadhyay
Dauleshupadhyay
 
Robinatech_eTOM-Training
Robinatech_eTOM-TrainingRobinatech_eTOM-Training
Robinatech_eTOM-Training
 
Building Operational Intelligence in Telecom with IBM ODM @Claro
Building Operational Intelligence in Telecom with IBM ODM @ClaroBuilding Operational Intelligence in Telecom with IBM ODM @Claro
Building Operational Intelligence in Telecom with IBM ODM @Claro
 
02 mc will v6 operation and support system(by song yongliang&zhao chunping)
02 mc will v6 operation and support system(by song yongliang&zhao chunping)02 mc will v6 operation and support system(by song yongliang&zhao chunping)
02 mc will v6 operation and support system(by song yongliang&zhao chunping)
 
Case Study - BSS Transformation
Case Study - BSS TransformationCase Study - BSS Transformation
Case Study - BSS Transformation
 
Comarch Telecom Brunch - KPN case study
Comarch Telecom Brunch - KPN case studyComarch Telecom Brunch - KPN case study
Comarch Telecom Brunch - KPN case study
 
Intelligent traffic signal control system using embedded system
Intelligent traffic signal control system using embedded systemIntelligent traffic signal control system using embedded system
Intelligent traffic signal control system using embedded system
 
Dynamic lightning protection system
Dynamic lightning protection systemDynamic lightning protection system
Dynamic lightning protection system
 
How network operators improve their efficiency and prepare for market consoli...
How network operators improve their efficiency and prepare for market consoli...How network operators improve their efficiency and prepare for market consoli...
How network operators improve their efficiency and prepare for market consoli...
 
Smart Grid Overvoltage Protection
Smart Grid Overvoltage ProtectionSmart Grid Overvoltage Protection
Smart Grid Overvoltage Protection
 
Enterprise architecture supporting decision making process
Enterprise architecture supporting decision making processEnterprise architecture supporting decision making process
Enterprise architecture supporting decision making process
 
How will virtual networks, controlled by software, impact OSS systems?
How will virtual networks, controlled by software, impact OSS systems?How will virtual networks, controlled by software, impact OSS systems?
How will virtual networks, controlled by software, impact OSS systems?
 
SMART GRID
SMART GRIDSMART GRID
SMART GRID
 
Ppt of 132kv gss sitapura jaipur
Ppt of 132kv gss sitapura jaipurPpt of 132kv gss sitapura jaipur
Ppt of 132kv gss sitapura jaipur
 
Summer Training Presentation, DLW Varanasi
Summer Training Presentation, DLW VaranasiSummer Training Presentation, DLW Varanasi
Summer Training Presentation, DLW Varanasi
 
Smart sensor technology in healthcare & protection
Smart sensor technology in healthcare & protectionSmart sensor technology in healthcare & protection
Smart sensor technology in healthcare & protection
 
Smart Traffic Light Controller
Smart Traffic Light ControllerSmart Traffic Light Controller
Smart Traffic Light Controller
 

Similar to Advanced Automated Analytics Using OSS Tools

Historic Opportunities: Discover the Power of Ignition's Historian
Historic Opportunities: Discover the Power of Ignition's HistorianHistoric Opportunities: Discover the Power of Ignition's Historian
Historic Opportunities: Discover the Power of Ignition's HistorianInductive Automation
 
Decision Matrix for IoT Product Development
Decision Matrix for IoT Product DevelopmentDecision Matrix for IoT Product Development
Decision Matrix for IoT Product DevelopmentAlexey Pyshkin
 
David Henthorn [Rose-Hulman Institute of Technology] | Illuminating the Dark ...
David Henthorn [Rose-Hulman Institute of Technology] | Illuminating the Dark ...David Henthorn [Rose-Hulman Institute of Technology] | Illuminating the Dark ...
David Henthorn [Rose-Hulman Institute of Technology] | Illuminating the Dark ...InfluxData
 
Smart Manufacturing Requirements for Equipment Capability and Control
Smart Manufacturing Requirements forEquipment Capability and ControlSmart Manufacturing Requirements forEquipment Capability and Control
Smart Manufacturing Requirements for Equipment Capability and ControlKimberly Daich
 
Building data intensive applications
Building data intensive applicationsBuilding data intensive applications
Building data intensive applicationsAmit Kejriwal
 
Webinar on Latency and throughput computation of automotive EE network
Webinar on Latency and throughput computation of automotive EE networkWebinar on Latency and throughput computation of automotive EE network
Webinar on Latency and throughput computation of automotive EE networkDeepak Shankar
 
Opal: Simple Web Services Wrappers for Scientific Applications
Opal: Simple Web Services Wrappers for Scientific ApplicationsOpal: Simple Web Services Wrappers for Scientific Applications
Opal: Simple Web Services Wrappers for Scientific ApplicationsSriram Krishnan
 
Data Vault Automation at the Bijenkorf
Data Vault Automation at the BijenkorfData Vault Automation at the Bijenkorf
Data Vault Automation at the BijenkorfRob Winters
 
ADDO Open Source Observability Tools
ADDO Open Source Observability Tools ADDO Open Source Observability Tools
ADDO Open Source Observability Tools Mickey Boxell
 
Using VisualSim Architect for Semiconductor System Analysis
Using VisualSim Architect for Semiconductor System AnalysisUsing VisualSim Architect for Semiconductor System Analysis
Using VisualSim Architect for Semiconductor System AnalysisDeepak Shankar
 
Architect’s Open-Source Guide for a Data Mesh Architecture
Architect’s Open-Source Guide for a Data Mesh ArchitectureArchitect’s Open-Source Guide for a Data Mesh Architecture
Architect’s Open-Source Guide for a Data Mesh ArchitectureDatabricks
 
LinkedIn's Approach to Programmable Data Center
LinkedIn's Approach to Programmable Data CenterLinkedIn's Approach to Programmable Data Center
LinkedIn's Approach to Programmable Data CenterShawn Zandi
 
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...Spark Summit
 
PEARC17: Live Integrated Visualization Environment: An Experiment in General...
PEARC17: Live Integrated Visualization Environment: An Experiment in General...PEARC17: Live Integrated Visualization Environment: An Experiment in General...
PEARC17: Live Integrated Visualization Environment: An Experiment in General...moneyjh
 
Model Based Test Validation and Oracles for Data Acquisition Systems
Model Based Test Validation and Oracles for Data Acquisition SystemsModel Based Test Validation and Oracles for Data Acquisition Systems
Model Based Test Validation and Oracles for Data Acquisition SystemsLionel Briand
 
performancetestinganoverview-110206071921-phpapp02.pdf
performancetestinganoverview-110206071921-phpapp02.pdfperformancetestinganoverview-110206071921-phpapp02.pdf
performancetestinganoverview-110206071921-phpapp02.pdfMAshok10
 
Overview of DuraMat software tool development
Overview of DuraMat software tool developmentOverview of DuraMat software tool development
Overview of DuraMat software tool developmentAnubhav Jain
 

Similar to Advanced Automated Analytics Using OSS Tools (20)

Cloud Migration
Cloud MigrationCloud Migration
Cloud Migration
 
Historic Opportunities: Discover the Power of Ignition's Historian
Historic Opportunities: Discover the Power of Ignition's HistorianHistoric Opportunities: Discover the Power of Ignition's Historian
Historic Opportunities: Discover the Power of Ignition's Historian
 
Decision Matrix for IoT Product Development
Decision Matrix for IoT Product DevelopmentDecision Matrix for IoT Product Development
Decision Matrix for IoT Product Development
 
Best Practices Using RTI Connext DDS
Best Practices Using RTI Connext DDSBest Practices Using RTI Connext DDS
Best Practices Using RTI Connext DDS
 
David Henthorn [Rose-Hulman Institute of Technology] | Illuminating the Dark ...
David Henthorn [Rose-Hulman Institute of Technology] | Illuminating the Dark ...David Henthorn [Rose-Hulman Institute of Technology] | Illuminating the Dark ...
David Henthorn [Rose-Hulman Institute of Technology] | Illuminating the Dark ...
 
Smart Manufacturing Requirements for Equipment Capability and Control
Smart Manufacturing Requirements forEquipment Capability and ControlSmart Manufacturing Requirements forEquipment Capability and Control
Smart Manufacturing Requirements for Equipment Capability and Control
 
Building data intensive applications
Building data intensive applicationsBuilding data intensive applications
Building data intensive applications
 
Webinar on Latency and throughput computation of automotive EE network
Webinar on Latency and throughput computation of automotive EE networkWebinar on Latency and throughput computation of automotive EE network
Webinar on Latency and throughput computation of automotive EE network
 
Opal: Simple Web Services Wrappers for Scientific Applications
Opal: Simple Web Services Wrappers for Scientific ApplicationsOpal: Simple Web Services Wrappers for Scientific Applications
Opal: Simple Web Services Wrappers for Scientific Applications
 
Data Vault Automation at the Bijenkorf
Data Vault Automation at the BijenkorfData Vault Automation at the Bijenkorf
Data Vault Automation at the Bijenkorf
 
ADDO Open Source Observability Tools
ADDO Open Source Observability Tools ADDO Open Source Observability Tools
ADDO Open Source Observability Tools
 
Using VisualSim Architect for Semiconductor System Analysis
Using VisualSim Architect for Semiconductor System AnalysisUsing VisualSim Architect for Semiconductor System Analysis
Using VisualSim Architect for Semiconductor System Analysis
 
Architect’s Open-Source Guide for a Data Mesh Architecture
Architect’s Open-Source Guide for a Data Mesh ArchitectureArchitect’s Open-Source Guide for a Data Mesh Architecture
Architect’s Open-Source Guide for a Data Mesh Architecture
 
LinkedIn's Approach to Programmable Data Center
LinkedIn's Approach to Programmable Data CenterLinkedIn's Approach to Programmable Data Center
LinkedIn's Approach to Programmable Data Center
 
GPA Software Overview R3
GPA Software Overview R3GPA Software Overview R3
GPA Software Overview R3
 
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...
 
PEARC17: Live Integrated Visualization Environment: An Experiment in General...
PEARC17: Live Integrated Visualization Environment: An Experiment in General...PEARC17: Live Integrated Visualization Environment: An Experiment in General...
PEARC17: Live Integrated Visualization Environment: An Experiment in General...
 
Model Based Test Validation and Oracles for Data Acquisition Systems
Model Based Test Validation and Oracles for Data Acquisition SystemsModel Based Test Validation and Oracles for Data Acquisition Systems
Model Based Test Validation and Oracles for Data Acquisition Systems
 
performancetestinganoverview-110206071921-phpapp02.pdf
performancetestinganoverview-110206071921-phpapp02.pdfperformancetestinganoverview-110206071921-phpapp02.pdf
performancetestinganoverview-110206071921-phpapp02.pdf
 
Overview of DuraMat software tool development
Overview of DuraMat software tool developmentOverview of DuraMat software tool development
Overview of DuraMat software tool development
 

Recently uploaded

April 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's AnalysisApril 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's Analysismanisha194592
 
Log Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxLog Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxJohnnyPlasten
 
Generative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and MilvusGenerative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and MilvusTimothy Spann
 
Zuja dropshipping via API with DroFx.pptx
Zuja dropshipping via API with DroFx.pptxZuja dropshipping via API with DroFx.pptx
Zuja dropshipping via API with DroFx.pptxolyaivanovalion
 
Week-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interactionWeek-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interactionfulawalesam
 
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% SecureCall me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% SecurePooja Nehwal
 
100-Concepts-of-AI by Anupama Kate .pptx
100-Concepts-of-AI by Anupama Kate .pptx100-Concepts-of-AI by Anupama Kate .pptx
100-Concepts-of-AI by Anupama Kate .pptxAnupama Kate
 
Discover Why Less is More in B2B Research
Discover Why Less is More in B2B ResearchDiscover Why Less is More in B2B Research
Discover Why Less is More in B2B Researchmichael115558
 
Edukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFxEdukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFxolyaivanovalion
 
BigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxBigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxolyaivanovalion
 
Accredited-Transport-Cooperatives-Jan-2021-Web.pdf
Accredited-Transport-Cooperatives-Jan-2021-Web.pdfAccredited-Transport-Cooperatives-Jan-2021-Web.pdf
Accredited-Transport-Cooperatives-Jan-2021-Web.pdfadriantubila
 
Vip Model Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...
Vip Model  Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...Vip Model  Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...
Vip Model Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...shivangimorya083
 
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...Delhi Call girls
 
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Callshivangimorya083
 
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Callshivangimorya083
 
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...amitlee9823
 
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...amitlee9823
 

Recently uploaded (20)

April 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's AnalysisApril 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's Analysis
 
Log Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxLog Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptx
 
Generative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and MilvusGenerative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and Milvus
 
Zuja dropshipping via API with DroFx.pptx
Zuja dropshipping via API with DroFx.pptxZuja dropshipping via API with DroFx.pptx
Zuja dropshipping via API with DroFx.pptx
 
Week-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interactionWeek-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interaction
 
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% SecureCall me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
 
Delhi 99530 vip 56974 Genuine Escort Service Call Girls in Kishangarh
Delhi 99530 vip 56974 Genuine Escort Service Call Girls in  KishangarhDelhi 99530 vip 56974 Genuine Escort Service Call Girls in  Kishangarh
Delhi 99530 vip 56974 Genuine Escort Service Call Girls in Kishangarh
 
100-Concepts-of-AI by Anupama Kate .pptx
100-Concepts-of-AI by Anupama Kate .pptx100-Concepts-of-AI by Anupama Kate .pptx
100-Concepts-of-AI by Anupama Kate .pptx
 
Discover Why Less is More in B2B Research
Discover Why Less is More in B2B ResearchDiscover Why Less is More in B2B Research
Discover Why Less is More in B2B Research
 
Edukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFxEdukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFx
 
BigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxBigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptx
 
Accredited-Transport-Cooperatives-Jan-2021-Web.pdf
Accredited-Transport-Cooperatives-Jan-2021-Web.pdfAccredited-Transport-Cooperatives-Jan-2021-Web.pdf
Accredited-Transport-Cooperatives-Jan-2021-Web.pdf
 
Vip Model Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...
Vip Model  Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...Vip Model  Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...
Vip Model Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...
 
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
 
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
 
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
 
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
 
Sampling (random) method and Non random.ppt
Sampling (random) method and Non random.pptSampling (random) method and Non random.ppt
Sampling (random) method and Non random.ppt
 
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get CytotecAbortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
 
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
 

Advanced Automated Analytics Using OSS Tools

  • 1. Advanced Automated Analytics Using OSS Tools Presented By Theo Laughner – TVA Author Fred Elmendorf – GPA 2016 FALLS Users’ Group
  • 2. Presentation Overview • Open Source Software (OSS) Approach • Building Blocks of an Automated System • Examples and Use Cases • Food for Thought • Questions
  • 3. Open Source Software (OSS) Approach • Stimulates innovation • Encourages and facilitates collaboration • Reduces time to deployment • Reduces cycle time for improvements • Lowers total cost of ownership • Accelerates development • Avoids vendor lock-in • Lowers on-going software maintenance costs • Improves code quality • Improves security through community review
  • 4. The Open Source Tool Suite
  • 5. Building Blocks of an Automated System • Get the data • Analyze the data • Visualize the data
  • 6. Get the Data • Physical transport of data from field device to a central repository • Can be anything from disk copy to fiber network • Determines the periodicity of data processing • An OSS project called openMIC can be used to fully automate this step • https://github.com/GridProtectionAlliance/openMIC
  • 7. openMIC – Meter Information Collector • Schedules device interrogation and manages the returned data • Via IP • Via Modem (RAS & FTP) • Via ModBus • Logs and reports meter problems • Includes a mobile-ready web app to configure openMIC and view device interrogation statistics
  • 8. Analyze the Data • Process the data as quickly as it is available • No manual interaction to complete the task • Send appropriate notifications immediately • Build a database for visualization and analysis • openXDA can be used to accomplish this step • Project contributions from EPRI and direct from utilities • https://github.com/GridProtectionAlliance/openXDA
  • 9. openXDA – eXtensible Disturbance Analytics • Automatically processes and analyzes event files from disturbance monitoring equipment such as DFRs and PQ monitors • Loads this file-based data into an enterprise grade relational database • Enables on-the-fly analytics such as single and double-ended fault location, voltage sag and swell analysis, breaker timing evaluation, among others. • Supports both open source and proprietary analytics • The data layer for Open PQ Dashboard and openSEE
  • 10. openXDA Inputs • Power System Configuration Data • Meter name and location • Meter channel definitions (for fault location) • Line parameters (for fault location) • Waveform Data • COMTRADE • PQDIF • EMAX (native format) • SEL .eve (SEL-251, SEL-351, Sel-421 relays) • SEL .cev format under development
  • 11. openXDA – Recent Community Activities • Breaker Timing at GTC • Ability to apply fault determination logic executed externally to openXDA • Increased flexibility regarding required data: • No longer requires all three phases • Accepts magnitude and duration only files such as ION 8650-C data • Cap Bank monitoring research at TVA
  • 12. Visualize the Data • A Web based dashboard can be available company wide • Secured by user credentials • Visualize entire fleet of devices regardless of brand or type • Intuitive displays: • Geographic • Annunciation panel • Historical performance • Details by day, site, device, channel • Animation for a specific value over 24 hours • Weather data overlays • Real-time ModBus data • Open PQ Dashboard can be used to accomplish this step • Open PQ Dashboard was initiated by the Electric Power Research Institute • https://github.com/GridProtectionAlliance/PQDashboard
  • 13. EPRI Open PQ Dashboard • A web-based enterprise dashboard that nicely complements traditional vendor- provided waveform analysis tools • Displays the results of the analytics that run automatically in openXDA • Provides drill-down from wide-area displays to full resolution waveforms Version 1.0.3
  • 14. Examples and Use Cases Automated Analytics in Production • Fault presence, and type • Single and double ended fault distance • Standard Power Quality parameters such as sag, swell, etc. • Breaker timing assessment • Historical trend performance • Data quality: • Completeness • Correctness • Reasonableness
  • 15. Examples and Use Cases External Analytic Integration • Incipient cable fault analysis • Capacitor switching transient analysis Automated Analytics in Development • Advanced breaker operation analysis • Capacitor health assessment
  • 16. Automated Lightning Correlation • A number of utilities have expressed need • Once the time and location are determined, the automated analytic process can easily interrogate a lightning source such as the TXD-100 and include the results in the database for use in visualizations • Prerequisites include: • Geospatial information for power system structures • Access to lightning data source
  • 18. Food for Thought – OSS Building Blocks • Functional and deployed in operational systems • Facilitate fully automated advanced analytic systems to perform any analysis appropriate for the type of data available. • Provide dramatically improved access to information compared to manual methods. • What we see today, it is only the tip of the iceberg. • Other functions such as data quality, device availability, and device performance are also being applied in this environment.
  • 19. Food for Thought - Conclusions • OSS is a good environment to accelerate power system tools • Building blocks exist to build a fully automated end-to-end system • Any appropriate analytic can be added • Automated lightning and weather correlation can be included
  • 20. Food for Thought – References • BSD License https://en.wikipedia.org/wiki/BSD_licenses • MIT License https://en.wikipedia.org/wiki/MIT_License • openMIC https://github.com/GridProtectionAlliance/openMIC • openXDA http://gridprotectionalliance.org/products.asp#XDA • PQDashboard https://github.com/GridProtectionAlliance/PQDashboard • OSI https://opensource.com/resources/what-open-source
  • 21. Thank You! Fred Elmendorf Grid Protection Alliance http://gridrpotectionalliance.org