SlideShare uma empresa Scribd logo
1 de 21
Baixar para ler offline
Deploying R into Business Intelligence and
Real-time Applications
Lou Bajuk-Yorgan
Sr. Dir., Product Management
TIBCO Spotfire
lbajuk@tibco.com
@loubajuk
© Copyright 2000-2014 TIBCO Software Inc.
1
R in Business Intelligence and Real-time Applications
• TIBCO, S+, and embracing R
• Challenges of R for Enterprise applications
• TIBCO Enterprise Runtime for R (TERR)
– Motivation and Benefits
• Applications of R/TERR
• Learn more and try it yourself
- 2
Milestones on the Journey to TERR
• John Chambers developed the S language at Bell Labs
– Starting in the mid 70’s
• Insightful (Statsci) founded to commercial S as S+ in 1987
– The “plus”: statistical libraries, documentation, and support
– Later focus on commercial users, ease of use, server integration
• R: development begun by Ross Ihaka and Robert Gentleman at University of
Auckland in mid 90’s
• Insightful acquired by TIBCO in 2008
– Spotfire (for Data Discovery and Visualization) acquired in 2007
• Focus on applying Advanced Analytics in Spotfire & TIBCO applications
– Step 1: Embrace R
- 3
Embracing R
• Spotfire Statistics Server
– Integration of R & S+ into Spotfire
applications
• Later added SAS® & MATLAB®
– Leverage the interactive visualizations,
data access and application
development of Spotfire
• Well received—but our Enterprise
customers need more
– R provides tremendous benefits to
statisticians
– But large enterprises are often
challenged to leverage that value
- 4
© Copyright 2000-2013 TIBCO Software Inc.
• Core R engine struggles with Big Data & Fast Data (real time)
– Customers don’t use R, or reimplement R code in specialized libraries or other
languages, or leverage Hadoop, etc. to parallelize R
– Lose agility & consistency, delay time to production, lose opportunities
• R was not intended for enterprise usage
– Not the right tool for real-time, high performance & reliability, big data
– Built originally as an academic tool for research and teaching
– Proprietary & Specialized packages still dependent on the core engine
• Free to acquire, but costly to maintain
– Version incompatibilities, variable quality in packages
– Lack of enterprise-level technical support
Enterprise Challenges for Open Source R
5
© Copyright 2000-2013 TIBCO Software Inc.
• Enterprise-grade implementation of the R language
– Completely new R interpreter, developed from the ground up
– Based on TIBCO’s long history and expertise with S+
– Designed to be fully compatible with R language
– Faster and more memory efficient than open source R
– Fully supported by TIBCO
TERR extends the reach of R in the enterprise
– Develop code in open source R
– Deploy on a commercially-supported and robust platform
• Without the delay and cost of rewriting your code
TIBCO Enterprise Runtime for R (TERR)
© Copyright 2000-2013 TIBCO Software Inc.
• Embedded in TIBCO Spotfire
– Enhance Business Intelligence and interactive visualizations for everyone in an
organization
– Works out of the box—no configuration or set up required
• Integrated with TIBCO Complex Event Processing
– Apply R models in real time, event-driven applications
– Advanced Analytics on “Fast Data”
• Cloud-based analytics
– TIBCO Cloud Compute Grid
• Custom applications developed by TIBCO customers and partners
Applications of TERR
TERR in Spotfire
• Powers Predictive Modeling & Forecast Tools
• Easily enhance Spotfire analyses and applications with R language scripts
• TERR is embedded in Spotfire Analyst/Desktop
– No other software required, no connection to server required. Simply works.
• Spotfire analyses that use TERR can be deployed to the web
Predicting the Business
Customer Churn:
• Retain your most profitable customers
• Increase upsell, decrease churn
Fraud Detection:
• Reduce losses due to fraudulent
transactions
Supply Chain Optimization:
• Anticipate peaks and lulls
• Optimize distribution centers
HR Planning:
• Predict employee attrition and optimize
retention
Demo & Case Study
© Copyright 2000-2013 TIBCO Software Inc.
© Copyright 2000-2013 TIBCO Software Inc.
© Copyright 2000-2013 TIBCO Software Inc.
TERR in BI and Real Time applications
© Copyright 2000-2013 TIBCO Software Inc.
• Alert Facilities Managers to
Severe Weather Alerts
• Use TIBCO Streambase to
monitor alerts in real time
– TERR queries for current
weather alerts
– Uses sp & rgdal package
to compare areas of alerts
vs. facility locations
• On alert, update Spotfire
visualization with mapped
alerts, notify Facilities
managers
Severe Weather Alerts Tracking for Facilities
© Copyright 2000-2013 TIBCO Software Inc.
• Oil & Gas Extraction
– Maintenance Downtime and
Equipment failures are costly
– Engineers track sensor data to
find leading indicators
• Temperature, vibration, etc.
• Engineers usually use ad hoc
rules on leading indicators
– R/TERR used to develop
predictive models for
preventative maintenance
– Deployed in real-time systems,
alert when maintenance
recommended
Predictive Maintenance for Oil & Gas
© Copyright 2000-2013 TIBCO Software Inc.
• Major Logistics Company
• Port Congestion Detection
– Real time system triggers TERR
– Analyzes port congestion
– Recommends reduction of speed
if no berths available
• Maritime Abnormality Detection
– Based on Automatic Identification
System info, TERR calculates
likelihood of deviation from normal
sailing routes
– Alerts carrier & operator
Logistics Optimization
TIBCO Cloud Compute Grid
• High performance computing on the cloud
– Available on TIBCO Cloud Marketplace
• Robust DataSynapse GridServer architecture
– Used by Wall Street to manage 10K’s nodes
– Java, .NET, and REST APIs (JSON)
• Perfect for pure computational work
– Vastly easier to use for applications like Monte
Carlo simulations than Map-Reduce
– Run complex statistical models multiple orders of
magnitude faster than open source R on a single
computer
– Unparalleled scalability without upfront capital
investment
• Easy to get started
– Uses your Amazon EC2 account
TERR for individual R users
• Empower R users
– Enterprise platform for the deployment and
integration of your work—without having to rewrite
it!
• TERR Developer Edition
– Full version of TERR engine for testing code prior to
deployment
• Compatible with RStudio & ESS Emacs
– Free for non-production use
– Supported through Community site
– Available at Tap.tibco.com
-
Summary
• TIBCO makes the power of R available across the enterprise
– Ad-hoc Predictive Analytics for Data Scientists
• Spotfire & TERR
– Guided Analytic Applications
• Spotfire & Statistics Services predictive ecosystem, starring TERR
– Event-driven, real-time analytics
• Spotfire Event Analytics, TIBCO CEP & TERR
• TERR is R for the Enterprise
– Enables customers to develop code in open source R, then deploy their R code on
commercially-supported and robust platforms—without recoding, saving time &
money
– Enables TIBCO, partners & customers products to tightly & efficiently embed R
language functionality
• TERR Community at TIBCOmmunity.com
– Resources, Documentation, FAQs, Forums
– More info at spotfire.tibco.com/terr
• TERR Developer Edition
– Full version of TERR engine for testing code prior to deployment
– Supported through TIBCOmmunity, download via tap.tibco.com
• Presentations: http://www.slideshare.net/loubajukyorgan/presentations
Learn more and Try it yourself

Mais conteúdo relacionado

Mais procurados

Splunk at Lloyds Banking Group
Splunk at Lloyds Banking GroupSplunk at Lloyds Banking Group
Splunk at Lloyds Banking GroupSplunk
 
Big Data Ecosystem- Impetus Technologies
Big Data Ecosystem-  Impetus TechnologiesBig Data Ecosystem-  Impetus Technologies
Big Data Ecosystem- Impetus TechnologiesImpetus Technologies
 
Cloud expo june 2013: Building a Real Time Analytics Platform on Big Data in ...
Cloud expo june 2013: Building a Real Time Analytics Platform on Big Data in ...Cloud expo june 2013: Building a Real Time Analytics Platform on Big Data in ...
Cloud expo june 2013: Building a Real Time Analytics Platform on Big Data in ...Sanjay Sharma
 
JDE & Peoplesoft 2 _ Denise Hill _ Maintenance Scheduling of electricity and ...
JDE & Peoplesoft 2 _ Denise Hill _ Maintenance Scheduling of electricity and ...JDE & Peoplesoft 2 _ Denise Hill _ Maintenance Scheduling of electricity and ...
JDE & Peoplesoft 2 _ Denise Hill _ Maintenance Scheduling of electricity and ...InSync2011
 
Using InfluxDB for Full Observability of a SaaS Platform by Aleksandr Tavgen,...
Using InfluxDB for Full Observability of a SaaS Platform by Aleksandr Tavgen,...Using InfluxDB for Full Observability of a SaaS Platform by Aleksandr Tavgen,...
Using InfluxDB for Full Observability of a SaaS Platform by Aleksandr Tavgen,...InfluxData
 
Trey Weaver's Resume
Trey Weaver's ResumeTrey Weaver's Resume
Trey Weaver's ResumeTrey Weaver
 
Americas LFM User Meeting 2018 - Graham Dalton, LFM
Americas LFM User Meeting 2018 - Graham Dalton, LFMAmericas LFM User Meeting 2018 - Graham Dalton, LFM
Americas LFM User Meeting 2018 - Graham Dalton, LFMVanessa Erickson
 
Scale Your Load Balancer from 0 to 1 million TPS on Azure
Scale Your Load Balancer from 0 to 1 million TPS on AzureScale Your Load Balancer from 0 to 1 million TPS on Azure
Scale Your Load Balancer from 0 to 1 million TPS on AzureAvi Networks
 
BIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICS
BIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICSBIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICS
BIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICSTIBCO Spotfire
 
EnGenius' End to End Solution (E2ES)
EnGenius' End to End Solution (E2ES)EnGenius' End to End Solution (E2ES)
EnGenius' End to End Solution (E2ES)Bryan Slayman
 
Modern Reporting at Scale: How to Distribute Information and Answers to the M...
Modern Reporting at Scale: How to Distribute Information and Answers to the M...Modern Reporting at Scale: How to Distribute Information and Answers to the M...
Modern Reporting at Scale: How to Distribute Information and Answers to the M...TIBCO Jaspersoft
 
Heimmermann_Resume_2016-11b
Heimmermann_Resume_2016-11bHeimmermann_Resume_2016-11b
Heimmermann_Resume_2016-11bDean Heimmerman
 
Data Acquisition Automation for NiFi in a Hybrid Cloud environment – the Path...
Data Acquisition Automation for NiFi in a Hybrid Cloud environment – the Path...Data Acquisition Automation for NiFi in a Hybrid Cloud environment – the Path...
Data Acquisition Automation for NiFi in a Hybrid Cloud environment – the Path...DataWorks Summit
 
Example presentation implement project wireless (thai)
Example presentation implement project wireless (thai)Example presentation implement project wireless (thai)
Example presentation implement project wireless (thai)Kero Kung
 
Streaming analytics overview for R
Streaming analytics overview for RStreaming analytics overview for R
Streaming analytics overview for RLou Bajuk
 

Mais procurados (16)

Splunk at Lloyds Banking Group
Splunk at Lloyds Banking GroupSplunk at Lloyds Banking Group
Splunk at Lloyds Banking Group
 
Big Data Ecosystem- Impetus Technologies
Big Data Ecosystem-  Impetus TechnologiesBig Data Ecosystem-  Impetus Technologies
Big Data Ecosystem- Impetus Technologies
 
Cloud expo june 2013: Building a Real Time Analytics Platform on Big Data in ...
Cloud expo june 2013: Building a Real Time Analytics Platform on Big Data in ...Cloud expo june 2013: Building a Real Time Analytics Platform on Big Data in ...
Cloud expo june 2013: Building a Real Time Analytics Platform on Big Data in ...
 
JDE & Peoplesoft 2 _ Denise Hill _ Maintenance Scheduling of electricity and ...
JDE & Peoplesoft 2 _ Denise Hill _ Maintenance Scheduling of electricity and ...JDE & Peoplesoft 2 _ Denise Hill _ Maintenance Scheduling of electricity and ...
JDE & Peoplesoft 2 _ Denise Hill _ Maintenance Scheduling of electricity and ...
 
The Factory InfoStore:Using SoA to Easily Create Factory Applications
The Factory InfoStore:Using SoA to Easily Create Factory ApplicationsThe Factory InfoStore:Using SoA to Easily Create Factory Applications
The Factory InfoStore:Using SoA to Easily Create Factory Applications
 
Using InfluxDB for Full Observability of a SaaS Platform by Aleksandr Tavgen,...
Using InfluxDB for Full Observability of a SaaS Platform by Aleksandr Tavgen,...Using InfluxDB for Full Observability of a SaaS Platform by Aleksandr Tavgen,...
Using InfluxDB for Full Observability of a SaaS Platform by Aleksandr Tavgen,...
 
Trey Weaver's Resume
Trey Weaver's ResumeTrey Weaver's Resume
Trey Weaver's Resume
 
Americas LFM User Meeting 2018 - Graham Dalton, LFM
Americas LFM User Meeting 2018 - Graham Dalton, LFMAmericas LFM User Meeting 2018 - Graham Dalton, LFM
Americas LFM User Meeting 2018 - Graham Dalton, LFM
 
Scale Your Load Balancer from 0 to 1 million TPS on Azure
Scale Your Load Balancer from 0 to 1 million TPS on AzureScale Your Load Balancer from 0 to 1 million TPS on Azure
Scale Your Load Balancer from 0 to 1 million TPS on Azure
 
BIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICS
BIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICSBIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICS
BIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICS
 
EnGenius' End to End Solution (E2ES)
EnGenius' End to End Solution (E2ES)EnGenius' End to End Solution (E2ES)
EnGenius' End to End Solution (E2ES)
 
Modern Reporting at Scale: How to Distribute Information and Answers to the M...
Modern Reporting at Scale: How to Distribute Information and Answers to the M...Modern Reporting at Scale: How to Distribute Information and Answers to the M...
Modern Reporting at Scale: How to Distribute Information and Answers to the M...
 
Heimmermann_Resume_2016-11b
Heimmermann_Resume_2016-11bHeimmermann_Resume_2016-11b
Heimmermann_Resume_2016-11b
 
Data Acquisition Automation for NiFi in a Hybrid Cloud environment – the Path...
Data Acquisition Automation for NiFi in a Hybrid Cloud environment – the Path...Data Acquisition Automation for NiFi in a Hybrid Cloud environment – the Path...
Data Acquisition Automation for NiFi in a Hybrid Cloud environment – the Path...
 
Example presentation implement project wireless (thai)
Example presentation implement project wireless (thai)Example presentation implement project wireless (thai)
Example presentation implement project wireless (thai)
 
Streaming analytics overview for R
Streaming analytics overview for RStreaming analytics overview for R
Streaming analytics overview for R
 

Semelhante a TERR in BI and Real Time applications

Deploying R in BI and Real time Applications
Deploying R in BI and Real time ApplicationsDeploying R in BI and Real time Applications
Deploying R in BI and Real time ApplicationsLou Bajuk
 
Extending the Reach of R to the Enterprise with TERR and Spotfire
Extending the Reach of R to the Enterprise with TERR and SpotfireExtending the Reach of R to the Enterprise with TERR and Spotfire
Extending the Reach of R to the Enterprise with TERR and SpotfireLou Bajuk
 
Extend the Reach of R to the Enterprise (for useR! 2013)
Extend the Reach of R to the Enterprise (for useR! 2013)Extend the Reach of R to the Enterprise (for useR! 2013)
Extend the Reach of R to the Enterprise (for useR! 2013)Lou Bajuk
 
Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...
Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...
Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...Data Con LA
 
Applying R in BI and Real Time applications EARL London 2015
Applying R in BI and Real Time applications EARL London 2015Applying R in BI and Real Time applications EARL London 2015
Applying R in BI and Real Time applications EARL London 2015Lou Bajuk
 
Real time applications using the R Language
Real time applications using the R LanguageReal time applications using the R Language
Real time applications using the R LanguageLou Bajuk
 
Houston Energy Data Science Meet up_TIBCO Slides
Houston Energy Data Science Meet up_TIBCO SlidesHouston Energy Data Science Meet up_TIBCO Slides
Houston Energy Data Science Meet up_TIBCO SlidesJennifer Walsh
 
RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...
RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...
RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...Databricks
 
Engineering Effectiveness
Engineering EffectivenessEngineering Effectiveness
Engineering EffectivenessMarcio Sete
 
TIBCO presentation at the Chief Analytics Officer Forum East Coast 2016 (#CAO...
TIBCO presentation at the Chief Analytics Officer Forum East Coast 2016 (#CAO...TIBCO presentation at the Chief Analytics Officer Forum East Coast 2016 (#CAO...
TIBCO presentation at the Chief Analytics Officer Forum East Coast 2016 (#CAO...Chief Analytics Officer Forum
 
The Rise of Postmodern ERP
The Rise of Postmodern ERP The Rise of Postmodern ERP
The Rise of Postmodern ERP Coupa Software
 
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...Spark Summit
 
Ahead of the Stream: How to Future-Proof Real-Time Analytics
Ahead of the Stream: How to Future-Proof Real-Time AnalyticsAhead of the Stream: How to Future-Proof Real-Time Analytics
Ahead of the Stream: How to Future-Proof Real-Time AnalyticsInside Analysis
 
Tibco Augmented Intelligence - Analytics, IoT, Big Data, Streaming 20161025
Tibco Augmented Intelligence - Analytics, IoT, Big Data, Streaming 20161025Tibco Augmented Intelligence - Analytics, IoT, Big Data, Streaming 20161025
Tibco Augmented Intelligence - Analytics, IoT, Big Data, Streaming 20161025Nicola Sandoli
 
Meeting Nuvollo - La passerelle-I.D.E
Meeting Nuvollo - La passerelle-I.D.EMeeting Nuvollo - La passerelle-I.D.E
Meeting Nuvollo - La passerelle-I.D.ENuvollo
 
Nuvollo and La passerelle-I.D.E
Nuvollo and La passerelle-I.D.ENuvollo and La passerelle-I.D.E
Nuvollo and La passerelle-I.D.ENuvollo
 
Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...
Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...
Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...Matt Stubbs
 
Cox Communications: Fueling a Smarter Operations Center
Cox Communications:  Fueling a Smarter Operations CenterCox Communications:  Fueling a Smarter Operations Center
Cox Communications: Fueling a Smarter Operations CenterSoftware AG
 

Semelhante a TERR in BI and Real Time applications (20)

Deploying R in BI and Real time Applications
Deploying R in BI and Real time ApplicationsDeploying R in BI and Real time Applications
Deploying R in BI and Real time Applications
 
Extending the Reach of R to the Enterprise with TERR and Spotfire
Extending the Reach of R to the Enterprise with TERR and SpotfireExtending the Reach of R to the Enterprise with TERR and Spotfire
Extending the Reach of R to the Enterprise with TERR and Spotfire
 
Extend the Reach of R to the Enterprise (for useR! 2013)
Extend the Reach of R to the Enterprise (for useR! 2013)Extend the Reach of R to the Enterprise (for useR! 2013)
Extend the Reach of R to the Enterprise (for useR! 2013)
 
Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...
Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...
Big Data Day LA 2016/ Big Data Track - Apply R in Enterprise Applications, Lo...
 
Applying R in BI and Real Time applications EARL London 2015
Applying R in BI and Real Time applications EARL London 2015Applying R in BI and Real Time applications EARL London 2015
Applying R in BI and Real Time applications EARL London 2015
 
Real time applications using the R Language
Real time applications using the R LanguageReal time applications using the R Language
Real time applications using the R Language
 
Houston Energy Data Science Meet up_TIBCO Slides
Houston Energy Data Science Meet up_TIBCO SlidesHouston Energy Data Science Meet up_TIBCO Slides
Houston Energy Data Science Meet up_TIBCO Slides
 
RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...
RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...
RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...
 
Engineering Effectiveness
Engineering EffectivenessEngineering Effectiveness
Engineering Effectiveness
 
TIBCO presentation at the Chief Analytics Officer Forum East Coast 2016 (#CAO...
TIBCO presentation at the Chief Analytics Officer Forum East Coast 2016 (#CAO...TIBCO presentation at the Chief Analytics Officer Forum East Coast 2016 (#CAO...
TIBCO presentation at the Chief Analytics Officer Forum East Coast 2016 (#CAO...
 
VASU_VALLABHUNI_INFOSYS
VASU_VALLABHUNI_INFOSYSVASU_VALLABHUNI_INFOSYS
VASU_VALLABHUNI_INFOSYS
 
The Rise of Postmodern ERP
The Rise of Postmodern ERP The Rise of Postmodern ERP
The Rise of Postmodern ERP
 
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...
 
Ahead of the Stream: How to Future-Proof Real-Time Analytics
Ahead of the Stream: How to Future-Proof Real-Time AnalyticsAhead of the Stream: How to Future-Proof Real-Time Analytics
Ahead of the Stream: How to Future-Proof Real-Time Analytics
 
Tibco Augmented Intelligence - Analytics, IoT, Big Data, Streaming 20161025
Tibco Augmented Intelligence - Analytics, IoT, Big Data, Streaming 20161025Tibco Augmented Intelligence - Analytics, IoT, Big Data, Streaming 20161025
Tibco Augmented Intelligence - Analytics, IoT, Big Data, Streaming 20161025
 
Meeting Nuvollo - La passerelle-I.D.E
Meeting Nuvollo - La passerelle-I.D.EMeeting Nuvollo - La passerelle-I.D.E
Meeting Nuvollo - La passerelle-I.D.E
 
Nuvollo and La passerelle-I.D.E
Nuvollo and La passerelle-I.D.ENuvollo and La passerelle-I.D.E
Nuvollo and La passerelle-I.D.E
 
Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...
Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...
Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...
 
Validation
ValidationValidation
Validation
 
Cox Communications: Fueling a Smarter Operations Center
Cox Communications:  Fueling a Smarter Operations CenterCox Communications:  Fueling a Smarter Operations Center
Cox Communications: Fueling a Smarter Operations Center
 

Mais de Lou Bajuk

R Consortium update for EARL Boston Oct 2017
R Consortium update for EARL Boston Oct 2017R Consortium update for EARL Boston Oct 2017
R Consortium update for EARL Boston Oct 2017Lou Bajuk
 
Reusing and Managing R models in an Enterprise
Reusing and Managing  R models in an EnterpriseReusing and Managing  R models in an Enterprise
Reusing and Managing R models in an EnterpriseLou Bajuk
 
R consortium update EARL London Sept 2017
R consortium update EARL London Sept 2017R consortium update EARL London Sept 2017
R consortium update EARL London Sept 2017Lou Bajuk
 
Making Data Science accessible to a wider audience
Making Data Science accessible to a wider audienceMaking Data Science accessible to a wider audience
Making Data Science accessible to a wider audienceLou Bajuk
 
R Consortium Update for EARL June 2017
R Consortium Update for EARL June 2017R Consortium Update for EARL June 2017
R Consortium Update for EARL June 2017Lou Bajuk
 
Tibco streaming analytics overview and roadmap
Tibco streaming analytics overview and roadmapTibco streaming analytics overview and roadmap
Tibco streaming analytics overview and roadmapLou Bajuk
 
Embracing data science for smarter analytics apps
Embracing data science for smarter analytics appsEmbracing data science for smarter analytics apps
Embracing data science for smarter analytics appsLou Bajuk
 
EARL Sept 2016 R consortium
EARL Sept 2016 R consortiumEARL Sept 2016 R consortium
EARL Sept 2016 R consortiumLou Bajuk
 
The Importance of an Analytics Platform
The Importance of an Analytics PlatformThe Importance of an Analytics Platform
The Importance of an Analytics PlatformLou Bajuk
 
Software Testing and the R language
Software Testing and the R languageSoftware Testing and the R language
Software Testing and the R languageLou Bajuk
 
The Compatibility Challenge:Examining R and Developing TERR
The Compatibility Challenge:Examining R and Developing TERRThe Compatibility Challenge:Examining R and Developing TERR
The Compatibility Challenge:Examining R and Developing TERRLou Bajuk
 

Mais de Lou Bajuk (11)

R Consortium update for EARL Boston Oct 2017
R Consortium update for EARL Boston Oct 2017R Consortium update for EARL Boston Oct 2017
R Consortium update for EARL Boston Oct 2017
 
Reusing and Managing R models in an Enterprise
Reusing and Managing  R models in an EnterpriseReusing and Managing  R models in an Enterprise
Reusing and Managing R models in an Enterprise
 
R consortium update EARL London Sept 2017
R consortium update EARL London Sept 2017R consortium update EARL London Sept 2017
R consortium update EARL London Sept 2017
 
Making Data Science accessible to a wider audience
Making Data Science accessible to a wider audienceMaking Data Science accessible to a wider audience
Making Data Science accessible to a wider audience
 
R Consortium Update for EARL June 2017
R Consortium Update for EARL June 2017R Consortium Update for EARL June 2017
R Consortium Update for EARL June 2017
 
Tibco streaming analytics overview and roadmap
Tibco streaming analytics overview and roadmapTibco streaming analytics overview and roadmap
Tibco streaming analytics overview and roadmap
 
Embracing data science for smarter analytics apps
Embracing data science for smarter analytics appsEmbracing data science for smarter analytics apps
Embracing data science for smarter analytics apps
 
EARL Sept 2016 R consortium
EARL Sept 2016 R consortiumEARL Sept 2016 R consortium
EARL Sept 2016 R consortium
 
The Importance of an Analytics Platform
The Importance of an Analytics PlatformThe Importance of an Analytics Platform
The Importance of an Analytics Platform
 
Software Testing and the R language
Software Testing and the R languageSoftware Testing and the R language
Software Testing and the R language
 
The Compatibility Challenge:Examining R and Developing TERR
The Compatibility Challenge:Examining R and Developing TERRThe Compatibility Challenge:Examining R and Developing TERR
The Compatibility Challenge:Examining R and Developing TERR
 

Último

Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...Jaydeep Chhasatia
 
Mastering Kubernetes - Basics and Advanced Concepts using Example Project
Mastering Kubernetes - Basics and Advanced Concepts using Example ProjectMastering Kubernetes - Basics and Advanced Concepts using Example Project
Mastering Kubernetes - Basics and Advanced Concepts using Example Projectwajrcs
 
About .NET 8 and a first glimpse into .NET9
About .NET 8 and a first glimpse into .NET9About .NET 8 and a first glimpse into .NET9
About .NET 8 and a first glimpse into .NET9Jürgen Gutsch
 
Webinar - IA generativa e grafi Neo4j: RAG time!
Webinar - IA generativa e grafi Neo4j: RAG time!Webinar - IA generativa e grafi Neo4j: RAG time!
Webinar - IA generativa e grafi Neo4j: RAG time!Neo4j
 
How Does the Epitome of Spyware Differ from Other Malicious Software?
How Does the Epitome of Spyware Differ from Other Malicious Software?How Does the Epitome of Spyware Differ from Other Malicious Software?
How Does the Epitome of Spyware Differ from Other Malicious Software?AmeliaSmith90
 
Introduction-to-Software-Development-Outsourcing.pptx
Introduction-to-Software-Development-Outsourcing.pptxIntroduction-to-Software-Development-Outsourcing.pptx
Introduction-to-Software-Development-Outsourcing.pptxIntelliSource Technologies
 
Growing Oxen: channel operators and retries
Growing Oxen: channel operators and retriesGrowing Oxen: channel operators and retries
Growing Oxen: channel operators and retriesSoftwareMill
 
Why Choose Brain Inventory For Ecommerce Development.pdf
Why Choose Brain Inventory For Ecommerce Development.pdfWhy Choose Brain Inventory For Ecommerce Development.pdf
Why Choose Brain Inventory For Ecommerce Development.pdfBrain Inventory
 
OpenChain Webinar: Universal CVSS Calculator
OpenChain Webinar: Universal CVSS CalculatorOpenChain Webinar: Universal CVSS Calculator
OpenChain Webinar: Universal CVSS CalculatorShane Coughlan
 
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine HarmonyLeveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmonyelliciumsolutionspun
 
Top Software Development Trends in 2024
Top Software Development Trends in  2024Top Software Development Trends in  2024
Top Software Development Trends in 2024Mind IT Systems
 
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdfARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdfTobias Schneck
 
Cybersecurity Challenges with Generative AI - for Good and Bad
Cybersecurity Challenges with Generative AI - for Good and BadCybersecurity Challenges with Generative AI - for Good and Bad
Cybersecurity Challenges with Generative AI - for Good and BadIvo Andreev
 
IA Generativa y Grafos de Neo4j: RAG time
IA Generativa y Grafos de Neo4j: RAG timeIA Generativa y Grafos de Neo4j: RAG time
IA Generativa y Grafos de Neo4j: RAG timeNeo4j
 
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...OnePlan Solutions
 
Generative AI for Cybersecurity - EC-Council
Generative AI for Cybersecurity - EC-CouncilGenerative AI for Cybersecurity - EC-Council
Generative AI for Cybersecurity - EC-CouncilVICTOR MAESTRE RAMIREZ
 
20240330_고급진 코드를 위한 exception 다루기
20240330_고급진 코드를 위한 exception 다루기20240330_고급진 코드를 위한 exception 다루기
20240330_고급진 코드를 위한 exception 다루기Chiwon Song
 
Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/ML
Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/MLBig Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/ML
Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/MLAlluxio, Inc.
 
JS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AIJS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AIIvo Andreev
 

Último (20)

Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
Optimizing Business Potential: A Guide to Outsourcing Engineering Services in...
 
Mastering Kubernetes - Basics and Advanced Concepts using Example Project
Mastering Kubernetes - Basics and Advanced Concepts using Example ProjectMastering Kubernetes - Basics and Advanced Concepts using Example Project
Mastering Kubernetes - Basics and Advanced Concepts using Example Project
 
About .NET 8 and a first glimpse into .NET9
About .NET 8 and a first glimpse into .NET9About .NET 8 and a first glimpse into .NET9
About .NET 8 and a first glimpse into .NET9
 
Webinar - IA generativa e grafi Neo4j: RAG time!
Webinar - IA generativa e grafi Neo4j: RAG time!Webinar - IA generativa e grafi Neo4j: RAG time!
Webinar - IA generativa e grafi Neo4j: RAG time!
 
How Does the Epitome of Spyware Differ from Other Malicious Software?
How Does the Epitome of Spyware Differ from Other Malicious Software?How Does the Epitome of Spyware Differ from Other Malicious Software?
How Does the Epitome of Spyware Differ from Other Malicious Software?
 
Introduction-to-Software-Development-Outsourcing.pptx
Introduction-to-Software-Development-Outsourcing.pptxIntroduction-to-Software-Development-Outsourcing.pptx
Introduction-to-Software-Development-Outsourcing.pptx
 
Growing Oxen: channel operators and retries
Growing Oxen: channel operators and retriesGrowing Oxen: channel operators and retries
Growing Oxen: channel operators and retries
 
Why Choose Brain Inventory For Ecommerce Development.pdf
Why Choose Brain Inventory For Ecommerce Development.pdfWhy Choose Brain Inventory For Ecommerce Development.pdf
Why Choose Brain Inventory For Ecommerce Development.pdf
 
Sustainable Web Design - Claire Thornewill
Sustainable Web Design - Claire ThornewillSustainable Web Design - Claire Thornewill
Sustainable Web Design - Claire Thornewill
 
OpenChain Webinar: Universal CVSS Calculator
OpenChain Webinar: Universal CVSS CalculatorOpenChain Webinar: Universal CVSS Calculator
OpenChain Webinar: Universal CVSS Calculator
 
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine HarmonyLeveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
 
Top Software Development Trends in 2024
Top Software Development Trends in  2024Top Software Development Trends in  2024
Top Software Development Trends in 2024
 
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdfARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
ARM Talk @ Rejekts - Will ARM be the new Mainstream in our Data Centers_.pdf
 
Cybersecurity Challenges with Generative AI - for Good and Bad
Cybersecurity Challenges with Generative AI - for Good and BadCybersecurity Challenges with Generative AI - for Good and Bad
Cybersecurity Challenges with Generative AI - for Good and Bad
 
IA Generativa y Grafos de Neo4j: RAG time
IA Generativa y Grafos de Neo4j: RAG timeIA Generativa y Grafos de Neo4j: RAG time
IA Generativa y Grafos de Neo4j: RAG time
 
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
 
Generative AI for Cybersecurity - EC-Council
Generative AI for Cybersecurity - EC-CouncilGenerative AI for Cybersecurity - EC-Council
Generative AI for Cybersecurity - EC-Council
 
20240330_고급진 코드를 위한 exception 다루기
20240330_고급진 코드를 위한 exception 다루기20240330_고급진 코드를 위한 exception 다루기
20240330_고급진 코드를 위한 exception 다루기
 
Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/ML
Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/MLBig Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/ML
Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/ML
 
JS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AIJS-Experts - Cybersecurity for Generative AI
JS-Experts - Cybersecurity for Generative AI
 

TERR in BI and Real Time applications

  • 1. Deploying R into Business Intelligence and Real-time Applications Lou Bajuk-Yorgan Sr. Dir., Product Management TIBCO Spotfire lbajuk@tibco.com @loubajuk © Copyright 2000-2014 TIBCO Software Inc. 1
  • 2. R in Business Intelligence and Real-time Applications • TIBCO, S+, and embracing R • Challenges of R for Enterprise applications • TIBCO Enterprise Runtime for R (TERR) – Motivation and Benefits • Applications of R/TERR • Learn more and try it yourself - 2
  • 3. Milestones on the Journey to TERR • John Chambers developed the S language at Bell Labs – Starting in the mid 70’s • Insightful (Statsci) founded to commercial S as S+ in 1987 – The “plus”: statistical libraries, documentation, and support – Later focus on commercial users, ease of use, server integration • R: development begun by Ross Ihaka and Robert Gentleman at University of Auckland in mid 90’s • Insightful acquired by TIBCO in 2008 – Spotfire (for Data Discovery and Visualization) acquired in 2007 • Focus on applying Advanced Analytics in Spotfire & TIBCO applications – Step 1: Embrace R - 3
  • 4. Embracing R • Spotfire Statistics Server – Integration of R & S+ into Spotfire applications • Later added SAS® & MATLAB® – Leverage the interactive visualizations, data access and application development of Spotfire • Well received—but our Enterprise customers need more – R provides tremendous benefits to statisticians – But large enterprises are often challenged to leverage that value - 4
  • 5. © Copyright 2000-2013 TIBCO Software Inc. • Core R engine struggles with Big Data & Fast Data (real time) – Customers don’t use R, or reimplement R code in specialized libraries or other languages, or leverage Hadoop, etc. to parallelize R – Lose agility & consistency, delay time to production, lose opportunities • R was not intended for enterprise usage – Not the right tool for real-time, high performance & reliability, big data – Built originally as an academic tool for research and teaching – Proprietary & Specialized packages still dependent on the core engine • Free to acquire, but costly to maintain – Version incompatibilities, variable quality in packages – Lack of enterprise-level technical support Enterprise Challenges for Open Source R 5
  • 6. © Copyright 2000-2013 TIBCO Software Inc. • Enterprise-grade implementation of the R language – Completely new R interpreter, developed from the ground up – Based on TIBCO’s long history and expertise with S+ – Designed to be fully compatible with R language – Faster and more memory efficient than open source R – Fully supported by TIBCO TERR extends the reach of R in the enterprise – Develop code in open source R – Deploy on a commercially-supported and robust platform • Without the delay and cost of rewriting your code TIBCO Enterprise Runtime for R (TERR)
  • 7. © Copyright 2000-2013 TIBCO Software Inc. • Embedded in TIBCO Spotfire – Enhance Business Intelligence and interactive visualizations for everyone in an organization – Works out of the box—no configuration or set up required • Integrated with TIBCO Complex Event Processing – Apply R models in real time, event-driven applications – Advanced Analytics on “Fast Data” • Cloud-based analytics – TIBCO Cloud Compute Grid • Custom applications developed by TIBCO customers and partners Applications of TERR
  • 8. TERR in Spotfire • Powers Predictive Modeling & Forecast Tools • Easily enhance Spotfire analyses and applications with R language scripts • TERR is embedded in Spotfire Analyst/Desktop – No other software required, no connection to server required. Simply works. • Spotfire analyses that use TERR can be deployed to the web
  • 9. Predicting the Business Customer Churn: • Retain your most profitable customers • Increase upsell, decrease churn Fraud Detection: • Reduce losses due to fraudulent transactions Supply Chain Optimization: • Anticipate peaks and lulls • Optimize distribution centers HR Planning: • Predict employee attrition and optimize retention
  • 10. Demo & Case Study
  • 11. © Copyright 2000-2013 TIBCO Software Inc.
  • 12. © Copyright 2000-2013 TIBCO Software Inc.
  • 13. © Copyright 2000-2013 TIBCO Software Inc.
  • 15. © Copyright 2000-2013 TIBCO Software Inc. • Alert Facilities Managers to Severe Weather Alerts • Use TIBCO Streambase to monitor alerts in real time – TERR queries for current weather alerts – Uses sp & rgdal package to compare areas of alerts vs. facility locations • On alert, update Spotfire visualization with mapped alerts, notify Facilities managers Severe Weather Alerts Tracking for Facilities
  • 16. © Copyright 2000-2013 TIBCO Software Inc. • Oil & Gas Extraction – Maintenance Downtime and Equipment failures are costly – Engineers track sensor data to find leading indicators • Temperature, vibration, etc. • Engineers usually use ad hoc rules on leading indicators – R/TERR used to develop predictive models for preventative maintenance – Deployed in real-time systems, alert when maintenance recommended Predictive Maintenance for Oil & Gas
  • 17. © Copyright 2000-2013 TIBCO Software Inc. • Major Logistics Company • Port Congestion Detection – Real time system triggers TERR – Analyzes port congestion – Recommends reduction of speed if no berths available • Maritime Abnormality Detection – Based on Automatic Identification System info, TERR calculates likelihood of deviation from normal sailing routes – Alerts carrier & operator Logistics Optimization
  • 18. TIBCO Cloud Compute Grid • High performance computing on the cloud – Available on TIBCO Cloud Marketplace • Robust DataSynapse GridServer architecture – Used by Wall Street to manage 10K’s nodes – Java, .NET, and REST APIs (JSON) • Perfect for pure computational work – Vastly easier to use for applications like Monte Carlo simulations than Map-Reduce – Run complex statistical models multiple orders of magnitude faster than open source R on a single computer – Unparalleled scalability without upfront capital investment • Easy to get started – Uses your Amazon EC2 account
  • 19. TERR for individual R users • Empower R users – Enterprise platform for the deployment and integration of your work—without having to rewrite it! • TERR Developer Edition – Full version of TERR engine for testing code prior to deployment • Compatible with RStudio & ESS Emacs – Free for non-production use – Supported through Community site – Available at Tap.tibco.com -
  • 20. Summary • TIBCO makes the power of R available across the enterprise – Ad-hoc Predictive Analytics for Data Scientists • Spotfire & TERR – Guided Analytic Applications • Spotfire & Statistics Services predictive ecosystem, starring TERR – Event-driven, real-time analytics • Spotfire Event Analytics, TIBCO CEP & TERR • TERR is R for the Enterprise – Enables customers to develop code in open source R, then deploy their R code on commercially-supported and robust platforms—without recoding, saving time & money – Enables TIBCO, partners & customers products to tightly & efficiently embed R language functionality
  • 21. • TERR Community at TIBCOmmunity.com – Resources, Documentation, FAQs, Forums – More info at spotfire.tibco.com/terr • TERR Developer Edition – Full version of TERR engine for testing code prior to deployment – Supported through TIBCOmmunity, download via tap.tibco.com • Presentations: http://www.slideshare.net/loubajukyorgan/presentations Learn more and Try it yourself