More Related Content Similar to Pentaho Analytics for MongoDB - presentation from MongoDB World 2014 (20) Pentaho Analytics for MongoDB - presentation from MongoDB World 20141. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75551
Bo Borland
VP, Field Technical Sales
Blending disparate data into a single MongoDB view for analytics
Pentaho Analytics for
MongoDB
2. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75552
3. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75553
Tesla Motors Inc
$34/per share
$229/per share
January 2013 thru June 20, 2014
4. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75554
Tesla Motors Inc
Current month stock performance
Tesla announces it will share all patents in spirt of open source movement
Source: http://www.teslamotors.com/blog/all-our-patent-are-belong-you
June 12th -
Open Source
Announcement
1. Attract and motivate the world’s most talented engineers
2. Collaborate with auto-makers on a common, rapidly evolving technology platform (the
charging station network)
3. Accelerate the creation and advancement of electronic vehicles (sustainable
transport) to address carbon crises
10% increase
5. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75555
Tesla Motors Inc
Mixed reaction to open source news
June 12th -
Open Source
Announcement
June 12, 2014 - Tesla Motors Inc. to Give Away Patents -- Good or Bad for Investors?
June 15, 2014 - Electric car groups eye collaboration over charging technology
6. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75556
Supercharger Charging Stations
Open Now & By 2015
June 16, 2014 - Tesla Motors, Inc. Stock Jumps on News of Possible Charging Collaboration
“Tesla stock is up about 3% this morning (at the time of this writing) after Financial Times author
Henry Foy reported that Tesla, Nissan, and BMW, the world's three largest manufacturers of electric
vehicles, are in "keen talks" regarding a new level of collaboration on charging networks, according
to sources at all three companies.”
7. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75557
Market-Moving Insights
Blending sources that can influence stocks and financial markets
Twitter Sentiment issued by
corporations, executives, government
officials, economist, commentators,
media outlets.
High-quality news from various news
organizations and industry bloggers
Intra-day buy/sell stock quote data
8. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75558
• Web service api call for live intraday equity quote data
• Level 1, tick-by-tick quote data for given stock and date range
• Enrich the data and load to MongoDB
• Relevant fields:
• Date
• Time
• Bid Price
• Offer Price
• Bid Qty
• Offer Qty
Intraday Equity Quotes
9. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75559
• Live Twitter API search query for Telsa Motor stock
• Unstructured search result is parsed
• Enriched with Pentaho predictive analytics model to derive
sentiment score
• Enriched dataset loaded to MongoDB
• Relevant fields:
• User
• Tweet text
• Retweet count
• Followers
• Search term
• Sentiment index
Twitter Sentiment Data
+1 (Positive)
0 (Neutral)
-1 (Negative)
Advanced
Analytics
Data Science Pack: Pentaho 5.1
capability with a text classification
predictive model to score each
tweet and load the tweets and
scores into MongoDB.
10. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755510
Market-Moving Insights
• Intra-day buy/sell stock quote data
provided by a web service
• Real time Twitter data
provided by Twitter API
• Pentaho Data Integration to blend
disparate data sources
• Pentaho Predictive Analytics to enrich
data with twitter sentiment score
Single MongoDB view with
Pentaho Analysis to make stock
investment decisions
11. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755511
Analyzer for MongoDB
Released Today as part of Pentaho 5.1 Release
Analyze and visualize MongoDB data thru a drag-n-drop
interface.
• Native OLAP analysis on real-time data in MongoDB
• Easy to use, award-winning OLAP interface for
building visualizations that can be added to
dashboards
• Native integration with MongoDB leveraging the
power of the MongoDB query language and
aggregation framework.
Analyze blended June data to make an investment
decision on Tesla Motors?
12. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755512
Analyzer Demonstration
13. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755513
Market-Moving Insights
Blending sources that can influence stocks and financial markets
Twitter Sentiment issued by
corporations, executives, government
officials, economist, commentators,
media outlets.
High-quality news from various news
organizations and industry bloggers
Intra-day buy/sell stock quote data
Blend
Enrich
Predict
Load
Query
Aggregate
Notify
Inform
14. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755514
mongoDB
clusterPDI ETL
Analytics
Broad Connectivity
Broad connectivity combined with powerful data integration
15. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755515
Concept – Data Transformations
INPUT(S) – PROCESS(ES) – OUTPUT(S)
16. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755516
Data Integration Demonstration
17. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755517
Pentaho Visual Development
Eliminates the Need for Complex Coding
Would you rather do this?
Scheduling
Modeling
Ingestion / Manipulation / Integration
… or this?
18. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755518
Equity Data Ingestion
INPUT(S) – PROCESS(ES) – OUTPUT(S)
19. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755519
Twitter API Data Ingestion
INPUT(S) – PROCESS(ES) – OUTPUT(S)
20. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755520
Pentaho Job Automates Data Load Sequence
START – CHECK – WATCH – EXECUTE – NOTIFY - FINISH
21. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755521
Equity Quotes Schema
Eliminates the need for table joins
RDBMS Star Schema
(6-9 tables)
Mongo Hierarchy Schema
(1 collection)
quotes
tweets
company
dimension
date
dimension
time
dimension
tweet
dimension
record
type
dmension
22. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755522
Entity 360 – NoSQL Architecture
A Blended View to Drive Revenue Growth and Service Improvements
MongoDB
CRM System
Claims
Admin. Info
PDI
Online
Transactions
Documents &
Images
PDI
Advanced
Analytics
Business
Analysis
Analyzer for
MongoDB
Data
Science
Pack
Aggregation
Framework
Data
Science
Pack
23. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755523 © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755523
OPERATIONAL DATA BIG DATA DATA STREAMPUBLIC/PRIVATE CLOUDS
DBA/ETL/BI DEVELOPER BUSINESS USER BUSINESS/DATAANALYST
Data Integration
+ Analytics +
Predictive
Extensive
community of
developers
Pluggable,
extensible, java
architecture
Single, Open Platform for Analytics
24. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755524
Pentaho Analytics for MongoDB
25. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755525
Learn more: http://www.pentaho.com/analytics-for-
mongodb
Watch demo:
http://www.pentaho.com/resource/analyzer-on-
mongodb-video
Download: http://www.pentaho.com/testdrive
Resources & Links of Interest
26. © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755526
Bo Borland
VP, Field Technical Sales
bo.borland@pentaho.com
Thank You
Editor's Notes Demo of building a transformation to load CSV equity quote data to MongoDB