Platfora - An Analytics Sandbox In A World Of Big Data

©2014 DesignMind. All Rights Reserved.
An Analytics Sandbox
in a World of Big Data
Roberto Arnetoli
roberto@designmind.com
Vice President,Big DataSolutions
Andrew Eichenbaum
andrew@designmind.com
Principal DataScience Consultant
Platfora

2
DesignMind’s Expertise and Offering
Power BI
Applications
Databases
Data Warehousing
Big Data
BI & Data Visualization
Information Sharing
& CollaborationCloud Computing
Data Science

3
Our Clients

4
Agenda
 Big Data and Self-Service Analytics
 Platfora
 Case Study: Peer-2-Peer Lending
 Demo
 Conclusion and Questions

5
Big Data and Self-Service Analytics

6
What is Big Data?
 Largedata sets
 excessive
retrievaland processing
time

structured and
unstructured collections
BIG DATA

7

volume
velocity
variety
Volum
e
Velocity
Variety
SQL
BIG DATA
SQL vs. Big Data

8
We tend to structure data

we tend to prepare,
transform and structuredata
 severaladvantages
-
-
-
-
 severalnon-trivial
disadvantages
-
-
-
Traditional
DataWarehouse
Big Data
Platform

9
For today’s Data Scientistsit issimply not enough!
mailfeeds
additional
databases
multimedia
logs social
geo
e-commerce
unstructured
text
web
Traditional
DataWarehouse
Big Data
Platform

10
mailfeeds
additional
databases
ia
social
web
Traditional
DataWarehouse
Big Data
Platform
For today’s Data Scientistsit issimply not enough!
 self-serviceanalyticsplatform
 ‘analyticssandbox’

significantly
reduce timeand costs

11
DesignMind chooses Platfora
 Microsoft Gold Data
PlatformPartnerand SilverBI
Partner
ClouderaPartner
PlatforaPartner

data
analyticswinning solution
maximize
thevalueof their data
makefact-based decisions
Big Data
Platform
Traditional
Data Warehouse
Self-Service
Analytics

12
Platfora

13
Platfora is an All in One Data Sandbox
Ingest
Select
Explore

14
Platfora Easily Ingests Data

Delimited Text XML JSON Raw Text Avro


15
Platfora MeansHands Off ETL



lenses

16
Platfora MeansHands Off ETL
 Platfora ETLprocessbacked by Hadoop
- Automaticcluster creation on multiple
platforms(Amazon,Cloudera,
Hortonworks)
- Cluster sizesfrom one node to many
 Automaticallyhandlesthe handoff of
multiple filesof any size to the cluster
 Scheduling available for data
reprocessing or updates

17
Platfora Allows for Easy Data Exploration


18
Typical Big Data Warehousing Stack
 complexlinear process
Data warehouse accesstools
have no easy way to accessthe
data from earlier stages
Only way to get new data in is
to reprocess the data at the
Ingestion and Transformation
levels
Ingest Select Explore
Transformation
I
n
g
e
t
s
i
o
n

19
Big Data Warehousing Tools
Pig
 Transformation
 Each step can be complexand need a
knowledgeablesupport staff
 Ingestion
 BI Tools  data warehousing

20
Platfora Sits Parallel to the Traditional Stack

Ingest Select Explore
Data Catalog VizboardsLenses
Transformation
I
n
g
e
t
s
i
o
n

21
Case Study: Peer-2-Peer Lending

22
What is P2P Lending




23

-
-
-

-
-
-

24
Completed Loans: Months to Last Payment
 Loans can complete in two ways: Charge Off
(Default) and Fully Paid
 Normal loan durations are 36 and 60 months.
 Early payoff and
Charge Offs follow the
same curve after two
months of payments.
 Loan Charge Off rate
is approximately 16%
for loans completed in
the first the first 18
months.

25
Loan Stats: Average Revolving to Maximum Credit
 When loans are in funding, can we find predictors of default?
 We look at loan applicants total revolving credit (e.g. credit
cards) vs the average revolving credit balance

26
Loan Stats: Average Revolving to Maximum Credit

27
Demo

28
Demo Notes

-
-

-
-



29
Conclusion

30

31
 Concluding Remarks
 Quick Introduction to Platfora and its abilities
- It is a data analytics sandbox that is complimentary
to current ETL/Warehouse implementations
- Allows data practitioners free range to access and
use new data easily
 Platfora can do a lot more than shown
 Platfora is extensible:
- UDFs allow access to almost any Java routine
- Data ingestion can be scheduled

32
Questions

33
www.designmind.com

Platfora - An Analytics Sandbox In A World Of Big Data

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Semelhante a Platfora - An Analytics Sandbox In A World Of Big Data

Semelhante a Platfora - An Analytics Sandbox In A World Of Big Data (20)

Mais de Mark Ginnebaugh

Mais de Mark Ginnebaugh (20)

Último

Último (20)

Platfora - An Analytics Sandbox In A World Of Big Data