BI landscape is changing drastically. Cloud, BIGDATA, Social Data and opensource are helping the democratization process that is required to fulfill the business gap between technology and today\'s business needs. As proof point, the results of several consulting engagements will be used as examples to support this assertion and to explain why QMining was created.
QMining builds software for the fragmented online marketing field. QMining has developed a Marketing Management Platform to help businesses measure and optimize the ROI of their online investments. In order to do so, we will present how we are leveraging amazon web services, BIGDATA frameworks, Python language, open-source and Social Data to give business insides to our customers.
We will also present the architecture of the QMining platform, the data used, and how the data is processed.
The presentation will conclude with some customer stories and real-life cases.
http://salonbi.com/en/content/how-we-leverage-cloud-bigdata-social-data-do-bi-qmining
How we Leverage Cloud, Big Data, Social Data at QMining (Salon BI nov 6 2012)
1. How we leverage the cloud, big-
data, social data to do BI?
Salon BI 6 November 2012
francis@qmining.com
Founder & CEO
2. Hidden Agenda
● Story
● QMining
● BI landscape - Issues
● How QMining is leveraging:
○ Open source
○ Cloud
○ Hadoop for Big data
○ Social data
● Innovation
○ QMiner
○ QMarketing
9. Examples
Context Enterprise QMining
Big Player (content) 18 mois = failure 3 months = success
online marketing 180+ days = not 11 days = success
done
online KPI 30+ days 2 days (bots)
investigations
IBM SPSS 15 days 1 day
... ...
15. All abstractions leak
Abstract -> Procrastinate!
http://www.aleax.it/pycon_abst.pdf (Alex Martelli : "Abstraction as a Leverage" )
16. Minimize A Tower of Abstraction
Simplify & lower the layer of abstraction
Examples:
● Work on file not BD if possible
● Low level linux command lines (cut, grep, sed etc.)
● High level languages : python
● Minimize # of languages; ex: Hadoop streaming
(map/reduce=python)
● Prototype on a laptop (atom N450)
18. Cloud - PaaS vs IaaS
Pros ● framework ● less limits
● deployment ● Scaling
● multi-tenant ● Pricing
● https
● log & data
visualisation
General Score
+20 -20
Recommendations:
Protot Productio
ype n
The best of both world might be heroku a Cloud application platform but we haven't tried it
montreal python slides on a comparison (appengine vs amazon, pris & cons for a startup)
19. QMining in Cloud
Principles:
● Easy deployment of environments
● Scalable by design
● Multi-tenant by design (don't manage multiple versions/instances)
● REST API by design
20. the power of matlab for prod
What How
power
of
PaaS
(Platform as a Service)
Web framework
example coradiant : 100X speedup
21. Big Data
Leverage cloud to process lot of data (hadoop)
We use amazon EMR (hadoop, EC2 & S3)
23. Why enterprises fail at
innovation? (blog)
1. Salon BI 2011: Philippe Nieuwbourg M&A
2. Boston CXO Forum 24 October : Best Practice on Global
Innovation (IBM, EMC, P&G, Intuit) Exploit vs Explore
3. Brad Feld (Managing Director at Foundry Group)
Startup community 29 October Notman house MTL
Hierarchy vs network
24. QMiner
1. Simplify real user management
2. Simplify business view management
3. Simplify Persona management
25. QMiner
Simplify real user management
10% of your online users are experiencing
slowness
● 100% are located in China
● 75% are using mobile device
● 90% are using iphone
http://qmining.qminer.com
26. QMiner & Social Graph
Leverage the social graph apis
Facebook Social Graph:
http://developers.facebook.com/docs/reference/api/
QMiner Example:
http://fr.qmining.com/facebook/
27. QMiner
Simplify business view management
Your are losing $10K/hour:
● 100% are Male
● 75% are using mobile device
● 90% are using iphone
http://qmining.qminer.com/api/clients/qmining/apps/fbtest/ruleset/
28. QMiner
Simplify persona management
None buying customers are:
93% male
67% single
87% high educated
Persona fit = 25%
35. Summary
● Story
● QMining
● BI landscape - Issues (not simple, slow, costly)
● How QMining is leveraging:
○ Open source with linux, python, github
○ Cloud with amazon, google appengine
○ Big data with hadoop
○ Social data with facebook api
● Innovation
○ QMiner Simplify real user, business view & persona management
○ QMarketing simplify online marketing management