SlideShare uma empresa Scribd logo
1 de 20
Big Data @ Cloud Scale
 Tuesday, June 26, 2012
         SVForum
Silicon Valley Cloud Center
    Chase McMichael CEO
 @chasemcmichael @infinigraph
InfiniGraph solves a problem for marketers
drowning in data by enabling them to identify what's
            relevant to their customers.

We simplify trend identification empowering brands
to create resonating content marketing campaigns.
We’re drinking from the social media fire hose.




Content insight involves a staggering amount of data:
3.2 billion pieces of content are shared each week
 between a billion + consumers.
      How do you make sense of all this data?




               Big Data is Big Opportunity
Large Scale Industry Insights




Who is driving the greatest engagement in your business.
What content is working and why?
How Big?




6
Trend Identification - Hypercuration™




    Example: Real-Time trending content from 25 retail brands in one view. Know
    what your audience is resonating around.

7
Our Biggest Challenges
1. Data Store Scale (I/O &
  Performance)

2. Distributed Data Gathering
  (Drone / Broker Mesh)

3. Changing Landscape of Data
  (Changing API / Changing Data
  "Types" & Sources)

4. Categorization / Taxonomy
  Handling (Dealing with lots of
  disparate data)

        Scale, Scale,                    Scale
Big Data Problems
   Big Solutions



@chasemcmichel @infinigraph
Quick Poll –

Who is doing Big Data
      Projects?
Open to Innovation
“It’s not information overload. It’s
        filter failure.” ― Clay Shirky




@chasemcmichel @infinigraph
Big Data Requires People

People with:
• Deep expertise in statistics

• Machine learning

• Managers

• Analysts who know how to
 operate companies by using
 insights from Big Data,



        Big Data is more than just technology
13
Data Scientist Must Have Four Key Skills

• They can take a data set and
 model it mathematically and

• Understand the math required
 to build those models; they

• Can actually do that, which
 means they have the
 engineering skills…

     Someone who can find insights and tell stories
     from their data. Able to ask the right
     questions, and that is usually the hardest piece.
14
Batch or Real Time




15
Data can be a blessing or a curse

• Need the systems to monitor at
 a whole new level,

• Looking at usage patterns and

• Predicting future trouble before
 the trouble even happens

• Know a server pool needs
 tuning

• Need to provision additional
 services
  The future of monitoring is about automation
  and prevention
Big Data and Real-time
• Big Data is a fact of life and needs to be addressed. Big Process is old wine in new
 bottles. Tightly couple processes and data to stay competitive.




17
Killer Apps Needed
 Business need a killer app
 Let companies
     ‣ analyze,

     ‣ visualize and

     ‣ act on


       All this without hiring a team of Stanford Ph.Ds,
       OR
       Let developers write big-data apps without having to
       reinvent the wheel.
18
Take Away

• What problem are you attempting to
 solve - stop thinking about tech
• Plan collection / storage carefully
• Plan for both batch and real time
• Have a people plan

“The world is one big data problem. There’s a bit of
arrogance in that, and a bit of truth as well.”
–Andrew McAfee
19
Chase McMichael CEO
@chasemcmichael @infinigraph

Mais conteúdo relacionado

Mais de Infini Graph

Visual Hypercuration InfiniGraph Capabilities 2013 The Content Hub
Visual Hypercuration InfiniGraph Capabilities 2013 The Content HubVisual Hypercuration InfiniGraph Capabilities 2013 The Content Hub
Visual Hypercuration InfiniGraph Capabilities 2013 The Content HubInfini Graph
 
When Big Data and Predictive Analytics Collide: Visual Magic Happens
When Big Data and Predictive Analytics Collide: Visual Magic HappensWhen Big Data and Predictive Analytics Collide: Visual Magic Happens
When Big Data and Predictive Analytics Collide: Visual Magic HappensInfini Graph
 
Moneyball of Big Data and Real Time Insights are Changing Everthing
Moneyball of Big Data and Real Time Insights are Changing EverthingMoneyball of Big Data and Real Time Insights are Changing Everthing
Moneyball of Big Data and Real Time Insights are Changing EverthingInfini Graph
 
Great marketing is about great data
Great marketing is about great dataGreat marketing is about great data
Great marketing is about great dataInfini Graph
 
Big Data Intelligence for Exceptional Engagement Performance
Big Data Intelligence for Exceptional Engagement PerformanceBig Data Intelligence for Exceptional Engagement Performance
Big Data Intelligence for Exceptional Engagement PerformanceInfini Graph
 
How Meality achieved 2000% fan growth and 3% CTR increase with Big Data Combi...
How Meality achieved 2000% fan growth and 3% CTR increase with Big Data Combi...How Meality achieved 2000% fan growth and 3% CTR increase with Big Data Combi...
How Meality achieved 2000% fan growth and 3% CTR increase with Big Data Combi...Infini Graph
 
InfiniGraph Capabilities and 2.8 Release
InfiniGraph Capabilities and 2.8 ReleaseInfiniGraph Capabilities and 2.8 Release
InfiniGraph Capabilities and 2.8 ReleaseInfini Graph
 
How TCBY Got 398% More Engagement With Data-Based Content Marketing
How TCBY Got 398% More Engagement With Data-Based Content MarketingHow TCBY Got 398% More Engagement With Data-Based Content Marketing
How TCBY Got 398% More Engagement With Data-Based Content MarketingInfini Graph
 
Great Social Marketing Is About Great Data: The state of content and enga...
Great Social Marketing Is About Great Data:The state of content and enga...Great Social Marketing Is About Great Data:The state of content and enga...
Great Social Marketing Is About Great Data: The state of content and enga...Infini Graph
 
Trend Identification Empowering Brands
Trend Identification Empowering Brands Trend Identification Empowering Brands
Trend Identification Empowering Brands Infini Graph
 
Social Media Monitoring ROI Metrics Forum
Social Media Monitoring  ROI Metrics ForumSocial Media Monitoring  ROI Metrics Forum
Social Media Monitoring ROI Metrics ForumInfini Graph
 
International infinigraph digitalmarketingintelligence_2012
International infinigraph digitalmarketingintelligence_2012International infinigraph digitalmarketingintelligence_2012
International infinigraph digitalmarketingintelligence_2012Infini Graph
 
InfiniGraph Intro 2012
InfiniGraph Intro 2012InfiniGraph Intro 2012
InfiniGraph Intro 2012Infini Graph
 
Emerging Media Conference 2012 - San Francisco
Emerging Media Conference 2012 - San FranciscoEmerging Media Conference 2012 - San Francisco
Emerging Media Conference 2012 - San FranciscoInfini Graph
 
InfiniGraph Capabilities Deck 2012
InfiniGraph Capabilities Deck 2012InfiniGraph Capabilities Deck 2012
InfiniGraph Capabilities Deck 2012Infini Graph
 
Real Time Trends in Ads - Creating Intelligent Social Ads
Real Time Trends in Ads - Creating Intelligent Social Ads Real Time Trends in Ads - Creating Intelligent Social Ads
Real Time Trends in Ads - Creating Intelligent Social Ads Infini Graph
 
Infini graph digitalmarketingintelligence_2011_v1
Infini graph digitalmarketingintelligence_2011_v1Infini graph digitalmarketingintelligence_2011_v1
Infini graph digitalmarketingintelligence_2011_v1Infini Graph
 
Intelligent Trending Content scales Engagement within Social Display Ads
Intelligent Trending Content scales Engagement within Social Display AdsIntelligent Trending Content scales Engagement within Social Display Ads
Intelligent Trending Content scales Engagement within Social Display AdsInfini Graph
 
Optimizing Social Media: Making Real-Time Decisions on Real-Time Data
Optimizing Social Media: Making Real-Time Decisions on Real-Time DataOptimizing Social Media: Making Real-Time Decisions on Real-Time Data
Optimizing Social Media: Making Real-Time Decisions on Real-Time DataInfini Graph
 
Infinigraph NBC presentation SMM11
Infinigraph NBC presentation SMM11Infinigraph NBC presentation SMM11
Infinigraph NBC presentation SMM11Infini Graph
 

Mais de Infini Graph (20)

Visual Hypercuration InfiniGraph Capabilities 2013 The Content Hub
Visual Hypercuration InfiniGraph Capabilities 2013 The Content HubVisual Hypercuration InfiniGraph Capabilities 2013 The Content Hub
Visual Hypercuration InfiniGraph Capabilities 2013 The Content Hub
 
When Big Data and Predictive Analytics Collide: Visual Magic Happens
When Big Data and Predictive Analytics Collide: Visual Magic HappensWhen Big Data and Predictive Analytics Collide: Visual Magic Happens
When Big Data and Predictive Analytics Collide: Visual Magic Happens
 
Moneyball of Big Data and Real Time Insights are Changing Everthing
Moneyball of Big Data and Real Time Insights are Changing EverthingMoneyball of Big Data and Real Time Insights are Changing Everthing
Moneyball of Big Data and Real Time Insights are Changing Everthing
 
Great marketing is about great data
Great marketing is about great dataGreat marketing is about great data
Great marketing is about great data
 
Big Data Intelligence for Exceptional Engagement Performance
Big Data Intelligence for Exceptional Engagement PerformanceBig Data Intelligence for Exceptional Engagement Performance
Big Data Intelligence for Exceptional Engagement Performance
 
How Meality achieved 2000% fan growth and 3% CTR increase with Big Data Combi...
How Meality achieved 2000% fan growth and 3% CTR increase with Big Data Combi...How Meality achieved 2000% fan growth and 3% CTR increase with Big Data Combi...
How Meality achieved 2000% fan growth and 3% CTR increase with Big Data Combi...
 
InfiniGraph Capabilities and 2.8 Release
InfiniGraph Capabilities and 2.8 ReleaseInfiniGraph Capabilities and 2.8 Release
InfiniGraph Capabilities and 2.8 Release
 
How TCBY Got 398% More Engagement With Data-Based Content Marketing
How TCBY Got 398% More Engagement With Data-Based Content MarketingHow TCBY Got 398% More Engagement With Data-Based Content Marketing
How TCBY Got 398% More Engagement With Data-Based Content Marketing
 
Great Social Marketing Is About Great Data: The state of content and enga...
Great Social Marketing Is About Great Data:The state of content and enga...Great Social Marketing Is About Great Data:The state of content and enga...
Great Social Marketing Is About Great Data: The state of content and enga...
 
Trend Identification Empowering Brands
Trend Identification Empowering Brands Trend Identification Empowering Brands
Trend Identification Empowering Brands
 
Social Media Monitoring ROI Metrics Forum
Social Media Monitoring  ROI Metrics ForumSocial Media Monitoring  ROI Metrics Forum
Social Media Monitoring ROI Metrics Forum
 
International infinigraph digitalmarketingintelligence_2012
International infinigraph digitalmarketingintelligence_2012International infinigraph digitalmarketingintelligence_2012
International infinigraph digitalmarketingintelligence_2012
 
InfiniGraph Intro 2012
InfiniGraph Intro 2012InfiniGraph Intro 2012
InfiniGraph Intro 2012
 
Emerging Media Conference 2012 - San Francisco
Emerging Media Conference 2012 - San FranciscoEmerging Media Conference 2012 - San Francisco
Emerging Media Conference 2012 - San Francisco
 
InfiniGraph Capabilities Deck 2012
InfiniGraph Capabilities Deck 2012InfiniGraph Capabilities Deck 2012
InfiniGraph Capabilities Deck 2012
 
Real Time Trends in Ads - Creating Intelligent Social Ads
Real Time Trends in Ads - Creating Intelligent Social Ads Real Time Trends in Ads - Creating Intelligent Social Ads
Real Time Trends in Ads - Creating Intelligent Social Ads
 
Infini graph digitalmarketingintelligence_2011_v1
Infini graph digitalmarketingintelligence_2011_v1Infini graph digitalmarketingintelligence_2011_v1
Infini graph digitalmarketingintelligence_2011_v1
 
Intelligent Trending Content scales Engagement within Social Display Ads
Intelligent Trending Content scales Engagement within Social Display AdsIntelligent Trending Content scales Engagement within Social Display Ads
Intelligent Trending Content scales Engagement within Social Display Ads
 
Optimizing Social Media: Making Real-Time Decisions on Real-Time Data
Optimizing Social Media: Making Real-Time Decisions on Real-Time DataOptimizing Social Media: Making Real-Time Decisions on Real-Time Data
Optimizing Social Media: Making Real-Time Decisions on Real-Time Data
 
Infinigraph NBC presentation SMM11
Infinigraph NBC presentation SMM11Infinigraph NBC presentation SMM11
Infinigraph NBC presentation SMM11
 

Último

"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfSeasiaInfotech2
 
Vector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesVector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesZilliz
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfRankYa
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 

Último (20)

"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdf
 
Vector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesVector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector Databases
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 

Big Data @ Cloud Scale

  • 1. Big Data @ Cloud Scale Tuesday, June 26, 2012 SVForum Silicon Valley Cloud Center Chase McMichael CEO @chasemcmichael @infinigraph
  • 2.
  • 3. InfiniGraph solves a problem for marketers drowning in data by enabling them to identify what's relevant to their customers. We simplify trend identification empowering brands to create resonating content marketing campaigns.
  • 4. We’re drinking from the social media fire hose. Content insight involves a staggering amount of data: 3.2 billion pieces of content are shared each week between a billion + consumers. How do you make sense of all this data? Big Data is Big Opportunity
  • 5. Large Scale Industry Insights Who is driving the greatest engagement in your business. What content is working and why?
  • 7. Trend Identification - Hypercuration™ Example: Real-Time trending content from 25 retail brands in one view. Know what your audience is resonating around. 7
  • 8. Our Biggest Challenges 1. Data Store Scale (I/O & Performance) 2. Distributed Data Gathering (Drone / Broker Mesh) 3. Changing Landscape of Data (Changing API / Changing Data "Types" & Sources) 4. Categorization / Taxonomy Handling (Dealing with lots of disparate data) Scale, Scale, Scale
  • 9. Big Data Problems Big Solutions @chasemcmichel @infinigraph
  • 10. Quick Poll – Who is doing Big Data Projects?
  • 12. “It’s not information overload. It’s filter failure.” ― Clay Shirky @chasemcmichel @infinigraph
  • 13. Big Data Requires People People with: • Deep expertise in statistics • Machine learning • Managers • Analysts who know how to operate companies by using insights from Big Data, Big Data is more than just technology 13
  • 14. Data Scientist Must Have Four Key Skills • They can take a data set and model it mathematically and • Understand the math required to build those models; they • Can actually do that, which means they have the engineering skills… Someone who can find insights and tell stories from their data. Able to ask the right questions, and that is usually the hardest piece. 14
  • 15. Batch or Real Time 15
  • 16. Data can be a blessing or a curse • Need the systems to monitor at a whole new level, • Looking at usage patterns and • Predicting future trouble before the trouble even happens • Know a server pool needs tuning • Need to provision additional services The future of monitoring is about automation and prevention
  • 17. Big Data and Real-time • Big Data is a fact of life and needs to be addressed. Big Process is old wine in new bottles. Tightly couple processes and data to stay competitive. 17
  • 18. Killer Apps Needed Business need a killer app Let companies ‣ analyze, ‣ visualize and ‣ act on All this without hiring a team of Stanford Ph.Ds, OR Let developers write big-data apps without having to reinvent the wheel. 18
  • 19. Take Away • What problem are you attempting to solve - stop thinking about tech • Plan collection / storage carefully • Plan for both batch and real time • Have a people plan “The world is one big data problem. There’s a bit of arrogance in that, and a bit of truth as well.” –Andrew McAfee 19

Notas do Editor

  1. 1. Twitter and Facebook and they are doing many ads in digital - What’s important to them- Sustainable on going transaction with the