SlideShare uma empresa Scribd logo
1 de 29
Big Data in the Data Center
Jean-Pierre Dijcks
Big Data Product Mangement




1   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Agenda


         Architecting Big Data
         Building Big Data Solutions
         Oracle Big Data Appliance




2   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Architecting Big Data




3   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
What Does a Big Data World Look Like?
        Truck / Motor Manufacturer
    What they collect
    Monitors the complete car
    Miles Per Gallon, Driving techniques
    Location information

    How they use it
    Better tailored servicing plans
    Better targeted marketing
    Offer better finance deals or related options
    More data for R&D
    Sell on to partners

    Big Data means…
    The ability to predict when components might fail
    Create better service plans based on actual usage
    Drivers can post their data to manufacturers website
    Black box data can help with accidents


4   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
What Does a Big Data World Look Like?
         Retailer / White Goods
What they collect
Food monitoring by RFID tags –
Fridge monitors food usage and sell-
by dates

How they use it
Automated food ordering
Better targeted marketing due to better data about
how/when customer uses products


Big Data means…
    More detailed information about customers
    Better store based demand planning



5    Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Sample of Big Data Use Cases Today

    AUTOMOTIVE
    Auto sensors
                                                  What is the main difference in this data?
                                                  COMMUNICATIONS
                                                  Location-based
                                                                 Retail / CPG
                                                                 Sentiment analysis
                                                                                    FINANCIAL
                                                                                    SERVICES
                                                                                                                                EDUCATION &
                                                                                                                                RESEARCH
    reporting                                       advertising             Hot products            Risk & portfolio analysis   Experiment
    location,                                                                                       New products                sensor analysis
                                                                            Optimized Marketing
    problems


HIGH TECHNOLOGY /
                                                    Volume, Velocity, Variety
                                                          LIFE              MEDIA/
                                                                                                     ON-LINE
                                                                                                     SERVICES /                 HEALTH CARE
INDUSTRIAL MFG.                                           SCIENCES          ENTERTAINMENT            SOCIAL                     Patient sensors,
Mfg quality                                               Clinical trials   Viewers / advertising    MEDIA                      monitoring, EHRs
Warranty analysis                                         Genomics          effectiveness            People & career            Quality of care
                                                                            Cross Sell               matching
                                                                                                     Web-site
                                                                                                     optimization
    OIL & GAS                                          These Characteristics Challenge your
                                                        Games           TRAVEL &
                                                                        TRANSPORTATION        UTILITIES
                                                                                                                                 LAW
                                                                                                                                 ENFORCEMENT
    Drilling                                            Adjust to
    exploration
    sensor analysis
                                                        player
                                                        behavior
                                                                  Existing Architecture Meter
                                                                        Sensor analysis for
                                                                        optimal traffic flows
                                                                                              Smart
                                                                                              analysis for
                                                                                                                                 & DEFENSE
                                                                                                                                 Threat analysis -
                                                                                                      network                    social media
                                                         In-Game Ads        Customer sentiment        capacity,                  monitoring, photo
                                                                                                                                 analysis




6    Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Building your big data architecture

          Gradually Extending your Existing Architecture for Big Data:
           Step 1: Further Analyze Current Data
           Step 2: Architect for Data Variety and Volume
           Step 3: Architect for Data Velocity
           Step 4: Discover New Patterns



             Increase                                                      Business Value

7   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Step 0: Data Warehouse Foundation


                                                                                                                 • Dashboard
                      High                                                  Oracle                               • Ad-Hoc Query
                      Density
                      Data                                                 Database
                                                                                                Oracle BI
                                                                                                Enterprise
                                                                                                 Edition




             Acquire                                    Organize                      Analyze           Decide

8   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Step 1: Deep Analysis of Current Data


                                                                                                                   • Dashboard
                      High                                                  Oracle                                 • Ad-Hoc Query
                      Density
                      Data                                                 Database
                                                                                                  Oracle BI        • Churn
                                                                                                  Enterprise       • Locality
                                                                                                   Edition
                                                                                   Spatial
                                                                                  and Graph
                                                                                  Advanced
                                                                                  Analytics



             Acquire                                    Organize                        Analyze           Decide

9   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Step 2: Architect for Volume and Variety


                                                                                                                    • Dashboard
                       High                                                  Oracle                                 • Ad-Hoc Query
                       Density                                              Database
                       Data
                                                                                                   Oracle BI        • Churn
                                                                                                   Enterprise       • Locality
 Low
 Density                                                                                            Edition
                                                                                    Spatial                         • Relationship
 variable
 Data                                                                              and Graph                        • Comments
                                            Hadoop
                                                                                   Advanced
                                                    Aggregate                      Analytics
                                                   Pre-Analyze



              Acquire                                    Organize                        Analyze           Decide

10   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Step 3: Architect for Velocity

                            High                                              Oracle
                           Density
                            Data                                             Database
                                                                                                                             • Dashboard
                                                                                                             Oracle BI       • Ad-Hoc Query
                                                Hadoop                                                       Enterprise
        Low                                                                                                   Edition
      Density                                                                     Spatial and                                • Churn
     Batch Data                                                                     Graph                                    • Locality
                                                   Aggregate
                                                                                   Advanced
                                                  Pre-Analyze
                                                                                   Analytics         Model                   • Relationship
                                                                                                                             • Comments
Streaming                                      Event                                                          Real Time
   Data                                      Processing                                                       Decisions
                                                                                                                             • Recommend
                                                                                                                             • Act
                                                                                            Act

               Acquire                                    Organize                         Analyze                  Decide

11    Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Step 4: Discover New Information
                                                                                                               Endeca Information Discovery

                              High                                              Oracle
                             Density
                              Data                                             Database
                                                                                                                                     • Dashboard
                                                                                                               Oracle BI             • Ad-Hoc Query
                                                  Hadoop                                                       Enterprise
          Low                                                                                                   Edition
        Density                                                                     Spatial and                                      • Churn
       Batch Data                                                                     Graph                                          • Locality
                                                     Aggregate
                                                                                     Advanced
                                                    Pre-Analyze
                                                                                     Analytics         Model                          • Relationship
                                                                                                                                      • Comments
Streaming                                        Event                                                          Real Time
   Data                                        Processing                                                       Decisions
                                                                                                                                      • Recommend
                                                                                                                                      • Act
                                                                                              Act

                                                            Organize                         Analyze                  Decide          • Discover
                 Acquire

  12    Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Oracle Engineered Systems

         Simplify IT – Simplify Big Data                                                                              • Dashboard
                                                                                                                                       
                                                                                                                      • Ad-Hoc Query
                           Oracle
                          Big Data
                          Appliance
                                                                            Oracle
                                                                            Exadata                   Oracle
                                                                                                                      • Churn
                                                                                                                      • Locality       
                                                                                                                                       
                                                                                                     Exalytics
                                                                                                                      • Relationship
                                                                                                                      • Comments
                                                               InfiniBand               InfiniBand

                                                                                                                      • Recommend
                                                                                                                      • Act            
                                                                                                                      • Discover
                                                                                                                                       
              Acquire                                    Organize                     Analyze                Decide

13   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Building Big Data Solutions




14   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Building a Big Data Solution
         Customer Retention and Social Media

           Apply classic churn models to the Data Warehouse data
           Add Social Data (Twitter) and Relationships (Facebook)
           Analyze Social Data and Relationships
           Deploy New Retention Policy into the Data Stream




              Increase                                                      Business Value

15   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Predict Customer Churn


                                                                            Churn
Find at-risk customers

Predictive models

Widely used




16   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Oracle Advanced Analytics
           Oracle Data Mining



12 Algorithms                                                                             Build
                                                                            Usage
Extreme performance                                                          Data        Deploy
                                                                                                     Customer A: 0.49
                                                                                                     Customer B: 0.25
                                                                                          Score
GUI for Data Scientists



                                                                             Acquire   Organize   Analyze         Decide



17   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Understand Your Customers


                                                                            Churn   Social
Find interesting data sets                                                          Data

Process the data to
represent meaningful
actions

Uncover new relationships
                                                                                    New
                                                                                    Facts


18   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Oracle Big Data Appliance
         Big Data Acquisition and Organization


                                                                             Twitter
                                                                              Data
Pre-integrated cluster                                                                        Collect
                                                                                                          Customer A:
                                                                            Facebook                      Customer B:
Sun Oracle hardware                                                                          Sessionize
                                                                              Data
Cloudera CDH                                                                                 Aggregate

Massive scale                                                                Internal
                                                                            Log Data

                                                                                   Acquire     Organize



19   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Oracle Big Data Connectors



                                                                                                     Customer A:
High performance                                                            Customer A:              Customer B:
                                                                            Customer B:
Secure
                                                                                                       Cust A: 0.49
Efficient                                                                                              Cust B: 0.25




                                                                            Acquire       Organize



20   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Oracle Advanced Analytics
         Oracle R Enterprise




Open source compatible                                                                                          Model
                                                                              Customer A:                                        D    0.10
                                                                              Customer B:                         0.25
Scales to huge data sets
                                                                                                 R                         B
                                                                                                                                     0.79
Extreme performance                                                                                      0.49
                                                                                Cust A: 0.49                      A              C
                                                                                Cust B: 0.25
Widely used


                                                                            Organize           Analyze                  Decide



21   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Real-Time Retention Decisions


                                                                            Churn    Social
                                                                                     Data
React to real-time events

Influence key customers

Adjust in real-time
                                                                            New      New
                                                                            Policy   Facts


22   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Oracle RTD and Oracle NoSQL Database


                                                                                                         Enrich
                                                                                                                        Decisions


Self learning                                                                       Tweet           Events                     Model       D
                                                                                                                                       B
Fast profile lookups
                                                                                                                               A           C
Integrated                                                                                Instant
                                                                                       Communication
                                                                            Tweet           Offer               Ideas


                                                                                                             Analyze            Decide



23   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Oracle Big Data Appliance




24   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Oracle Big Data Appliance


Get up and Running
Quickly

Improve Performance of
Hadoop

Integrated with Exadata

Lower TCO for Big Data




25   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Price comparison

Oracle Big Data Appliance                                       “Build-Your-Own” – HP hardware and Cloudera
                Year 1     Year 2    Year 3      Total                            Year 1       Year 2     Year 3    Total


                                                                 Servers and
 BDA Cost       $450,000                                                           $428,220
                                                                 switches


 Support
                 $54,000   $54,000     $54,000                   Support Cost      $136,233     $72,000   $72,000
 Cost

 On-site                                                         Installation &
 Installation    $14,150                                         configuration
                                                                 not included

 Total          $518,150   $54,000     $54,000    $626,150       Total             $564,453     $72,000   $72,000    $708,453


Full details at https://blogs.oracle.com/datawarehousing/entry/price_comparison_for_big_data
Big Data Appliance performance comparisons
     6x faster than custom 20-node Hadoop                                   2.5x faster than 30-node Hadoop cluster
     cluster for large batch transformation jobs                            for tagging and parsing text documents



                      10                                                                      10




                                                                               Time (hours)
       Time (hours)




                      5                                                                        5




                      0                                                                        0
                              Big Data                        DIY Hadoop                           Big Data    Cloud-based
                              Appliance                         Cluster                            Appliance     Hadoop


27   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
28   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
29   Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

Mais conteúdo relacionado

Semelhante a 2012 09 Oracle bigdata_architecture

BI Forum 2012 - Integrované systémy
BI Forum 2012 - Integrované systémyBI Forum 2012 - Integrované systémy
BI Forum 2012 - Integrované systémy
OKsystem
 
Big dataforcf os1_23_12_final
Big dataforcf os1_23_12_finalBig dataforcf os1_23_12_final
Big dataforcf os1_23_12_final
BurrPilgerMayer
 
Asian Bankers Association, Manila Conference
Asian Bankers Association, Manila ConferenceAsian Bankers Association, Manila Conference
Asian Bankers Association, Manila Conference
Deepak Ramanathan
 
Commerical Advantage Services Brochure
Commerical Advantage Services BrochureCommerical Advantage Services Brochure
Commerical Advantage Services Brochure
AlexHewitt
 
Annik research analytics deck pvd
Annik research analytics deck   pvdAnnik research analytics deck   pvd
Annik research analytics deck pvd
Atul Sharma
 

Semelhante a 2012 09 Oracle bigdata_architecture (20)

BI Forum 2012 - Integrované systémy
BI Forum 2012 - Integrované systémyBI Forum 2012 - Integrované systémy
BI Forum 2012 - Integrované systémy
 
Admonsters OPS Mobile Keynote Presentation
Admonsters OPS Mobile Keynote PresentationAdmonsters OPS Mobile Keynote Presentation
Admonsters OPS Mobile Keynote Presentation
 
DataSift Update - May 3rd 2011 - Devnest
DataSift Update - May 3rd 2011 - DevnestDataSift Update - May 3rd 2011 - Devnest
DataSift Update - May 3rd 2011 - Devnest
 
GRS Market Research
GRS Market ResearchGRS Market Research
GRS Market Research
 
SOA and Cloud in Life Sciences
SOA and Cloud in Life SciencesSOA and Cloud in Life Sciences
SOA and Cloud in Life Sciences
 
Twitter and Mediasift Partnership
Twitter and Mediasift PartnershipTwitter and Mediasift Partnership
Twitter and Mediasift Partnership
 
Cloudera Sessions - Cloudera Keynote: A Blueprint for Data Management
Cloudera Sessions - Cloudera Keynote: A Blueprint for Data ManagementCloudera Sessions - Cloudera Keynote: A Blueprint for Data Management
Cloudera Sessions - Cloudera Keynote: A Blueprint for Data Management
 
SAS Customer Analytics for Insurance
SAS Customer Analytics for InsuranceSAS Customer Analytics for Insurance
SAS Customer Analytics for Insurance
 
Big dataforcf os1_23_12_final
Big dataforcf os1_23_12_finalBig dataforcf os1_23_12_final
Big dataforcf os1_23_12_final
 
IASA 2010 - Enhancing the Agent Experience
IASA 2010 - Enhancing the Agent ExperienceIASA 2010 - Enhancing the Agent Experience
IASA 2010 - Enhancing the Agent Experience
 
EDF2013: Selected Talk: Bryan Drexler: The 80/20 Rule and Big Data
EDF2013: Selected Talk: Bryan Drexler: The 80/20 Rule and Big Data EDF2013: Selected Talk: Bryan Drexler: The 80/20 Rule and Big Data
EDF2013: Selected Talk: Bryan Drexler: The 80/20 Rule and Big Data
 
Financial Services Data - Use It or Lose It
Financial Services Data - Use It or Lose ItFinancial Services Data - Use It or Lose It
Financial Services Data - Use It or Lose It
 
Asian Bankers Association, Manila Conference
Asian Bankers Association, Manila ConferenceAsian Bankers Association, Manila Conference
Asian Bankers Association, Manila Conference
 
Eureka Facts Capabilities Overview
Eureka Facts Capabilities OverviewEureka Facts Capabilities Overview
Eureka Facts Capabilities Overview
 
Kantar health china credential deck 20110621
Kantar health china credential deck 20110621Kantar health china credential deck 20110621
Kantar health china credential deck 20110621
 
Hacking Trust
Hacking TrustHacking Trust
Hacking Trust
 
Commerical Advantage Services Brochure
Commerical Advantage Services BrochureCommerical Advantage Services Brochure
Commerical Advantage Services Brochure
 
Annik research analytics deck pvd
Annik research analytics deck   pvdAnnik research analytics deck   pvd
Annik research analytics deck pvd
 
Future of Analytics is here
Future of Analytics is hereFuture of Analytics is here
Future of Analytics is here
 
Big data meets big analytics
Big data meets big analyticsBig data meets big analytics
Big data meets big analytics
 

Mais de jdijcks

2012 10 bigdata_overview
2012 10 bigdata_overview2012 10 bigdata_overview
2012 10 bigdata_overview
jdijcks
 

Mais de jdijcks (6)

Oracle Big Data Appliance and Big Data SQL for advanced analytics
Oracle Big Data Appliance and Big Data SQL for advanced analyticsOracle Big Data Appliance and Big Data SQL for advanced analytics
Oracle Big Data Appliance and Big Data SQL for advanced analytics
 
Oracle Openworld Presentation with Paul Kent (SAS) on Big Data Appliance and ...
Oracle Openworld Presentation with Paul Kent (SAS) on Big Data Appliance and ...Oracle Openworld Presentation with Paul Kent (SAS) on Big Data Appliance and ...
Oracle Openworld Presentation with Paul Kent (SAS) on Big Data Appliance and ...
 
Expand a Data warehouse with Hadoop and Big Data
Expand a Data warehouse with Hadoop and Big DataExpand a Data warehouse with Hadoop and Big Data
Expand a Data warehouse with Hadoop and Big Data
 
2013 05 Oracle big_dataapplianceoverview
2013 05 Oracle big_dataapplianceoverview2013 05 Oracle big_dataapplianceoverview
2013 05 Oracle big_dataapplianceoverview
 
2012 10 bigdata_overview
2012 10 bigdata_overview2012 10 bigdata_overview
2012 10 bigdata_overview
 
Big dataappliance hadoopworld_final
Big dataappliance hadoopworld_finalBig dataappliance hadoopworld_final
Big dataappliance hadoopworld_final
 

Último

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Último (20)

Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKSpring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 

2012 09 Oracle bigdata_architecture

  • 1. Big Data in the Data Center Jean-Pierre Dijcks Big Data Product Mangement 1 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 2. Agenda  Architecting Big Data  Building Big Data Solutions  Oracle Big Data Appliance 2 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 3. Architecting Big Data 3 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 4. What Does a Big Data World Look Like? Truck / Motor Manufacturer What they collect Monitors the complete car Miles Per Gallon, Driving techniques Location information How they use it Better tailored servicing plans Better targeted marketing Offer better finance deals or related options More data for R&D Sell on to partners Big Data means… The ability to predict when components might fail Create better service plans based on actual usage Drivers can post their data to manufacturers website Black box data can help with accidents 4 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 5. What Does a Big Data World Look Like? Retailer / White Goods What they collect Food monitoring by RFID tags – Fridge monitors food usage and sell- by dates How they use it Automated food ordering Better targeted marketing due to better data about how/when customer uses products Big Data means… More detailed information about customers Better store based demand planning 5 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 6. Sample of Big Data Use Cases Today AUTOMOTIVE Auto sensors What is the main difference in this data? COMMUNICATIONS Location-based Retail / CPG Sentiment analysis FINANCIAL SERVICES EDUCATION & RESEARCH reporting advertising Hot products Risk & portfolio analysis Experiment location, New products sensor analysis Optimized Marketing problems HIGH TECHNOLOGY / Volume, Velocity, Variety LIFE MEDIA/ ON-LINE SERVICES / HEALTH CARE INDUSTRIAL MFG. SCIENCES ENTERTAINMENT SOCIAL Patient sensors, Mfg quality Clinical trials Viewers / advertising MEDIA monitoring, EHRs Warranty analysis Genomics effectiveness People & career Quality of care Cross Sell matching Web-site optimization OIL & GAS These Characteristics Challenge your Games TRAVEL & TRANSPORTATION UTILITIES LAW ENFORCEMENT Drilling Adjust to exploration sensor analysis player behavior Existing Architecture Meter Sensor analysis for optimal traffic flows Smart analysis for & DEFENSE Threat analysis - network social media In-Game Ads Customer sentiment capacity, monitoring, photo analysis 6 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 7. Building your big data architecture Gradually Extending your Existing Architecture for Big Data:  Step 1: Further Analyze Current Data  Step 2: Architect for Data Variety and Volume  Step 3: Architect for Data Velocity  Step 4: Discover New Patterns Increase Business Value 7 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 8. Step 0: Data Warehouse Foundation • Dashboard High Oracle • Ad-Hoc Query Density Data Database Oracle BI Enterprise Edition Acquire Organize Analyze Decide 8 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 9. Step 1: Deep Analysis of Current Data • Dashboard High Oracle • Ad-Hoc Query Density Data Database Oracle BI • Churn Enterprise • Locality Edition Spatial and Graph Advanced Analytics Acquire Organize Analyze Decide 9 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 10. Step 2: Architect for Volume and Variety • Dashboard High Oracle • Ad-Hoc Query Density Database Data Oracle BI • Churn Enterprise • Locality Low Density Edition Spatial • Relationship variable Data and Graph • Comments Hadoop Advanced Aggregate Analytics Pre-Analyze Acquire Organize Analyze Decide 10 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 11. Step 3: Architect for Velocity High Oracle Density Data Database • Dashboard Oracle BI • Ad-Hoc Query Hadoop Enterprise Low Edition Density Spatial and • Churn Batch Data Graph • Locality Aggregate Advanced Pre-Analyze Analytics Model • Relationship • Comments Streaming Event Real Time Data Processing Decisions • Recommend • Act Act Acquire Organize Analyze Decide 11 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 12. Step 4: Discover New Information Endeca Information Discovery High Oracle Density Data Database • Dashboard Oracle BI • Ad-Hoc Query Hadoop Enterprise Low Edition Density Spatial and • Churn Batch Data Graph • Locality Aggregate Advanced Pre-Analyze Analytics Model • Relationship • Comments Streaming Event Real Time Data Processing Decisions • Recommend • Act Act Organize Analyze Decide • Discover Acquire 12 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 13. Oracle Engineered Systems Simplify IT – Simplify Big Data • Dashboard  • Ad-Hoc Query Oracle Big Data Appliance Oracle Exadata Oracle • Churn • Locality   Exalytics • Relationship • Comments InfiniBand InfiniBand • Recommend • Act  • Discover  Acquire Organize Analyze Decide 13 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 14. Building Big Data Solutions 14 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 15. Building a Big Data Solution Customer Retention and Social Media  Apply classic churn models to the Data Warehouse data  Add Social Data (Twitter) and Relationships (Facebook)  Analyze Social Data and Relationships  Deploy New Retention Policy into the Data Stream Increase Business Value 15 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 16. Predict Customer Churn Churn Find at-risk customers Predictive models Widely used 16 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 17. Oracle Advanced Analytics Oracle Data Mining 12 Algorithms Build Usage Extreme performance Data Deploy Customer A: 0.49 Customer B: 0.25 Score GUI for Data Scientists Acquire Organize Analyze Decide 17 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 18. Understand Your Customers Churn Social Find interesting data sets Data Process the data to represent meaningful actions Uncover new relationships New Facts 18 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 19. Oracle Big Data Appliance Big Data Acquisition and Organization Twitter Data Pre-integrated cluster Collect Customer A: Facebook Customer B: Sun Oracle hardware Sessionize Data Cloudera CDH Aggregate Massive scale Internal Log Data Acquire Organize 19 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 20. Oracle Big Data Connectors Customer A: High performance Customer A: Customer B: Customer B: Secure Cust A: 0.49 Efficient Cust B: 0.25 Acquire Organize 20 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 21. Oracle Advanced Analytics Oracle R Enterprise Open source compatible Model Customer A: D 0.10 Customer B: 0.25 Scales to huge data sets R B 0.79 Extreme performance 0.49 Cust A: 0.49 A C Cust B: 0.25 Widely used Organize Analyze Decide 21 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 22. Real-Time Retention Decisions Churn Social Data React to real-time events Influence key customers Adjust in real-time New New Policy Facts 22 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 23. Oracle RTD and Oracle NoSQL Database Enrich Decisions Self learning Tweet Events Model D B Fast profile lookups A C Integrated Instant Communication Tweet Offer Ideas Analyze Decide 23 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 24. Oracle Big Data Appliance 24 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 25. Oracle Big Data Appliance Get up and Running Quickly Improve Performance of Hadoop Integrated with Exadata Lower TCO for Big Data 25 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 26. Price comparison Oracle Big Data Appliance “Build-Your-Own” – HP hardware and Cloudera Year 1 Year 2 Year 3 Total Year 1 Year 2 Year 3 Total Servers and BDA Cost $450,000 $428,220 switches Support $54,000 $54,000 $54,000 Support Cost $136,233 $72,000 $72,000 Cost On-site Installation & Installation $14,150 configuration not included Total $518,150 $54,000 $54,000 $626,150 Total $564,453 $72,000 $72,000 $708,453 Full details at https://blogs.oracle.com/datawarehousing/entry/price_comparison_for_big_data
  • 27. Big Data Appliance performance comparisons 6x faster than custom 20-node Hadoop 2.5x faster than 30-node Hadoop cluster cluster for large batch transformation jobs for tagging and parsing text documents 10 10 Time (hours) Time (hours) 5 5 0 0 Big Data DIY Hadoop Big Data Cloud-based Appliance Cluster Appliance Hadoop 27 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 28. 28 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
  • 29. 29 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

Notas do Editor

  1. Who are my most valuable customers?What is last Months Revenue?
  2. Where are my most valuable customers located?Who is most likely to churn in the next month?
  3. What opinions do people have?Why do people buy these products?
  4. How do I influence buying decisions?How do I prevent serious issues from happening?
  5. How do I influence buying decisions?How do I prevent serious issues from happening?
  6. How do I influence buying decisions?How do I prevent serious issues from happening?