SlideShare uma empresa Scribd logo
1 de 31
Big Data and Competitive Intelligence
Finding Answers Outside the Firewall

 Presenters: Isai Shenker, VP of Product Management, Connotate
             Gina Cerami, VP of Marketing, Connotate

 Moderator: Christian Giaretta, VP of Sales Engineering, Connotate

 Date:       September 20, 2012
Presenters




         Isai Shenker                      Gina Cerami
  Vice President of Product Management   Vice President of Marketing
                Connotate                        Connotate
Today’s Discussion
• Competitive pricing: Insight from outside the firewall
   • Business case and operational challenges
   • Case study: Competitive pricing for online retail
   • Case study: Pricing optimization for specialty chemicals

• Customer sentiment: Digging into Deep Web
   • Sources of consumer sentiment
   • Process: Extracting consumer sentiment from YouTube
   • Case Study: Allergy medicine and consumer sentiment

• Manual versus automated approaches

• Q&A
Competitive Pricing
The Business Case



    Distributors and resellers prices


  15,000,000 prices
       Other competitor’s prices
Operational Challenges in Setting Prices

           Measuring the impact
            of pricing decisions

       Forecasting the impact of
       potential pricing decisions
                                      Getting
        Maintaining visibility into
                                      access to
         promotional profitability    robust,
              Getting access to       competitive
    robust competitive price data
                                      price data is a
  Making sure that stores change
    prices accurately and timely      big challenge
Keeping up with promotional deals     Retail Systems
 cut by buyers with manufacturers
                                      Research 2012
            Managing promotions       Benchmark Report
                across channels
Polling Question

Are you currently collecting competitive pricing data
from the Web?

   Yes – we are collecting pricing data from the Web

   No – we are not collecting pricing data from the Web
   but we have a project or plan to do this within the next
   6 months

   No – we have no plans to collect pricing data from
   the Web
Competitive Pricing:
Real-World Success Stories

Online Retailer of                             Specialized Retailer
                        National Store Chain   Goes Deep Web
New and Used Goods
• Checks 1M online      • Checks prices on     • Builds online
  prices per day to       3M items at            catalog by
  win business            national and local     going 3-7 layers
                          levels                 deep on direct mfrs’
                                                 Web sites for
                                                 product info



                      Automation is key to success
Competitive Pricing:
Real-World Success Stories

Online Retailer of                            Specialized Retailer
                       National Store Chain   Goes Deep Web
New and Used Goods


 LOWEST PRICE              OPTIMIZED          DOUBLED SIZE OF
                           MARGINS            ONLINE CATALOG




                     Automation is key to success
An Overview of the Automation Process

                                                         Connotate
                                                          Partners




                              {
                              {
             Collect Data                 Transform                  Deliver
Internal Sources    External Sources   • Structure               • Reports
• Database          • Social Media     • Classify                • Dashboards
• Market Basket     • Surface Web      • Prep for Analysis       • Workflow
• Inventory, etc.   • Hidden Web                                 • BI Plug-ins
                    •Secured Sites
Example: Pricing Flow Diagram
Price Optimization Case Study:
Sigma Aldrich
Sigma-Aldrich faced a “Big Data” challenge
• An overwhelming volume of pricing information on the Web




                           ?                     $
                                            Jeopardizing
    Manual              Inaccurate            a Sound
   Processes              Results              Pricing
                                              Strategy
Results: Price Optimization Pays Off




            Increase revenue
                 2%- 4%
       $8.75M - $16B for Fortune 500 Company
Customer Sentiment
Customer Sentiment


  “The better and more quickly a company
  can measure customer sentiment,
  the sooner it can tell how well a product
  is likely to sell.”
                        – BusinessWeek, 2011
Customer Sentiment: Deep Web
A Fortune 50 consumer product goods company sought input
from social media on customer sentiment about a popular
class of products:
 • Twitter was easy to access via API but not useful; there was
   no in-depth discussion of features
 • Detailed product reviews existed on Amazon, Walmart, in
   microblogs and comments on YouTube videos
 • The firm wanted to access these sites and draw conclusions
   from this data to create a feedback loop for their continuous
   product design cycle
Differences in Web Sources
    Facebook
   Twitter, etc.
                                               D
                                               A
                                               T
Surface Web, Other                             A
   Social Media

                                               A
                             Processing
                                               N
    Deep Web                                   A
 (traverse links)
                                               L
                                               Y
                                               S
    Password-                                  I
  Protected Sites
                                               S
 Data Sources                Analysis


                                          18
Automation Opens Access to Deep Web and Secured Sites

   Facebook
  Twitter, etc.
                                                  D
                                                  A
                                                  T
  Surface Web,                                    A
  blogs, forums

                                                  A
                                     Processing
                                                  N
    Deep Web                                      A
 (traverse links)
                                                  L
                                                  Y
                                                  S
   Password                                       I
 Protected Sites
                                                  S
                                      Analysis
Data Sources


                                                        19
Obtaining Customer Sentiment from YouTube

      Manually search YouTube for <“product name”> <“review”>




            Use the Connotate automation package to find
          <“product name”> <“review”> in posted comments



                     Use Connotate to follow links
                 to other sites with <“product name”>




         Feed input into analytical engine to reveal sentiment


            Graphical User Interface/Presentation of Insights
Refining Data for Business Insights: Customer
Sentiment
A major pharmaceutical company wants to understand the
competitive landscape for allergy medications.

  • Decided to focus on data available online
  • Used Connotate to collect product information, prices and

    4,700 customer reviews on 465 products
  • Analyzed data and found insights using Luminoso text analytics

  • Time from idea to initial findings:   6 hours
Customer Sentiment Around Allergy Drug Cost
as Displayed by Sentiment Analysis Tool
Customer Sentiment Around the Word
“Generic”




         Customer Sentiment Around Allergy Drug
         Cost
         as Displayed by Sentiment Analysis Tool
The Value of the Data is in the Delivery
Another Look at the Automation Process
                                                             Your internal BI tools or
             Connotate                    Connotate           Connotate partners
             Collect Data                  Transform                Deliver
                                                                      • Reports
Internal Sources    External Sources
                                       • Classify                     • Dashboards
• Database          • Social Media
                                       • Structure                    • Workflow
• Market Basket     • Surface Web
                                       • Prep for Analysis            • BI Plug-ins
• Inventory, etc.   • Hidden Web
                    •Secured Sites




    Connotate provides precise quality data, structured
    for delivery to your analysis and presentation tools.

    Connotate maximizes the value of your investment
    in business intelligence, text analytics and semantic
    analysis tools.

                                                                              Excel
Polling Question: Customer Sentiment

Are you currently collecting customer sentiment data
from the Web?

   Yes – we are collecting customer sentiment data
   from the Web

   No – we are not collecting customer sentiment data
   from the Web but we have a project or plan to do this
   within the next 6 months

   No – we have no plans to collect customer sentiment
   from the Web
Manual versus Automated Approaches

 Your Data Needs                           To Automate or Not?

                                           ? May want to consider
 Complex product-matching tasks
                                             crowd sourcing

 Small amount of data, needed a few        ? A manual approach may
 times per year                              suffice

 Specific external data (under $5K/year)   ? Purchase from 3rd party

  High volume data monitoring               Automate

 Variety of sources                         Automate

 Frequent updates and/or monitoring         Automate

 Need for data post-processing              Automate
Vast Resources of Competitive Intelligence are
Outside the Firewall

Automation is                       Price
the key to                          optimization
extracting
precise quality                     Product design
data
                                    Deliver new
                                    online services
Automation is
needed when
                                    Dynamically
the initiative is
                                    adjust product
strategic
                                    positioning
Selected Connotate Partners for
Competitive Intelligence
                        Text and Sentiment Analysis




                                                         Data Integration and
 Pricing Intelligence          CrowdSourcing
                                                               Business
                                                             Intelligence




                        Special thanks to Nikki Baird,
                          Retail Systems Research,
                           www.rsrresearch.com
Q&A

Connotate will email a link to this presentation as well as a
copy of the slides to you within 2 business days.


If you have an immediate need and would like us to contact
you about a forthcoming project, please check the appropriate
box in the last polling question or call us at 732-296-8844.


You may also visit www.connotate.com for more information.
Thank You

If you have an immediate need and would like us to contact
you about a forthcoming project, please check the appropriate
box in the last polling question or call us at 732-296-8844.


For more information, visit www.connotate.com.

Mais conteúdo relacionado

Destaque

Competitive Intelligence & Big Data
Competitive Intelligence & Big DataCompetitive Intelligence & Big Data
Competitive Intelligence & Big DataCID GmbH
 
Driving Innovation through Licensing Competitive Intelligence and Big Data…
Driving Innovation through Licensing Competitive Intelligence and Big Data…Driving Innovation through Licensing Competitive Intelligence and Big Data…
Driving Innovation through Licensing Competitive Intelligence and Big Data…Paragon Solutions
 
Market Research & Competitive Intelligence
Market Research & Competitive IntelligenceMarket Research & Competitive Intelligence
Market Research & Competitive IntelligenceSAI Digital
 
What is Competitive Intelligence (CI) and What It Should Include
What is Competitive Intelligence (CI) and What It Should IncludeWhat is Competitive Intelligence (CI) and What It Should Include
What is Competitive Intelligence (CI) and What It Should IncludeTrainOurTroops.org
 
Competitive intelligence - industry research and benchmarking
Competitive intelligence -  industry research and benchmarkingCompetitive intelligence -  industry research and benchmarking
Competitive intelligence - industry research and benchmarkingR Pagell
 
Competitive Intelligence and Big Data
Competitive Intelligence and Big DataCompetitive Intelligence and Big Data
Competitive Intelligence and Big DataCID GmbH
 
Marketing Research and Competitive Intelligence
Marketing Research and Competitive IntelligenceMarketing Research and Competitive Intelligence
Marketing Research and Competitive IntelligenceAugust Jackson
 
Data & Automation Drive the Future of All Marketing Communications at Freshpair
Data & Automation Drive the Future of All Marketing Communications at FreshpairData & Automation Drive the Future of All Marketing Communications at Freshpair
Data & Automation Drive the Future of All Marketing Communications at FreshpairBluecore
 
COMPETITIVE INTELLIGENCE FOR SALES AND MARKETING: HOW TO WIN MORE OPPORTUNITI...
COMPETITIVE INTELLIGENCE FOR SALES AND MARKETING: HOW TO WIN MORE OPPORTUNITI...COMPETITIVE INTELLIGENCE FOR SALES AND MARKETING: HOW TO WIN MORE OPPORTUNITI...
COMPETITIVE INTELLIGENCE FOR SALES AND MARKETING: HOW TO WIN MORE OPPORTUNITI...HubSpot
 
Monitoring and Analysis of Web Information for Various Business Contexts : Co...
Monitoring and Analysis of Web Information for Various Business Contexts : Co...Monitoring and Analysis of Web Information for Various Business Contexts : Co...
Monitoring and Analysis of Web Information for Various Business Contexts : Co...Dr. Haxel Consult
 
WhereScape, the pioneer in data warehouse automation software
WhereScape, the pioneer in data warehouse automation software WhereScape, the pioneer in data warehouse automation software
WhereScape, the pioneer in data warehouse automation software Patrick Van Renterghem
 
Intelligence Trends 2017 - Snapshot of Market and Competitive Intelligence T...
Intelligence Trends 2017  - Snapshot of Market and Competitive Intelligence T...Intelligence Trends 2017  - Snapshot of Market and Competitive Intelligence T...
Intelligence Trends 2017 - Snapshot of Market and Competitive Intelligence T...ACRASIO
 
Competitive analysis of it service firms
Competitive analysis of it service firmsCompetitive analysis of it service firms
Competitive analysis of it service firmsSayan Maiti
 
Best Practices in Implementing Strategic and Competitive Intelligence
Best Practices in Implementing Strategic and Competitive IntelligenceBest Practices in Implementing Strategic and Competitive Intelligence
Best Practices in Implementing Strategic and Competitive IntelligenceACRASIO
 

Destaque (20)

Competitive Intelligence & Big Data
Competitive Intelligence & Big DataCompetitive Intelligence & Big Data
Competitive Intelligence & Big Data
 
Driving Innovation through Licensing Competitive Intelligence and Big Data…
Driving Innovation through Licensing Competitive Intelligence and Big Data…Driving Innovation through Licensing Competitive Intelligence and Big Data…
Driving Innovation through Licensing Competitive Intelligence and Big Data…
 
Market Research & Competitive Intelligence
Market Research & Competitive IntelligenceMarket Research & Competitive Intelligence
Market Research & Competitive Intelligence
 
What is Competitive Intelligence (CI) and What It Should Include
What is Competitive Intelligence (CI) and What It Should IncludeWhat is Competitive Intelligence (CI) and What It Should Include
What is Competitive Intelligence (CI) and What It Should Include
 
Competitive intelligence - industry research and benchmarking
Competitive intelligence -  industry research and benchmarkingCompetitive intelligence -  industry research and benchmarking
Competitive intelligence - industry research and benchmarking
 
Mobile Business Intelligence - Yellowfin
Mobile Business Intelligence - YellowfinMobile Business Intelligence - Yellowfin
Mobile Business Intelligence - Yellowfin
 
Competitive Intelligence and Big Data
Competitive Intelligence and Big DataCompetitive Intelligence and Big Data
Competitive Intelligence and Big Data
 
Marketing Research and Competitive Intelligence
Marketing Research and Competitive IntelligenceMarketing Research and Competitive Intelligence
Marketing Research and Competitive Intelligence
 
The Data Asset
The Data AssetThe Data Asset
The Data Asset
 
Data & Automation Drive the Future of All Marketing Communications at Freshpair
Data & Automation Drive the Future of All Marketing Communications at FreshpairData & Automation Drive the Future of All Marketing Communications at Freshpair
Data & Automation Drive the Future of All Marketing Communications at Freshpair
 
Test Automation for Data Warehouses
Test Automation for Data Warehouses Test Automation for Data Warehouses
Test Automation for Data Warehouses
 
COMPETITIVE INTELLIGENCE FOR SALES AND MARKETING: HOW TO WIN MORE OPPORTUNITI...
COMPETITIVE INTELLIGENCE FOR SALES AND MARKETING: HOW TO WIN MORE OPPORTUNITI...COMPETITIVE INTELLIGENCE FOR SALES AND MARKETING: HOW TO WIN MORE OPPORTUNITI...
COMPETITIVE INTELLIGENCE FOR SALES AND MARKETING: HOW TO WIN MORE OPPORTUNITI...
 
Monitoring and Analysis of Web Information for Various Business Contexts : Co...
Monitoring and Analysis of Web Information for Various Business Contexts : Co...Monitoring and Analysis of Web Information for Various Business Contexts : Co...
Monitoring and Analysis of Web Information for Various Business Contexts : Co...
 
WhereScape, the pioneer in data warehouse automation software
WhereScape, the pioneer in data warehouse automation software WhereScape, the pioneer in data warehouse automation software
WhereScape, the pioneer in data warehouse automation software
 
Data mining and_big_data_web
Data mining and_big_data_webData mining and_big_data_web
Data mining and_big_data_web
 
Big data mining
Big data miningBig data mining
Big data mining
 
Intelligence Trends 2017 - Snapshot of Market and Competitive Intelligence T...
Intelligence Trends 2017  - Snapshot of Market and Competitive Intelligence T...Intelligence Trends 2017  - Snapshot of Market and Competitive Intelligence T...
Intelligence Trends 2017 - Snapshot of Market and Competitive Intelligence T...
 
Competitive analysis of it service firms
Competitive analysis of it service firmsCompetitive analysis of it service firms
Competitive analysis of it service firms
 
Company ppt
Company pptCompany ppt
Company ppt
 
Best Practices in Implementing Strategic and Competitive Intelligence
Best Practices in Implementing Strategic and Competitive IntelligenceBest Practices in Implementing Strategic and Competitive Intelligence
Best Practices in Implementing Strategic and Competitive Intelligence
 

Semelhante a Big Data and Competitive Intelligence

Making Analytics Actionable with Web Content Management
Making Analytics Actionable with Web Content ManagementMaking Analytics Actionable with Web Content Management
Making Analytics Actionable with Web Content ManagementWebtrends
 
Rob's kt deck
Rob's kt deck Rob's kt deck
Rob's kt deck rvanwart
 
Big Data Marketing Analytics
Big Data Marketing AnalyticsBig Data Marketing Analytics
Big Data Marketing AnalyticsAkash Tyagi
 
Keys to Keyword Discovery - For High Search Visibility
Keys to Keyword Discovery - For High Search VisibilityKeys to Keyword Discovery - For High Search Visibility
Keys to Keyword Discovery - For High Search VisibilityWebMama.com Inc.
 
SharePoint Search Goes Public!
SharePoint Search Goes Public!SharePoint Search Goes Public!
SharePoint Search Goes Public!SurfRay
 
Power Up Competitive Price Intelligence with Web Data
Power Up Competitive Price Intelligence with Web DataPower Up Competitive Price Intelligence with Web Data
Power Up Competitive Price Intelligence with Web DataConnotate
 
The Connected Consumer – Real-time Customer 360
The Connected Consumer – Real-time Customer 360The Connected Consumer – Real-time Customer 360
The Connected Consumer – Real-time Customer 360Capgemini
 
SEO and Your Website; What's Possible
SEO and Your Website; What's PossibleSEO and Your Website; What's Possible
SEO and Your Website; What's PossibleSite-Seeker, Inc.
 
Customer Insights Summit Toronto 2012
Customer Insights Summit Toronto 2012Customer Insights Summit Toronto 2012
Customer Insights Summit Toronto 2012Fabiana Pereira
 
Opening Data for Fun and Profit
Opening Data for Fun and Profit Opening Data for Fun and Profit
Opening Data for Fun and Profit 3scale
 
Content Targeting Moving From Visitors to Customers
Content Targeting Moving From Visitors to CustomersContent Targeting Moving From Visitors to Customers
Content Targeting Moving From Visitors to CustomersAlterian
 
Google analytics Review
Google analytics ReviewGoogle analytics Review
Google analytics ReviewSeth Garske
 
Mint.com Pre-Launch Pitch Deck
Mint.com Pre-Launch Pitch DeckMint.com Pre-Launch Pitch Deck
Mint.com Pre-Launch Pitch DeckHiten Shah
 
Product Management Talk with Oracle, PayPal and Incubator X
Product Management Talk with Oracle, PayPal and Incubator XProduct Management Talk with Oracle, PayPal and Incubator X
Product Management Talk with Oracle, PayPal and Incubator XProduct School
 
Measuring the Impact of Earned Online Media on Business Outcomes: A Methodolo...
Measuring the Impact of Earned Online Media on Business Outcomes: A Methodolo...Measuring the Impact of Earned Online Media on Business Outcomes: A Methodolo...
Measuring the Impact of Earned Online Media on Business Outcomes: A Methodolo...Text 100 Global Public Relations
 
Seth Duncan/Context Analytics 2009 Institute for Public Relations Research Me...
Seth Duncan/Context Analytics 2009 Institute for Public Relations Research Me...Seth Duncan/Context Analytics 2009 Institute for Public Relations Research Me...
Seth Duncan/Context Analytics 2009 Institute for Public Relations Research Me...sethlduncan
 
Top Marketing Trends Impacting Your Business in 2022
Top Marketing Trends Impacting Your Business in 2022Top Marketing Trends Impacting Your Business in 2022
Top Marketing Trends Impacting Your Business in 2022Milestone Inc
 

Semelhante a Big Data and Competitive Intelligence (20)

Making Analytics Actionable with Web Content Management
Making Analytics Actionable with Web Content ManagementMaking Analytics Actionable with Web Content Management
Making Analytics Actionable with Web Content Management
 
Rob's kt deck
Rob's kt deck Rob's kt deck
Rob's kt deck
 
Big Data Marketing Analytics
Big Data Marketing AnalyticsBig Data Marketing Analytics
Big Data Marketing Analytics
 
Keys to Keyword Discovery - For High Search Visibility
Keys to Keyword Discovery - For High Search VisibilityKeys to Keyword Discovery - For High Search Visibility
Keys to Keyword Discovery - For High Search Visibility
 
SharePoint Search Goes Public!
SharePoint Search Goes Public!SharePoint Search Goes Public!
SharePoint Search Goes Public!
 
Power Up Competitive Price Intelligence with Web Data
Power Up Competitive Price Intelligence with Web DataPower Up Competitive Price Intelligence with Web Data
Power Up Competitive Price Intelligence with Web Data
 
The Connected Consumer – Real-time Customer 360
The Connected Consumer – Real-time Customer 360The Connected Consumer – Real-time Customer 360
The Connected Consumer – Real-time Customer 360
 
Maxv friday
Maxv fridayMaxv friday
Maxv friday
 
SEO and Your Website; What's Possible
SEO and Your Website; What's PossibleSEO and Your Website; What's Possible
SEO and Your Website; What's Possible
 
Customer Insights Summit Toronto 2012
Customer Insights Summit Toronto 2012Customer Insights Summit Toronto 2012
Customer Insights Summit Toronto 2012
 
Opening Data for Fun and Profit
Opening Data for Fun and Profit Opening Data for Fun and Profit
Opening Data for Fun and Profit
 
Content Targeting Moving From Visitors to Customers
Content Targeting Moving From Visitors to CustomersContent Targeting Moving From Visitors to Customers
Content Targeting Moving From Visitors to Customers
 
Black box
Black boxBlack box
Black box
 
Google analytics Review
Google analytics ReviewGoogle analytics Review
Google analytics Review
 
[Webinar] High Speed Retail Analytics
[Webinar] High Speed Retail Analytics[Webinar] High Speed Retail Analytics
[Webinar] High Speed Retail Analytics
 
Mint.com Pre-Launch Pitch Deck
Mint.com Pre-Launch Pitch DeckMint.com Pre-Launch Pitch Deck
Mint.com Pre-Launch Pitch Deck
 
Product Management Talk with Oracle, PayPal and Incubator X
Product Management Talk with Oracle, PayPal and Incubator XProduct Management Talk with Oracle, PayPal and Incubator X
Product Management Talk with Oracle, PayPal and Incubator X
 
Measuring the Impact of Earned Online Media on Business Outcomes: A Methodolo...
Measuring the Impact of Earned Online Media on Business Outcomes: A Methodolo...Measuring the Impact of Earned Online Media on Business Outcomes: A Methodolo...
Measuring the Impact of Earned Online Media on Business Outcomes: A Methodolo...
 
Seth Duncan/Context Analytics 2009 Institute for Public Relations Research Me...
Seth Duncan/Context Analytics 2009 Institute for Public Relations Research Me...Seth Duncan/Context Analytics 2009 Institute for Public Relations Research Me...
Seth Duncan/Context Analytics 2009 Institute for Public Relations Research Me...
 
Top Marketing Trends Impacting Your Business in 2022
Top Marketing Trends Impacting Your Business in 2022Top Marketing Trends Impacting Your Business in 2022
Top Marketing Trends Impacting Your Business in 2022
 

Mais de Connotate

Using Web Data to Drive Revenue and Reduce Costs
Using Web Data to Drive Revenue and Reduce CostsUsing Web Data to Drive Revenue and Reduce Costs
Using Web Data to Drive Revenue and Reduce CostsConnotate
 
Three Steps to Accelerating Your Billing Reconciliation Process in Online Adv...
Three Steps to Accelerating Your Billing Reconciliation Process in Online Adv...Three Steps to Accelerating Your Billing Reconciliation Process in Online Adv...
Three Steps to Accelerating Your Billing Reconciliation Process in Online Adv...Connotate
 
Using Web Data to Fuel Dynamic Pricing
Using Web Data to Fuel Dynamic PricingUsing Web Data to Fuel Dynamic Pricing
Using Web Data to Fuel Dynamic PricingConnotate
 
Increase Profits with Better Vehicle Listing Data
Increase Profits with Better Vehicle Listing DataIncrease Profits with Better Vehicle Listing Data
Increase Profits with Better Vehicle Listing DataConnotate
 
Employees, Business Partners and Bad Guys: What Web Data Reveals About Person...
Employees, Business Partners and Bad Guys: What Web Data Reveals About Person...Employees, Business Partners and Bad Guys: What Web Data Reveals About Person...
Employees, Business Partners and Bad Guys: What Web Data Reveals About Person...Connotate
 
Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...
Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...
Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...Connotate
 
Power Up Your Competitive Price Intelligence With Web Data
Power Up Your Competitive Price Intelligence With Web DataPower Up Your Competitive Price Intelligence With Web Data
Power Up Your Competitive Price Intelligence With Web DataConnotate
 
Using Web Data to Drive Revenue and Reduce Costs
Using Web Data to Drive Revenue and Reduce CostsUsing Web Data to Drive Revenue and Reduce Costs
Using Web Data to Drive Revenue and Reduce CostsConnotate
 

Mais de Connotate (8)

Using Web Data to Drive Revenue and Reduce Costs
Using Web Data to Drive Revenue and Reduce CostsUsing Web Data to Drive Revenue and Reduce Costs
Using Web Data to Drive Revenue and Reduce Costs
 
Three Steps to Accelerating Your Billing Reconciliation Process in Online Adv...
Three Steps to Accelerating Your Billing Reconciliation Process in Online Adv...Three Steps to Accelerating Your Billing Reconciliation Process in Online Adv...
Three Steps to Accelerating Your Billing Reconciliation Process in Online Adv...
 
Using Web Data to Fuel Dynamic Pricing
Using Web Data to Fuel Dynamic PricingUsing Web Data to Fuel Dynamic Pricing
Using Web Data to Fuel Dynamic Pricing
 
Increase Profits with Better Vehicle Listing Data
Increase Profits with Better Vehicle Listing DataIncrease Profits with Better Vehicle Listing Data
Increase Profits with Better Vehicle Listing Data
 
Employees, Business Partners and Bad Guys: What Web Data Reveals About Person...
Employees, Business Partners and Bad Guys: What Web Data Reveals About Person...Employees, Business Partners and Bad Guys: What Web Data Reveals About Person...
Employees, Business Partners and Bad Guys: What Web Data Reveals About Person...
 
Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...
Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...
Know Your Market - Know Your Customer: What Web Data Reveals if You Know Wher...
 
Power Up Your Competitive Price Intelligence With Web Data
Power Up Your Competitive Price Intelligence With Web DataPower Up Your Competitive Price Intelligence With Web Data
Power Up Your Competitive Price Intelligence With Web Data
 
Using Web Data to Drive Revenue and Reduce Costs
Using Web Data to Drive Revenue and Reduce CostsUsing Web Data to Drive Revenue and Reduce Costs
Using Web Data to Drive Revenue and Reduce Costs
 

Último

Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESmohitsingh558521
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 

Último (20)

Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 

Big Data and Competitive Intelligence

  • 1. Big Data and Competitive Intelligence Finding Answers Outside the Firewall Presenters: Isai Shenker, VP of Product Management, Connotate Gina Cerami, VP of Marketing, Connotate Moderator: Christian Giaretta, VP of Sales Engineering, Connotate Date: September 20, 2012
  • 2. Presenters Isai Shenker Gina Cerami Vice President of Product Management Vice President of Marketing Connotate Connotate
  • 3. Today’s Discussion • Competitive pricing: Insight from outside the firewall • Business case and operational challenges • Case study: Competitive pricing for online retail • Case study: Pricing optimization for specialty chemicals • Customer sentiment: Digging into Deep Web • Sources of consumer sentiment • Process: Extracting consumer sentiment from YouTube • Case Study: Allergy medicine and consumer sentiment • Manual versus automated approaches • Q&A
  • 5. The Business Case Distributors and resellers prices 15,000,000 prices Other competitor’s prices
  • 6. Operational Challenges in Setting Prices Measuring the impact of pricing decisions Forecasting the impact of potential pricing decisions Getting Maintaining visibility into access to promotional profitability robust, Getting access to competitive robust competitive price data price data is a Making sure that stores change prices accurately and timely big challenge Keeping up with promotional deals Retail Systems cut by buyers with manufacturers Research 2012 Managing promotions Benchmark Report across channels
  • 7. Polling Question Are you currently collecting competitive pricing data from the Web? Yes – we are collecting pricing data from the Web No – we are not collecting pricing data from the Web but we have a project or plan to do this within the next 6 months No – we have no plans to collect pricing data from the Web
  • 8. Competitive Pricing: Real-World Success Stories Online Retailer of Specialized Retailer National Store Chain Goes Deep Web New and Used Goods • Checks 1M online • Checks prices on • Builds online prices per day to 3M items at catalog by win business national and local going 3-7 layers levels deep on direct mfrs’ Web sites for product info Automation is key to success
  • 9. Competitive Pricing: Real-World Success Stories Online Retailer of Specialized Retailer National Store Chain Goes Deep Web New and Used Goods LOWEST PRICE OPTIMIZED DOUBLED SIZE OF MARGINS ONLINE CATALOG Automation is key to success
  • 10. An Overview of the Automation Process Connotate Partners { { Collect Data Transform Deliver Internal Sources External Sources • Structure • Reports • Database • Social Media • Classify • Dashboards • Market Basket • Surface Web • Prep for Analysis • Workflow • Inventory, etc. • Hidden Web • BI Plug-ins •Secured Sites
  • 12. Price Optimization Case Study: Sigma Aldrich Sigma-Aldrich faced a “Big Data” challenge • An overwhelming volume of pricing information on the Web ? $ Jeopardizing Manual Inaccurate a Sound Processes Results Pricing Strategy
  • 13.
  • 14. Results: Price Optimization Pays Off Increase revenue 2%- 4% $8.75M - $16B for Fortune 500 Company
  • 16. Customer Sentiment “The better and more quickly a company can measure customer sentiment, the sooner it can tell how well a product is likely to sell.” – BusinessWeek, 2011
  • 17. Customer Sentiment: Deep Web A Fortune 50 consumer product goods company sought input from social media on customer sentiment about a popular class of products: • Twitter was easy to access via API but not useful; there was no in-depth discussion of features • Detailed product reviews existed on Amazon, Walmart, in microblogs and comments on YouTube videos • The firm wanted to access these sites and draw conclusions from this data to create a feedback loop for their continuous product design cycle
  • 18. Differences in Web Sources Facebook Twitter, etc. D A T Surface Web, Other A Social Media A Processing N Deep Web A (traverse links) L Y S Password- I Protected Sites S Data Sources Analysis 18
  • 19. Automation Opens Access to Deep Web and Secured Sites Facebook Twitter, etc. D A T Surface Web, A blogs, forums A Processing N Deep Web A (traverse links) L Y S Password I Protected Sites S Analysis Data Sources 19
  • 20. Obtaining Customer Sentiment from YouTube Manually search YouTube for <“product name”> <“review”> Use the Connotate automation package to find <“product name”> <“review”> in posted comments Use Connotate to follow links to other sites with <“product name”> Feed input into analytical engine to reveal sentiment Graphical User Interface/Presentation of Insights
  • 21. Refining Data for Business Insights: Customer Sentiment A major pharmaceutical company wants to understand the competitive landscape for allergy medications. • Decided to focus on data available online • Used Connotate to collect product information, prices and 4,700 customer reviews on 465 products • Analyzed data and found insights using Luminoso text analytics • Time from idea to initial findings: 6 hours
  • 22. Customer Sentiment Around Allergy Drug Cost as Displayed by Sentiment Analysis Tool
  • 23. Customer Sentiment Around the Word “Generic” Customer Sentiment Around Allergy Drug Cost as Displayed by Sentiment Analysis Tool
  • 24. The Value of the Data is in the Delivery
  • 25. Another Look at the Automation Process Your internal BI tools or Connotate Connotate Connotate partners Collect Data Transform Deliver • Reports Internal Sources External Sources • Classify • Dashboards • Database • Social Media • Structure • Workflow • Market Basket • Surface Web • Prep for Analysis • BI Plug-ins • Inventory, etc. • Hidden Web •Secured Sites Connotate provides precise quality data, structured for delivery to your analysis and presentation tools. Connotate maximizes the value of your investment in business intelligence, text analytics and semantic analysis tools. Excel
  • 26. Polling Question: Customer Sentiment Are you currently collecting customer sentiment data from the Web? Yes – we are collecting customer sentiment data from the Web No – we are not collecting customer sentiment data from the Web but we have a project or plan to do this within the next 6 months No – we have no plans to collect customer sentiment from the Web
  • 27. Manual versus Automated Approaches Your Data Needs To Automate or Not? ? May want to consider Complex product-matching tasks crowd sourcing Small amount of data, needed a few ? A manual approach may times per year suffice Specific external data (under $5K/year) ? Purchase from 3rd party High volume data monitoring  Automate Variety of sources  Automate Frequent updates and/or monitoring  Automate Need for data post-processing  Automate
  • 28. Vast Resources of Competitive Intelligence are Outside the Firewall Automation is Price the key to optimization extracting precise quality Product design data Deliver new online services Automation is needed when Dynamically the initiative is adjust product strategic positioning
  • 29. Selected Connotate Partners for Competitive Intelligence Text and Sentiment Analysis Data Integration and Pricing Intelligence CrowdSourcing Business Intelligence Special thanks to Nikki Baird, Retail Systems Research, www.rsrresearch.com
  • 30. Q&A Connotate will email a link to this presentation as well as a copy of the slides to you within 2 business days. If you have an immediate need and would like us to contact you about a forthcoming project, please check the appropriate box in the last polling question or call us at 732-296-8844. You may also visit www.connotate.com for more information.
  • 31. Thank You If you have an immediate need and would like us to contact you about a forthcoming project, please check the appropriate box in the last polling question or call us at 732-296-8844. For more information, visit www.connotate.com.