SlideShare a Scribd company logo
1 of 65
Measuring What Matters

Dan Weingrod
Econsultancy
Harder than ever for businesses to make sense of so much
                                  data




http://www.flickr.com/photos/brandnewbrain/
Growth in volume of data is outpacing speed at which
          companies can make sense of it




    | 3 | Online Measurement and Strategy Report 2011 |
Do you have a company-wide strategy that ties data
        collection and analysis to business objectives?
•    Only 22% of companies have a strategy in place, down from 25% last year.
•    78% do not have a strategy, but 63% are working on this.




http://www.flickr.com/photos/risager/
Fewer organisations than last year say web analytics drive
actionable recommendations that make a difference
Do analytics drive actionable recommendations that make a difference to
                           your organisation?


         28%       • Yes – definitely

         57%       • Yes - sometimes

         14%       • No – not really

          1%       • Never


            Online Measurement and Strategy Report 2011
62% of companies say that less than half of data is useful

  What percentage of the web analytics data you collect is useful for driving
                            decision-making?

2011
        27%                   35%                  28%            10%




       0-25%
                          25-50%               50-75%             75-100%




2010
        22%                   40%                  27%            10%



               Online Measurement and Strategy Report 2011
To what extent are web analytics integrated into
 your broader business intelligence strategy?
                                                                       41%



       30%



                                                                                           19%
                               15%
                                                   11%




Not integrated at all     We don't have a     We have a common We have common        We have common
                        business intelligence technology platform KPIs for web and       teams and
                              strategy       for web and non-web   non-web data      processes for web
                                                     data                            and non-web data




                  Online Measurement and Strategy Report 2011
Do you integrate web analytics with data from
               other sources?



             • Yes                           59%




             • No                            41%
                                                    http://www.flickr.com/photos/carnielewis187
                                                    http://www.flickr.com/photos/ghetzu/




      Online Measurement and Strategy Report 2011
Main frustrations involved in managing
             web analytics




      Online Measurement and Strategy Report 2011
What We’ll Talk About Today
•   Options for KPI’s
•   Getting to Insights
•   Testing + Iterating + Learning = Winning
•   Intro to Social Media Analytics
If you can’t measure it you can’t manage it…




              …but what do we measure, and how?




                                       | 11 |
http://www.flickr.com/photos/iliahi/
Too Much Data




http://www.flickr.com/photos/mediafury/
Not enough insight
It shouldn’t be that hard…


Corporate    Online goals
Goals and        and        KPI’s
Objectives    objectives
So what’s the problem?
 Goals that
                                     Goals that
  can’t be
                                      can’t be
 measured
                                    measured by
   online
                                     Analytics
                   Goals that are
                   too complex
                                                     Goals without a
                                                      clear success
                                                          metric
 Goals that we
don’t have data
       for
                                        Goals that
                  Goals have too         can’t be
                      many               adjusted
                  dependencies
We make it too hard…


Corporate    Online goals
Goals and        and        KPI’s
Objectives    objectives
Recipe for great KPI’s




http://www.flickr.com/photos/jdickert/
Based on valid data




http://www.flickr.com/photos/procsilas/
Easy to understand




http://www.flickr.com/photos/drnewton/
Indicates success




http://www.flickr.com/photos/8136496@N05/
Or failure
Actionable




http://www.flickr.com/photos/cottergarage/
The Three Layers of “So What” Test
                    Avinash Kaushik

• Ask every web metric you report the question "so what"
  three times.

• Each question provides an answer that in turn raises
  another question (a "so what" again).

• If at the third "so what" you don't get a
  recommendation for an action you should take, you
  have the wrong metric.

• Kill it.
These are the top exit pages on our website for the
         last month.




| 24 |
These are the top exit pages on our website for the
         last month.


            So what? They don't seem to have changed in six
            months




| 25 |
These are the top exit pages on our website for the
         last month.


            So what? They don't seem to have changed in six
            months

         We should focus on these pages because they are
         major leakage points in our website.




| 26 |
These are the top exit pages on our website for the
         last month.


            So what? They don't seem to have changed in six
            months

         We should focus on these pages because they are
         major leakage points in our website.


            So what? We have looked at this report for six months
            and tried to make fixes, and even after that the pages
            listed here have not dropped off the report.



| 27 |
These are the top exit pages on our website for the
         last month.


            So what? They don't seem to have changed in six
            months

         We should focus on these pages because they are
         major leakage points in our website.


            So what? We have looked at this report for six months
            and tried to make fixes, and even after that the pages
            listed here have not dropped off the report.


         If we can stop visitors from leaving the website, we
| 28 |   can keep them on our web site.
These are the top exit pages on our website for the
         last month.


            So what? They don't seem to have changed in six
            months

         We should focus on these pages because they are
         major leakage points in our website.


            So what? We have looked at this report for six months
            and tried to make fixes, and even after that the pages
            listed here have not dropped off the report.


         If we can stop visitors from leaving the website, we
| 29 |   can keep them on our web site.


           So what? Doesn't everyone have to exit on some
           page?
Easy to understand                   You, and your boss, can get it




    Based on valid data                   No-one can argue the numbers




       Indicates success                  #Winning




   Actionable                             You can affect change



http://www.flickr.com/photos/azugaldia/
Pirate Metrics




http://www.flickr.com/photos/72213316@N00/
Pirate Metrics




           September 19th - International Talk Like a Pirate day




http://www.flickr.com/photos/72213316@N00/
Dave McClure’s: Customer Lifecycle KPI’s

Acquisition: users come to the site from various channels

Activation: users enjoy 1st visit: "happy" user experience

Retention: users come back, visit site multiple times

Referral: users like product enough to refer others

Revenue: users conduct some monetization behavior

               AARRR!
Pirate Metrics
• Acquisition – Did they visit? Did they stay?

• Activation – Were they happy? Did they sign up? Did
  they include profile data?

• Retention – Did they return? Did they return based on
  targeted marketing?

• Referral – Did they refer others?

• Revenue – Did they spend money with us?

•
Pirate Metrics
• Easy to understand?

• Based on valid data?

• Indicates success…or failure?

• Actionable?

•
New Product Launch
• Acquisition –
  – How many visits did we get and were they
    greater than baseline?

  – Which channels did visitors come from?

  – Were visits from existing customers or new
    customers?
New Product Launch
• Activation –
  – Did new visitors stay on site longer?

  – Did new visitors sign up?

  – Did returning visitors, or customers, stay on
    site longer or take action?
New Product Launch
• Retention –
  – How many return visitors did we get?

  – How many came from marketing or re-
    marketing campaigns and which ones?
New Product Launch
• Referral –
  – Did they refer others?

  – Did their referrers visit and purchase?
New Product Launch
• Revenue –
  – Did they spend money with us?

  – Did they spend money as a new or returning
    visitor?

  – How much did they spend?
Pirate Metrics
• Provides a template for establishment of
  simple KPI’s
• Based on control and broad knowledge of
  channels
silos


http://www.flickr.com/photos/nakrnsm/
Agency
                                                    IT Dept.
                                 You    Marketing




http://www.flickr.com/photos/nakrnsm/
Recipe for great KPI’s

•   Actionable and simple
•   Easy to understand
•   Based on reality
•   Collaborative
•   AARRR
Insight
• KPI’s are the platform to deliver insights
• Not a status quo, instead a status why
  and a status where
• This should be the hard stuff
Insight through testing
Testing via constant iteration
• Not looking for the answer
• Looking for the next step that will lead us
  to better results
• Coming up with new answers
Iterative testing


 Build    Test



     Learn
Recipe
•   KPI’s
•   Hunches
•   A/B Testing
•   Analytics
•   Speed
Example
• KPI - Can we increase customer sign up?

• Hunch – Maybe it’s the form design

• Test – Design two variants of form, drive
  traffic to both

• Analytics – Measure results
Speed
•   Build fast
•   Fail fast
•   Learn fast
•   Move to next fast
Iterate
• Don’t make wholesale changes
• Small changes that can be built upon
• Continue to follow hunches
• Collaborate with inbound marketing
Results
• Insights

• Regular continuous improvement

• Actionable analytics

• Better results, lower costs
Measure What Matters
• Analytics and Social Media
• K.D. Paine
How do you measure relationships?




http://www.flickr.com/photos/nataliejohnson/
Some familiar approaches
• Put measurement at the beginning
• Create a baseline
• Define your KPI’s (KBI’s)
Some different
•   Define your environment
•   Define your investment
•   Determine your benchmarks
•   Select measurement tool
•   Analyze and draw conclusions
Social ROI
•   Sales or traffic
•   Cost savings
•   Paid vs earned search rankings
•   Cost avoidance
•   Social capital
Engagement
• Builds a relationship between customers
  and brands
• Helps promote and protect your brand
• Make your products better
Engagement levels

•   Lurking - Impression
•   Casual – Like, tweet, click
•   Active – Follower, commenter
•   Committed – Retweet, repost, share, #
•   Loyalist- Active comments and involvement
Engagement levels

•   Lurking - A
•   Casual - A
•   Active - R
•   Committed - R
•   Loyalist - R

           AARRR!
Social Media Analytics
•   Measuring engagement
•   Similar and different
•   Less actionable/less control
•   Potential for new insight
Summary Insights
• KPI’s are the building blocks for real
  insights about customers, products and
  profits
• Iterative testing can help us reach insights
  more quickly
• Social analytics are rapidly becoming a
  part of the essential mix
Thank You

More Related Content

What's hot

The Total Economic Impact of Botify
The Total Economic Impact of BotifyThe Total Economic Impact of Botify
The Total Economic Impact of BotifyBotify
 
SEO 101 for Venues: Key Learnings from 25 Website Audits in 4 Weeks
SEO 101 for Venues: Key Learnings from 25 Website Audits in 4 WeeksSEO 101 for Venues: Key Learnings from 25 Website Audits in 4 Weeks
SEO 101 for Venues: Key Learnings from 25 Website Audits in 4 WeeksEtix
 
Opticon 2015-From Skeptic to Champion
Opticon 2015-From Skeptic to ChampionOpticon 2015-From Skeptic to Champion
Opticon 2015-From Skeptic to ChampionOptimizely
 
WebVisions2016 Presumptive Design Workshop
WebVisions2016 Presumptive Design WorkshopWebVisions2016 Presumptive Design Workshop
WebVisions2016 Presumptive Design WorkshopLeo Frishberg
 
Google Analytics Crash Course
Google Analytics Crash CourseGoogle Analytics Crash Course
Google Analytics Crash CoursePeter O'Neill
 
Online marketing and advertising for the Apartment Industry
Online marketing and advertising for the Apartment IndustryOnline marketing and advertising for the Apartment Industry
Online marketing and advertising for the Apartment IndustryLori Valenti Webb
 
Growth Driven Design: The Solution To Website Redesigns
Growth Driven Design: The Solution To Website RedesignsGrowth Driven Design: The Solution To Website Redesigns
Growth Driven Design: The Solution To Website RedesignsLeighton Interactive
 
WA-UX - data and strategies - Talk by Shivam
WA-UX  - data and strategies - Talk by ShivamWA-UX  - data and strategies - Talk by Shivam
WA-UX - data and strategies - Talk by ShivamShivam Dhawan
 
Gilligan's Guide to Analysts as Community Managers' Best Friends
Gilligan's Guide to Analysts as Community Managers' Best FriendsGilligan's Guide to Analysts as Community Managers' Best Friends
Gilligan's Guide to Analysts as Community Managers' Best FriendsTim Wilson
 
Maturing from Conversion Optimisation to Business Optimisation - Paul Rouke f...
Maturing from Conversion Optimisation to Business Optimisation - Paul Rouke f...Maturing from Conversion Optimisation to Business Optimisation - Paul Rouke f...
Maturing from Conversion Optimisation to Business Optimisation - Paul Rouke f...PRWD
 
BP305 Show me the money! The value in social business
BP305 Show me the money! The value in social businessBP305 Show me the money! The value in social business
BP305 Show me the money! The value in social businessSasja Beerendonk
 
MeasureWorks - Outfox your Competition - Context is king, but Performance is ...
MeasureWorks - Outfox your Competition - Context is king, but Performance is ...MeasureWorks - Outfox your Competition - Context is king, but Performance is ...
MeasureWorks - Outfox your Competition - Context is king, but Performance is ...MeasureWorks
 
Google Analytics for Everyone!
Google Analytics for Everyone!Google Analytics for Everyone!
Google Analytics for Everyone! Brian Alpert
 
SharePoint Saturday Ottawa - Building the CoE
SharePoint Saturday Ottawa - Building the CoESharePoint Saturday Ottawa - Building the CoE
SharePoint Saturday Ottawa - Building the CoERyan Merpaw
 
ProductCamp Seattle 2014 Presentation: Anil Batra
ProductCamp Seattle 2014 Presentation: Anil BatraProductCamp Seattle 2014 Presentation: Anil Batra
ProductCamp Seattle 2014 Presentation: Anil Batrapmcnw
 
Opticon 2015-Scaling Your Testing Program for Maximum Impact
Opticon 2015-Scaling Your Testing Program for Maximum ImpactOpticon 2015-Scaling Your Testing Program for Maximum Impact
Opticon 2015-Scaling Your Testing Program for Maximum ImpactOptimizely
 
Seo basics
Seo basicsSeo basics
Seo basicsROI-DNA
 
Why Should You Care About Web Analytics
Why Should You Care About Web AnalyticsWhy Should You Care About Web Analytics
Why Should You Care About Web AnalyticsPeter O'Neill
 

What's hot (20)

The Total Economic Impact of Botify
The Total Economic Impact of BotifyThe Total Economic Impact of Botify
The Total Economic Impact of Botify
 
SEO 101 for Venues: Key Learnings from 25 Website Audits in 4 Weeks
SEO 101 for Venues: Key Learnings from 25 Website Audits in 4 WeeksSEO 101 for Venues: Key Learnings from 25 Website Audits in 4 Weeks
SEO 101 for Venues: Key Learnings from 25 Website Audits in 4 Weeks
 
Opticon 2015-From Skeptic to Champion
Opticon 2015-From Skeptic to ChampionOpticon 2015-From Skeptic to Champion
Opticon 2015-From Skeptic to Champion
 
WebVisions2016 Presumptive Design Workshop
WebVisions2016 Presumptive Design WorkshopWebVisions2016 Presumptive Design Workshop
WebVisions2016 Presumptive Design Workshop
 
Google Analytics Crash Course
Google Analytics Crash CourseGoogle Analytics Crash Course
Google Analytics Crash Course
 
Online marketing and advertising for the Apartment Industry
Online marketing and advertising for the Apartment IndustryOnline marketing and advertising for the Apartment Industry
Online marketing and advertising for the Apartment Industry
 
Growth Driven Design: The Solution To Website Redesigns
Growth Driven Design: The Solution To Website RedesignsGrowth Driven Design: The Solution To Website Redesigns
Growth Driven Design: The Solution To Website Redesigns
 
WA-UX - data and strategies - Talk by Shivam
WA-UX  - data and strategies - Talk by ShivamWA-UX  - data and strategies - Talk by Shivam
WA-UX - data and strategies - Talk by Shivam
 
Gilligan's Guide to Analysts as Community Managers' Best Friends
Gilligan's Guide to Analysts as Community Managers' Best FriendsGilligan's Guide to Analysts as Community Managers' Best Friends
Gilligan's Guide to Analysts as Community Managers' Best Friends
 
Maturing from Conversion Optimisation to Business Optimisation - Paul Rouke f...
Maturing from Conversion Optimisation to Business Optimisation - Paul Rouke f...Maturing from Conversion Optimisation to Business Optimisation - Paul Rouke f...
Maturing from Conversion Optimisation to Business Optimisation - Paul Rouke f...
 
BP305 Show me the money! The value in social business
BP305 Show me the money! The value in social businessBP305 Show me the money! The value in social business
BP305 Show me the money! The value in social business
 
MeasureWorks - Outfox your Competition - Context is king, but Performance is ...
MeasureWorks - Outfox your Competition - Context is king, but Performance is ...MeasureWorks - Outfox your Competition - Context is king, but Performance is ...
MeasureWorks - Outfox your Competition - Context is king, but Performance is ...
 
Google Analytics for Everyone!
Google Analytics for Everyone!Google Analytics for Everyone!
Google Analytics for Everyone!
 
SharePoint Saturday Ottawa - Building the CoE
SharePoint Saturday Ottawa - Building the CoESharePoint Saturday Ottawa - Building the CoE
SharePoint Saturday Ottawa - Building the CoE
 
When Should You Send An Email
When Should You Send An EmailWhen Should You Send An Email
When Should You Send An Email
 
ProductCamp Seattle 2014 Presentation: Anil Batra
ProductCamp Seattle 2014 Presentation: Anil BatraProductCamp Seattle 2014 Presentation: Anil Batra
ProductCamp Seattle 2014 Presentation: Anil Batra
 
Opticon 2015-Scaling Your Testing Program for Maximum Impact
Opticon 2015-Scaling Your Testing Program for Maximum ImpactOpticon 2015-Scaling Your Testing Program for Maximum Impact
Opticon 2015-Scaling Your Testing Program for Maximum Impact
 
Seo basics
Seo basicsSeo basics
Seo basics
 
1330 keynote angle
1330 keynote angle1330 keynote angle
1330 keynote angle
 
Why Should You Care About Web Analytics
Why Should You Care About Web AnalyticsWhy Should You Care About Web Analytics
Why Should You Care About Web Analytics
 

Similar to Measure what matters

Integrating web analytics into information architecture and user-centered design
Integrating web analytics into information architecture and user-centered designIntegrating web analytics into information architecture and user-centered design
Integrating web analytics into information architecture and user-centered designHallie Wilfert
 
From Misunderstood to Celebrated: How to Make Executives Care About Digital A...
From Misunderstood to Celebrated: How to Make Executives Care About Digital A...From Misunderstood to Celebrated: How to Make Executives Care About Digital A...
From Misunderstood to Celebrated: How to Make Executives Care About Digital A...Jacques Warren
 
Continuous Improvement
Continuous ImprovementContinuous Improvement
Continuous ImprovementReading Room
 
Digital Key Performance Indicators: Signs of What Exactly?
Digital Key Performance Indicators: Signs of What Exactly?Digital Key Performance Indicators: Signs of What Exactly?
Digital Key Performance Indicators: Signs of What Exactly?Sonya David
 
How to develop actionable web analytics KPI's
How to develop actionable web analytics KPI's How to develop actionable web analytics KPI's
How to develop actionable web analytics KPI's Antoaneta Nikolaeva
 
Stop Wasting Your Analytics Budget - edUi 2016
Stop Wasting Your Analytics Budget - edUi 2016Stop Wasting Your Analytics Budget - edUi 2016
Stop Wasting Your Analytics Budget - edUi 2016Mitch Daniels
 
Making Good SEO Reports Portent Webinar
Making Good SEO Reports Portent WebinarMaking Good SEO Reports Portent Webinar
Making Good SEO Reports Portent WebinarBrightEdge
 
Metrics that Matter
Metrics that MatterMetrics that Matter
Metrics that MatterJeremy Horn
 
Analytics for Customer Acquisition - Presentation at Nasscom Product Conclave...
Analytics for Customer Acquisition - Presentation at Nasscom Product Conclave...Analytics for Customer Acquisition - Presentation at Nasscom Product Conclave...
Analytics for Customer Acquisition - Presentation at Nasscom Product Conclave...Arun Agrawal
 
Measuring PR with Google Analytics Webinar - Walker Sands and Walker Sands D...
Measuring PR with Google Analytics Webinar  - Walker Sands and Walker Sands D...Measuring PR with Google Analytics Webinar  - Walker Sands and Walker Sands D...
Measuring PR with Google Analytics Webinar - Walker Sands and Walker Sands D...beaslecb
 
Content Jam Measure What Matters 06/14/12
Content Jam Measure What Matters 06/14/12Content Jam Measure What Matters 06/14/12
Content Jam Measure What Matters 06/14/12Tim Frick
 
Content Jam Measure What Matters 06/14/12
Content Jam Measure What Matters 06/14/12Content Jam Measure What Matters 06/14/12
Content Jam Measure What Matters 06/14/12Mightybytes
 
Aiesec dm report jan mar 15 (1)
Aiesec dm report jan mar 15 (1)Aiesec dm report jan mar 15 (1)
Aiesec dm report jan mar 15 (1)AIESEC
 
The Good, The Bad, and The Metrics
 The Good, The Bad, and The Metrics The Good, The Bad, and The Metrics
The Good, The Bad, and The MetricsTeamQualityPro
 
Oeresund Business Club Web Analytics Presentation
Oeresund Business Club Web Analytics PresentationOeresund Business Club Web Analytics Presentation
Oeresund Business Club Web Analytics PresentationFORCE Technology
 
Strategic_Web_Design-TestingYourVisualStory
Strategic_Web_Design-TestingYourVisualStoryStrategic_Web_Design-TestingYourVisualStory
Strategic_Web_Design-TestingYourVisualStoryguidecreative
 
Essential SEO Analytics: The Performance Metrics That Truly Count
Essential SEO Analytics: The Performance Metrics That Truly Count Essential SEO Analytics: The Performance Metrics That Truly Count
Essential SEO Analytics: The Performance Metrics That Truly Count Rhea Drysdale
 
Cut Through the Web Analytics Fog: Using GA Data Grabber to Act on Google Ana...
Cut Through the Web Analytics Fog: Using GA Data Grabber to Act on Google Ana...Cut Through the Web Analytics Fog: Using GA Data Grabber to Act on Google Ana...
Cut Through the Web Analytics Fog: Using GA Data Grabber to Act on Google Ana...Brian Alpert
 

Similar to Measure what matters (20)

Integrating web analytics into information architecture and user-centered design
Integrating web analytics into information architecture and user-centered designIntegrating web analytics into information architecture and user-centered design
Integrating web analytics into information architecture and user-centered design
 
From Misunderstood to Celebrated: How to Make Executives Care About Digital A...
From Misunderstood to Celebrated: How to Make Executives Care About Digital A...From Misunderstood to Celebrated: How to Make Executives Care About Digital A...
From Misunderstood to Celebrated: How to Make Executives Care About Digital A...
 
Continuous Improvement
Continuous ImprovementContinuous Improvement
Continuous Improvement
 
Digital Key Performance Indicators: Signs of What Exactly?
Digital Key Performance Indicators: Signs of What Exactly?Digital Key Performance Indicators: Signs of What Exactly?
Digital Key Performance Indicators: Signs of What Exactly?
 
How to develop actionable web analytics KPI's
How to develop actionable web analytics KPI's How to develop actionable web analytics KPI's
How to develop actionable web analytics KPI's
 
Stop Wasting Your Analytics Budget - edUi 2016
Stop Wasting Your Analytics Budget - edUi 2016Stop Wasting Your Analytics Budget - edUi 2016
Stop Wasting Your Analytics Budget - edUi 2016
 
Making Good SEO Reports Portent Webinar
Making Good SEO Reports Portent WebinarMaking Good SEO Reports Portent Webinar
Making Good SEO Reports Portent Webinar
 
Metrics that Matter
Metrics that MatterMetrics that Matter
Metrics that Matter
 
Analytics for Customer Acquisition - Presentation at Nasscom Product Conclave...
Analytics for Customer Acquisition - Presentation at Nasscom Product Conclave...Analytics for Customer Acquisition - Presentation at Nasscom Product Conclave...
Analytics for Customer Acquisition - Presentation at Nasscom Product Conclave...
 
Measuring PR with Google Analytics Webinar - Walker Sands and Walker Sands D...
Measuring PR with Google Analytics Webinar  - Walker Sands and Walker Sands D...Measuring PR with Google Analytics Webinar  - Walker Sands and Walker Sands D...
Measuring PR with Google Analytics Webinar - Walker Sands and Walker Sands D...
 
Why KPIs Often Fail
Why KPIs Often FailWhy KPIs Often Fail
Why KPIs Often Fail
 
Content Jam Measure What Matters 06/14/12
Content Jam Measure What Matters 06/14/12Content Jam Measure What Matters 06/14/12
Content Jam Measure What Matters 06/14/12
 
Content Jam Measure What Matters 06/14/12
Content Jam Measure What Matters 06/14/12Content Jam Measure What Matters 06/14/12
Content Jam Measure What Matters 06/14/12
 
Aiesec dm report jan mar 15 (1)
Aiesec dm report jan mar 15 (1)Aiesec dm report jan mar 15 (1)
Aiesec dm report jan mar 15 (1)
 
The Good, The Bad, and The Metrics
 The Good, The Bad, and The Metrics The Good, The Bad, and The Metrics
The Good, The Bad, and The Metrics
 
Google analytics jan_2012
Google analytics jan_2012Google analytics jan_2012
Google analytics jan_2012
 
Oeresund Business Club Web Analytics Presentation
Oeresund Business Club Web Analytics PresentationOeresund Business Club Web Analytics Presentation
Oeresund Business Club Web Analytics Presentation
 
Strategic_Web_Design-TestingYourVisualStory
Strategic_Web_Design-TestingYourVisualStoryStrategic_Web_Design-TestingYourVisualStory
Strategic_Web_Design-TestingYourVisualStory
 
Essential SEO Analytics: The Performance Metrics That Truly Count
Essential SEO Analytics: The Performance Metrics That Truly Count Essential SEO Analytics: The Performance Metrics That Truly Count
Essential SEO Analytics: The Performance Metrics That Truly Count
 
Cut Through the Web Analytics Fog: Using GA Data Grabber to Act on Google Ana...
Cut Through the Web Analytics Fog: Using GA Data Grabber to Act on Google Ana...Cut Through the Web Analytics Fog: Using GA Data Grabber to Act on Google Ana...
Cut Through the Web Analytics Fog: Using GA Data Grabber to Act on Google Ana...
 

Recently uploaded

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MIND CTI
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Bhuvaneswari Subramani
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...apidays
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native ApplicationsWSO2
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamUiPathCommunity
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Angeliki Cooney
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdfSandro Moreira
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Jeffrey Haguewood
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...apidays
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWERMadyBayot
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Zilliz
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024The Digital Insurer
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontologyjohnbeverley2021
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDropbox
 

Recently uploaded (20)

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 

Measure what matters

  • 1. Measuring What Matters Dan Weingrod Econsultancy
  • 2. Harder than ever for businesses to make sense of so much data http://www.flickr.com/photos/brandnewbrain/
  • 3. Growth in volume of data is outpacing speed at which companies can make sense of it | 3 | Online Measurement and Strategy Report 2011 |
  • 4. Do you have a company-wide strategy that ties data collection and analysis to business objectives? • Only 22% of companies have a strategy in place, down from 25% last year. • 78% do not have a strategy, but 63% are working on this. http://www.flickr.com/photos/risager/
  • 5. Fewer organisations than last year say web analytics drive actionable recommendations that make a difference Do analytics drive actionable recommendations that make a difference to your organisation? 28% • Yes – definitely 57% • Yes - sometimes 14% • No – not really 1% • Never Online Measurement and Strategy Report 2011
  • 6. 62% of companies say that less than half of data is useful What percentage of the web analytics data you collect is useful for driving decision-making? 2011 27% 35% 28% 10% 0-25% 25-50% 50-75% 75-100% 2010 22% 40% 27% 10% Online Measurement and Strategy Report 2011
  • 7. To what extent are web analytics integrated into your broader business intelligence strategy? 41% 30% 19% 15% 11% Not integrated at all We don't have a We have a common We have common We have common business intelligence technology platform KPIs for web and teams and strategy for web and non-web non-web data processes for web data and non-web data Online Measurement and Strategy Report 2011
  • 8. Do you integrate web analytics with data from other sources? • Yes 59% • No 41% http://www.flickr.com/photos/carnielewis187 http://www.flickr.com/photos/ghetzu/ Online Measurement and Strategy Report 2011
  • 9. Main frustrations involved in managing web analytics Online Measurement and Strategy Report 2011
  • 10. What We’ll Talk About Today • Options for KPI’s • Getting to Insights • Testing + Iterating + Learning = Winning • Intro to Social Media Analytics
  • 11. If you can’t measure it you can’t manage it… …but what do we measure, and how? | 11 | http://www.flickr.com/photos/iliahi/
  • 14. It shouldn’t be that hard… Corporate Online goals Goals and and KPI’s Objectives objectives
  • 15. So what’s the problem? Goals that Goals that can’t be can’t be measured measured by online Analytics Goals that are too complex Goals without a clear success metric Goals that we don’t have data for Goals that Goals have too can’t be many adjusted dependencies
  • 16. We make it too hard… Corporate Online goals Goals and and KPI’s Objectives objectives
  • 17. Recipe for great KPI’s http://www.flickr.com/photos/jdickert/
  • 18. Based on valid data http://www.flickr.com/photos/procsilas/
  • 23. The Three Layers of “So What” Test Avinash Kaushik • Ask every web metric you report the question "so what" three times. • Each question provides an answer that in turn raises another question (a "so what" again). • If at the third "so what" you don't get a recommendation for an action you should take, you have the wrong metric. • Kill it.
  • 24. These are the top exit pages on our website for the last month. | 24 |
  • 25. These are the top exit pages on our website for the last month. So what? They don't seem to have changed in six months | 25 |
  • 26. These are the top exit pages on our website for the last month. So what? They don't seem to have changed in six months We should focus on these pages because they are major leakage points in our website. | 26 |
  • 27. These are the top exit pages on our website for the last month. So what? They don't seem to have changed in six months We should focus on these pages because they are major leakage points in our website. So what? We have looked at this report for six months and tried to make fixes, and even after that the pages listed here have not dropped off the report. | 27 |
  • 28. These are the top exit pages on our website for the last month. So what? They don't seem to have changed in six months We should focus on these pages because they are major leakage points in our website. So what? We have looked at this report for six months and tried to make fixes, and even after that the pages listed here have not dropped off the report. If we can stop visitors from leaving the website, we | 28 | can keep them on our web site.
  • 29. These are the top exit pages on our website for the last month. So what? They don't seem to have changed in six months We should focus on these pages because they are major leakage points in our website. So what? We have looked at this report for six months and tried to make fixes, and even after that the pages listed here have not dropped off the report. If we can stop visitors from leaving the website, we | 29 | can keep them on our web site. So what? Doesn't everyone have to exit on some page?
  • 30. Easy to understand You, and your boss, can get it Based on valid data No-one can argue the numbers Indicates success #Winning Actionable You can affect change http://www.flickr.com/photos/azugaldia/
  • 32. Pirate Metrics September 19th - International Talk Like a Pirate day http://www.flickr.com/photos/72213316@N00/
  • 33. Dave McClure’s: Customer Lifecycle KPI’s Acquisition: users come to the site from various channels Activation: users enjoy 1st visit: "happy" user experience Retention: users come back, visit site multiple times Referral: users like product enough to refer others Revenue: users conduct some monetization behavior AARRR!
  • 34. Pirate Metrics • Acquisition – Did they visit? Did they stay? • Activation – Were they happy? Did they sign up? Did they include profile data? • Retention – Did they return? Did they return based on targeted marketing? • Referral – Did they refer others? • Revenue – Did they spend money with us? •
  • 35. Pirate Metrics • Easy to understand? • Based on valid data? • Indicates success…or failure? • Actionable? •
  • 36. New Product Launch • Acquisition – – How many visits did we get and were they greater than baseline? – Which channels did visitors come from? – Were visits from existing customers or new customers?
  • 37. New Product Launch • Activation – – Did new visitors stay on site longer? – Did new visitors sign up? – Did returning visitors, or customers, stay on site longer or take action?
  • 38. New Product Launch • Retention – – How many return visitors did we get? – How many came from marketing or re- marketing campaigns and which ones?
  • 39. New Product Launch • Referral – – Did they refer others? – Did their referrers visit and purchase?
  • 40. New Product Launch • Revenue – – Did they spend money with us? – Did they spend money as a new or returning visitor? – How much did they spend?
  • 41. Pirate Metrics • Provides a template for establishment of simple KPI’s • Based on control and broad knowledge of channels
  • 43. Agency IT Dept. You Marketing http://www.flickr.com/photos/nakrnsm/
  • 44. Recipe for great KPI’s • Actionable and simple • Easy to understand • Based on reality • Collaborative • AARRR
  • 45. Insight • KPI’s are the platform to deliver insights • Not a status quo, instead a status why and a status where • This should be the hard stuff
  • 47. Testing via constant iteration • Not looking for the answer • Looking for the next step that will lead us to better results • Coming up with new answers
  • 49. Recipe • KPI’s • Hunches • A/B Testing • Analytics • Speed
  • 50. Example • KPI - Can we increase customer sign up? • Hunch – Maybe it’s the form design • Test – Design two variants of form, drive traffic to both • Analytics – Measure results
  • 51. Speed • Build fast • Fail fast • Learn fast • Move to next fast
  • 52. Iterate • Don’t make wholesale changes • Small changes that can be built upon • Continue to follow hunches • Collaborate with inbound marketing
  • 53. Results • Insights • Regular continuous improvement • Actionable analytics • Better results, lower costs
  • 54. Measure What Matters • Analytics and Social Media • K.D. Paine
  • 55.
  • 56. How do you measure relationships? http://www.flickr.com/photos/nataliejohnson/
  • 57. Some familiar approaches • Put measurement at the beginning • Create a baseline • Define your KPI’s (KBI’s)
  • 58. Some different • Define your environment • Define your investment • Determine your benchmarks • Select measurement tool • Analyze and draw conclusions
  • 59. Social ROI • Sales or traffic • Cost savings • Paid vs earned search rankings • Cost avoidance • Social capital
  • 60. Engagement • Builds a relationship between customers and brands • Helps promote and protect your brand • Make your products better
  • 61. Engagement levels • Lurking - Impression • Casual – Like, tweet, click • Active – Follower, commenter • Committed – Retweet, repost, share, # • Loyalist- Active comments and involvement
  • 62. Engagement levels • Lurking - A • Casual - A • Active - R • Committed - R • Loyalist - R AARRR!
  • 63. Social Media Analytics • Measuring engagement • Similar and different • Less actionable/less control • Potential for new insight
  • 64. Summary Insights • KPI’s are the building blocks for real insights about customers, products and profits • Iterative testing can help us reach insights more quickly • Social analytics are rapidly becoming a part of the essential mix