SlideShare uma empresa Scribd logo
1 de 32
Baixar para ler offline
The Hole, Not The Drill: Why Reporting
Should Focus On The Solution
(And Not The Story!)
Mike Sherman & Davina Stanley
September 2021
Sponsors
Communication
Creating Better
Research Reports
The Hole, Not The Drill: Why Reporting
Should Focus On The Solution (And Not
The Story!)
Mike Sherman & Davina Stanley
The Hole, Not The Drill: Why Reporting
Should Focus On The Solution (And Not
The Story!)
1. Clients are not happy! (and we don’t realize it)
2. Reports are too long and lack a clear answer to the
client’s business issues
3. Preparing concise, synthesized reports will improve
client satisfaction as well as your productivity
5
Very
4
3
2
1
0
Not
Very
Market
Research
Human
Resources
Information
Services
Marketing
Finance and
Accounting
How useful is the information?
In The 1990s CEOs Didn’t Value
Market Research
In 2019 Only 30% Of Report Recipients
Rated Reports Very Good or Excellent
7% 6%
28% 26%
32%
28%
23%
28%
7% 8%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Very poor Poor Fair Good Very good Excellent
Source: NewMR “Quality of Market Research Reports” survey, March 2019, “How would you describe the quality of that report?”
n=98
In 2021 The Results Are Similarly Poor
(But Slightly Improved)
Source: NewMR “Quality of Market Research Reports” survey, March 2019 and Summer 2021, “How would you describe the quality of that report?”
n=130
n=98
2019 2021
30% 36%
7% 6%
27% 26%
32%
28%
23%
28%
7% 8%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Very poor Poor Fair Good Very good Excellent
Report Creators Didn’t Recognize The
Problem - 2019
7%
1%
28%
7%
33%
24%
23%
47%
7%
20%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Very poor Poor Fair Good Very good Excellent
Source: NewMR “Quality of Market Research Reports” survey, March 2019, “How would you describe the quality of that report?”
Report Receivers Report Creators
n=382
n=98
37
point
gap
They Still Don’t - 2021
2% 0%
6%
0%
26%
6%
28%
23%
28%
46%
8%
23%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Very poor Poor Fair Good Very good Excellent
33
point
gap
Source: NewMR “Quality of Market Research Reports” survey, summer 2021, “How would you describe the quality of that report?”
Report Receivers Report Creators
n=361
n=130
Gap Exists In Other Industries
20%
4%
56%
44%
24%
49%
0% 3%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Poor Good Very Good Outstanding
Source: Clarity Client Survey, summer 2021“How would you describe the quality of that report?”
n=122
n=46
Authors
Audience
28
point
gap
1. Clients are not happy! (and we don’t realize it)
2. Reports are too long and lack a clear answer to the
client’s business issues
3. Preparing concise, synthesized reports will improve
client satisfaction as well as your productivity
The Hole, Not The Drill: Why Reporting
Should Focus On The Solution (And Not
The Story!)
Everybody Agrees What Is
Important
Report Receivers (n=130)
0% 20% 40% 60% 80% 100%
Detailed
Rigorous
Objective
Practical
Concise
Insightful
Report Creators (n=361)
0% 20% 40% 60% 80% 100%
Detailed
Rigorous
Objective
Practical
Concise
Insightful
Source: NewMR “Quality of Market Research Reports” survey, summer 2021, “Which of the following do you think are most important for an ‘Excellent’ report?”
Biology Is Part Of The Problem
2%
of body weight
20%
of calorie burn
So Is The Curse Of Knowledge
3 Bad (But Common) Examples
1. The “War and Peace” Report
2. The Data Drop Report
3. The Agatha Christie Report
“Many researchers are
still uncomfortable with
providing clear, concise
recommendations.”
- Marjolein Van
Nieuwkasteele, former
Head of Insights, Philips,
Research World, April 2005
These Are Long Standing
Problems
Source: Research World, April 2005, pages 13-14
In what ways was the report poor?
• “Presentation was a large 100pp pdf (with typos!) that
didn’t provide easily shareable insights to distribute to
other stakeholders”
• “Too many slides, difficult navigation”
• “Too much info on each page. Too many huge tables”
• “Volume of data presented overwhelmed non research
trained stakeholders”
• “Fantastic work, but likely too long to be truly
accessible”
Reports Are “Too Long” …
Source: NewMR “Quality of Market Research Reports” survey, Summer 2021, “In what ways was the report poor/good?”
REPORT RECEIVERS
In what ways was the report poor?
• “Very dense & difficult to surface the so what?”
• “The recommendations didn’t speak to some of the
key challenges we’re facing as an organization”
• “Overly descriptive of data rather than what we
learned and what the implications are. Structure
followed the questionnaire design rather than a
narrative answering the business questions”
• “Only report the findings but can’t interpret the data”
… And Lack Insights
Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?”
REPORT RECEIVERS
What is most important for making a report
excellent?
• “Answers the business issues”
• “Clearly answers the questions the stakeholders
want answers to”
• “Provocative or has a point of view”
• “Identifies clear action steps, shows patterns, going
beyond just observations”
Clients Want Answers!
Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?”
REPORT RECEIVERS
1. Clients are not happy! (and we don’t realize it)
2. Reports are too long and lack a clear answer to the
client’s business issues
3. Preparing concise, synthesized reports will improve
client satisfaction as well as your productivity
The Hole, Not The Drill: Why
Reporting Should Focus On The
Solution (And Not The Story!)
Provide A Clear Message That Adds Value
Before – 640 words After – 266 words
Focus On Outcomes, Not Inputs
Convey Your Main Insights As An
Elevator Pitch
1. Main issue
2. Hypothesis
3. Next steps
Love it! How Do We Implement It?
Coonawarra Storyboard – Short Deck
What it is
Executive summary: for
a presentation
Where it came from
Tracker Tracker Tracker
E
X
A
M
P
L
E
Make A Strawman For Your Messages Early
90 mins prep
Fast decision
> From 15 hours prep and
no decision to …
> From 90-min. detailed
discussion to …
2 questions
8 minutes
> From red penning multiple
lengthy drafts to …
30-minute briefing
1 quick review
Focus On Both Clarity AND Productivity
There Is An Opportunity To Use Your Time
Envelope Wisely
The old envelope
Key
messages
Materials
Analysis
Time
Your new one
Analysis
Storyline
Communication
materials
Have a complete draft storyline
half way through your time
1. Clients are not happy! (and we don’t realize it)
2. Reports are too long and lack a solution focus.
3. Concise, synthesized reports will improve client
satisfaction.
The Hole, Not The Drill: Why Reporting
Should Focus On The Solution (And Not
The Story!)
Q & A
Ray Poynter
Davina Stanley
Mike Sherman
Sponsors
Communication

Mais conteúdo relacionado

Mais procurados

Communications Measurement presentation
Communications Measurement presentationCommunications Measurement presentation
Communications Measurement presentationspindocbp
 
Monitoring your brand
Monitoring your brandMonitoring your brand
Monitoring your brandRob Howard
 
90-Minute Guru: Communication Strategy
90-Minute Guru: Communication Strategy90-Minute Guru: Communication Strategy
90-Minute Guru: Communication StrategyMer Joyce
 
Social media ROI - Quantify and Justify your Social Media campaign
Social media ROI - Quantify and Justify your Social Media campaignSocial media ROI - Quantify and Justify your Social Media campaign
Social media ROI - Quantify and Justify your Social Media campaignArun Nair
 
Scottish comms network paul njoku - 14 and 15 may 2014
Scottish comms network   paul njoku - 14 and 15 may 2014Scottish comms network   paul njoku - 14 and 15 may 2014
Scottish comms network paul njoku - 14 and 15 may 2014Jane Robson
 
Marketing Plans: The key to reaching your target
Marketing Plans: The key to reaching your targetMarketing Plans: The key to reaching your target
Marketing Plans: The key to reaching your targetJessica Walter
 
Checklist Communication Strategy Development
Checklist Communication Strategy DevelopmentChecklist Communication Strategy Development
Checklist Communication Strategy DevelopmentEwen Le Borgne
 
I Strategy%20 Framework%20 Approach 1
I Strategy%20 Framework%20 Approach 1I Strategy%20 Framework%20 Approach 1
I Strategy%20 Framework%20 Approach 1Ronny Braunstein
 
Developing your Internal Communications Strategy
Developing your Internal Communications StrategyDeveloping your Internal Communications Strategy
Developing your Internal Communications Strategyrozhendley
 
Integrated KPIs. Stats that matter workshop.
Integrated KPIs. Stats that matter workshop.Integrated KPIs. Stats that matter workshop.
Integrated KPIs. Stats that matter workshop.CharityComms
 
The Lean Data Field Guide by Acumen
The Lean Data Field Guide by AcumenThe Lean Data Field Guide by Acumen
The Lean Data Field Guide by AcumenMobile Surveys Inc.
 
Improving Internal Communications
Improving Internal CommunicationsImproving Internal Communications
Improving Internal CommunicationsGranicus
 
Stephanie Marx Presentation
Stephanie Marx PresentationStephanie Marx Presentation
Stephanie Marx PresentationMediabistro
 
Sample Presentation Final
Sample Presentation FinalSample Presentation Final
Sample Presentation FinalDavidGraunke
 
1.3 baer eng why is disseminating important astana november 2009
1.3 baer eng why is disseminating important   astana november 20091.3 baer eng why is disseminating important   astana november 2009
1.3 baer eng why is disseminating important astana november 2009Petteri Baer
 
Simplify, Optimize and Secure every Stakeholder Communication
Simplify, Optimize and Secure every Stakeholder CommunicationSimplify, Optimize and Secure every Stakeholder Communication
Simplify, Optimize and Secure every Stakeholder Communicationmhough
 

Mais procurados (20)

Communications Measurement presentation
Communications Measurement presentationCommunications Measurement presentation
Communications Measurement presentation
 
Monitoring your brand
Monitoring your brandMonitoring your brand
Monitoring your brand
 
90-Minute Guru: Communication Strategy
90-Minute Guru: Communication Strategy90-Minute Guru: Communication Strategy
90-Minute Guru: Communication Strategy
 
Social media ROI - Quantify and Justify your Social Media campaign
Social media ROI - Quantify and Justify your Social Media campaignSocial media ROI - Quantify and Justify your Social Media campaign
Social media ROI - Quantify and Justify your Social Media campaign
 
Scottish comms network paul njoku - 14 and 15 may 2014
Scottish comms network   paul njoku - 14 and 15 may 2014Scottish comms network   paul njoku - 14 and 15 may 2014
Scottish comms network paul njoku - 14 and 15 may 2014
 
Marketing Plans: The key to reaching your target
Marketing Plans: The key to reaching your targetMarketing Plans: The key to reaching your target
Marketing Plans: The key to reaching your target
 
Checklist Communication Strategy Development
Checklist Communication Strategy DevelopmentChecklist Communication Strategy Development
Checklist Communication Strategy Development
 
I Strategy%20 Framework%20 Approach 1
I Strategy%20 Framework%20 Approach 1I Strategy%20 Framework%20 Approach 1
I Strategy%20 Framework%20 Approach 1
 
Developing your Internal Communications Strategy
Developing your Internal Communications StrategyDeveloping your Internal Communications Strategy
Developing your Internal Communications Strategy
 
Integrated KPIs. Stats that matter workshop.
Integrated KPIs. Stats that matter workshop.Integrated KPIs. Stats that matter workshop.
Integrated KPIs. Stats that matter workshop.
 
The Lean Data Field Guide by Acumen
The Lean Data Field Guide by AcumenThe Lean Data Field Guide by Acumen
The Lean Data Field Guide by Acumen
 
Developing a communication strategy
Developing a communication strategyDeveloping a communication strategy
Developing a communication strategy
 
1415 track 2 richardson
1415 track 2 richardson1415 track 2 richardson
1415 track 2 richardson
 
Customer FAQs
Customer FAQsCustomer FAQs
Customer FAQs
 
Improving Internal Communications
Improving Internal CommunicationsImproving Internal Communications
Improving Internal Communications
 
Stephanie Marx Presentation
Stephanie Marx PresentationStephanie Marx Presentation
Stephanie Marx Presentation
 
Sample Presentation Final
Sample Presentation FinalSample Presentation Final
Sample Presentation Final
 
1.3 baer eng why is disseminating important astana november 2009
1.3 baer eng why is disseminating important   astana november 20091.3 baer eng why is disseminating important   astana november 2009
1.3 baer eng why is disseminating important astana november 2009
 
Top tips
Top tipsTop tips
Top tips
 
Simplify, Optimize and Secure every Stakeholder Communication
Simplify, Optimize and Secure every Stakeholder CommunicationSimplify, Optimize and Secure every Stakeholder Communication
Simplify, Optimize and Secure every Stakeholder Communication
 

Semelhante a The Hole, Not The Drill. Why reporting should focus on the solution (and not the story!)

Less is More: Delivering Value (Not Just Reams of Data From Your Research)
Less is More: Delivering Value (Not Just Reams of Data From Your Research)Less is More: Delivering Value (Not Just Reams of Data From Your Research)
Less is More: Delivering Value (Not Just Reams of Data From Your Research)Ray Poynter
 
Meeting customerexpectations - Seredyuk
Meeting customerexpectations - SeredyukMeeting customerexpectations - Seredyuk
Meeting customerexpectations - SeredyukIgor Bronovskyy
 
Lean out your backlog - Lean and Kanban Belgium 2010
Lean out your backlog - Lean and Kanban Belgium 2010Lean out your backlog - Lean and Kanban Belgium 2010
Lean out your backlog - Lean and Kanban Belgium 2010AgileCoach.net
 
Lean out your product backlog with Lean product Development and business anal...
Lean out your product backlog with Lean product Development and business anal...Lean out your product backlog with Lean product Development and business anal...
Lean out your product backlog with Lean product Development and business anal...AGILEMinds
 
Methodology dimension voice of customer
Methodology   dimension voice of customerMethodology   dimension voice of customer
Methodology dimension voice of customerJean-François Nguyen
 
grasp category vantage point 2017
grasp category vantage point 2017grasp category vantage point 2017
grasp category vantage point 2017Robin Norton
 
grasp category vantage point 2017
grasp category vantage point 2017grasp category vantage point 2017
grasp category vantage point 2017Robin Norton
 
Your VoC Programme is underperforming - and you know it Webinar
Your VoC Programme is underperforming - and you know it WebinarYour VoC Programme is underperforming - and you know it Webinar
Your VoC Programme is underperforming - and you know it WebinarFuturelab
 
What do people really think about today’s market research reports?
What do people really think about today’s market research reports?What do people really think about today’s market research reports?
What do people really think about today’s market research reports?Ray Poynter
 
Топ-3 тренда в PR в 2019 году.
Топ-3 тренда в PR в 2019 году.Топ-3 тренда в PR в 2019 году.
Топ-3 тренда в PR в 2019 году.mResearcher
 
The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...
The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...
The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...Frank Strong
 
Questback "Employee engagement and customer experience surveys – two sides of...
Questback "Employee engagement and customer experience surveys – two sides of...Questback "Employee engagement and customer experience surveys – two sides of...
Questback "Employee engagement and customer experience surveys – two sides of...Questback UK
 
Questback "Employee engagement is evolving - are you?"
Questback "Employee engagement is evolving - are you?"Questback "Employee engagement is evolving - are you?"
Questback "Employee engagement is evolving - are you?"Questback UK
 
S.M.A.R.T & F.O.C.U.S Testing - Increasing the value provided by your testing...
S.M.A.R.T & F.O.C.U.S Testing - Increasing the value provided by your testing...S.M.A.R.T & F.O.C.U.S Testing - Increasing the value provided by your testing...
S.M.A.R.T & F.O.C.U.S Testing - Increasing the value provided by your testing...PractiTest
 
Resume Coaching Workshop (Final)
Resume Coaching Workshop (Final)Resume Coaching Workshop (Final)
Resume Coaching Workshop (Final)Steve Urquhart
 
Recruiting Metrics - Strategic and Tactical KPIs for Talent Acquisition
Recruiting Metrics - Strategic and Tactical KPIs for Talent AcquisitionRecruiting Metrics - Strategic and Tactical KPIs for Talent Acquisition
Recruiting Metrics - Strategic and Tactical KPIs for Talent AcquisitionMaia Josebachvili
 
How to Gather Useful, Usable Customer Satisfaction Feedback
How to Gather Useful, Usable Customer Satisfaction FeedbackHow to Gather Useful, Usable Customer Satisfaction Feedback
How to Gather Useful, Usable Customer Satisfaction FeedbackNaomi Karten
 
The Win-Win Strategy for Survey Data Analytics
The Win-Win Strategy for Survey Data AnalyticsThe Win-Win Strategy for Survey Data Analytics
The Win-Win Strategy for Survey Data AnalyticsConvertML. ai
 

Semelhante a The Hole, Not The Drill. Why reporting should focus on the solution (and not the story!) (20)

Less is More: Delivering Value (Not Just Reams of Data From Your Research)
Less is More: Delivering Value (Not Just Reams of Data From Your Research)Less is More: Delivering Value (Not Just Reams of Data From Your Research)
Less is More: Delivering Value (Not Just Reams of Data From Your Research)
 
Meeting customerexpectations - Seredyuk
Meeting customerexpectations - SeredyukMeeting customerexpectations - Seredyuk
Meeting customerexpectations - Seredyuk
 
Lean out your backlog - Lean and Kanban Belgium 2010
Lean out your backlog - Lean and Kanban Belgium 2010Lean out your backlog - Lean and Kanban Belgium 2010
Lean out your backlog - Lean and Kanban Belgium 2010
 
Lean out your product backlog with Lean product Development and business anal...
Lean out your product backlog with Lean product Development and business anal...Lean out your product backlog with Lean product Development and business anal...
Lean out your product backlog with Lean product Development and business anal...
 
Methodology dimension voice of customer
Methodology   dimension voice of customerMethodology   dimension voice of customer
Methodology dimension voice of customer
 
grasp category vantage point 2017
grasp category vantage point 2017grasp category vantage point 2017
grasp category vantage point 2017
 
grasp category vantage point 2017
grasp category vantage point 2017grasp category vantage point 2017
grasp category vantage point 2017
 
Your VoC Programme is underperforming - and you know it Webinar
Your VoC Programme is underperforming - and you know it WebinarYour VoC Programme is underperforming - and you know it Webinar
Your VoC Programme is underperforming - and you know it Webinar
 
What do people really think about today’s market research reports?
What do people really think about today’s market research reports?What do people really think about today’s market research reports?
What do people really think about today’s market research reports?
 
Топ-3 тренда в PR в 2019 году.
Топ-3 тренда в PR в 2019 году.Топ-3 тренда в PR в 2019 году.
Топ-3 тренда в PR в 2019 году.
 
The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...
The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...
The 2019 JOTW Communications Survey | Trends in Corporate Communications and ...
 
Questback "Employee engagement and customer experience surveys – two sides of...
Questback "Employee engagement and customer experience surveys – two sides of...Questback "Employee engagement and customer experience surveys – two sides of...
Questback "Employee engagement and customer experience surveys – two sides of...
 
Questback "Employee engagement is evolving - are you?"
Questback "Employee engagement is evolving - are you?"Questback "Employee engagement is evolving - are you?"
Questback "Employee engagement is evolving - are you?"
 
S.M.A.R.T & F.O.C.U.S Testing - Increasing the value provided by your testing...
S.M.A.R.T & F.O.C.U.S Testing - Increasing the value provided by your testing...S.M.A.R.T & F.O.C.U.S Testing - Increasing the value provided by your testing...
S.M.A.R.T & F.O.C.U.S Testing - Increasing the value provided by your testing...
 
Business Storytelling
Business Storytelling Business Storytelling
Business Storytelling
 
Resume Coaching Workshop (Final)
Resume Coaching Workshop (Final)Resume Coaching Workshop (Final)
Resume Coaching Workshop (Final)
 
Recruiting Metrics - Strategic and Tactical KPIs for Talent Acquisition
Recruiting Metrics - Strategic and Tactical KPIs for Talent AcquisitionRecruiting Metrics - Strategic and Tactical KPIs for Talent Acquisition
Recruiting Metrics - Strategic and Tactical KPIs for Talent Acquisition
 
How to Gather Useful, Usable Customer Satisfaction Feedback
How to Gather Useful, Usable Customer Satisfaction FeedbackHow to Gather Useful, Usable Customer Satisfaction Feedback
How to Gather Useful, Usable Customer Satisfaction Feedback
 
SMPS 2011
SMPS 2011 SMPS 2011
SMPS 2011
 
The Win-Win Strategy for Survey Data Analytics
The Win-Win Strategy for Survey Data AnalyticsThe Win-Win Strategy for Survey Data Analytics
The Win-Win Strategy for Survey Data Analytics
 

Mais de Ray Poynter

The State of AI in Insights and Research 2024: Results and Findings
The State of AI in Insights and Research 2024: Results and FindingsThe State of AI in Insights and Research 2024: Results and Findings
The State of AI in Insights and Research 2024: Results and FindingsRay Poynter
 
ResearchWiseAI - an artificial intelligence driven research data analysis tool
ResearchWiseAI - an artificial intelligence driven research data analysis toolResearchWiseAI - an artificial intelligence driven research data analysis tool
ResearchWiseAI - an artificial intelligence driven research data analysis toolRay Poynter
 
AI-powered interviewing: Best practices from Yasna
AI-powered interviewing: Best practices from YasnaAI-powered interviewing: Best practices from Yasna
AI-powered interviewing: Best practices from YasnaRay Poynter
 
Artificial Intelligence and Qual: The Story So Far
Artificial Intelligence and Qual: The Story So FarArtificial Intelligence and Qual: The Story So Far
Artificial Intelligence and Qual: The Story So FarRay Poynter
 
State of Research Insights in Q1, 2024 from NewMR
State of Research Insights in Q1, 2024 from NewMRState of Research Insights in Q1, 2024 from NewMR
State of Research Insights in Q1, 2024 from NewMRRay Poynter
 
Sudden Death of Beliefs
Sudden Death of BeliefsSudden Death of Beliefs
Sudden Death of BeliefsRay Poynter
 
Uncovering Consumers’ Hidden Narratives
Uncovering Consumers’ Hidden NarrativesUncovering Consumers’ Hidden Narratives
Uncovering Consumers’ Hidden NarrativesRay Poynter
 
Narrative Exploration of New Categories at Mondelēz
Narrative Exploration of New Categories at MondelēzNarrative Exploration of New Categories at Mondelēz
Narrative Exploration of New Categories at MondelēzRay Poynter
 
The Future in Focus
The Future in FocusThe Future in Focus
The Future in FocusRay Poynter
 
The Future in Focus
The Future in FocusThe Future in Focus
The Future in FocusRay Poynter
 
The State of Insights – September 2023
The State of Insights – September 2023The State of Insights – September 2023
The State of Insights – September 2023Ray Poynter
 
Research Thinking in the age of AI
Research Thinking in the age of AIResearch Thinking in the age of AI
Research Thinking in the age of AIRay Poynter
 
How might AI impact Research and Insights over the next two years?
How might AI impact Research and Insights over the next two years?How might AI impact Research and Insights over the next two years?
How might AI impact Research and Insights over the next two years?Ray Poynter
 
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...Ray Poynter
 
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...Ray Poynter
 
Using Generative AI to Assess the Quality of Open-Ended Responses in Surveys
Using Generative AI to Assess the Quality of Open-Ended Responses in SurveysUsing Generative AI to Assess the Quality of Open-Ended Responses in Surveys
Using Generative AI to Assess the Quality of Open-Ended Responses in SurveysRay Poynter
 
Exploring the future of verbatim coding with ChatGPT
Exploring the future of verbatim coding with ChatGPTExploring the future of verbatim coding with ChatGPT
Exploring the future of verbatim coding with ChatGPTRay Poynter
 
Using Generative AI to bring Qualitative Capabilities to Quantitative Surveys
Using Generative AI to bring Qualitative Capabilities to Quantitative SurveysUsing Generative AI to bring Qualitative Capabilities to Quantitative Surveys
Using Generative AI to bring Qualitative Capabilities to Quantitative SurveysRay Poynter
 
How AI / ChatGPT Drives Business Growth
How AI / ChatGPT Drives Business GrowthHow AI / ChatGPT Drives Business Growth
How AI / ChatGPT Drives Business GrowthRay Poynter
 
Tech for tech’s sake? Learnings from experiments with AI in consumer research
Tech for tech’s sake? Learnings from experiments with AI in consumer researchTech for tech’s sake? Learnings from experiments with AI in consumer research
Tech for tech’s sake? Learnings from experiments with AI in consumer researchRay Poynter
 

Mais de Ray Poynter (20)

The State of AI in Insights and Research 2024: Results and Findings
The State of AI in Insights and Research 2024: Results and FindingsThe State of AI in Insights and Research 2024: Results and Findings
The State of AI in Insights and Research 2024: Results and Findings
 
ResearchWiseAI - an artificial intelligence driven research data analysis tool
ResearchWiseAI - an artificial intelligence driven research data analysis toolResearchWiseAI - an artificial intelligence driven research data analysis tool
ResearchWiseAI - an artificial intelligence driven research data analysis tool
 
AI-powered interviewing: Best practices from Yasna
AI-powered interviewing: Best practices from YasnaAI-powered interviewing: Best practices from Yasna
AI-powered interviewing: Best practices from Yasna
 
Artificial Intelligence and Qual: The Story So Far
Artificial Intelligence and Qual: The Story So FarArtificial Intelligence and Qual: The Story So Far
Artificial Intelligence and Qual: The Story So Far
 
State of Research Insights in Q1, 2024 from NewMR
State of Research Insights in Q1, 2024 from NewMRState of Research Insights in Q1, 2024 from NewMR
State of Research Insights in Q1, 2024 from NewMR
 
Sudden Death of Beliefs
Sudden Death of BeliefsSudden Death of Beliefs
Sudden Death of Beliefs
 
Uncovering Consumers’ Hidden Narratives
Uncovering Consumers’ Hidden NarrativesUncovering Consumers’ Hidden Narratives
Uncovering Consumers’ Hidden Narratives
 
Narrative Exploration of New Categories at Mondelēz
Narrative Exploration of New Categories at MondelēzNarrative Exploration of New Categories at Mondelēz
Narrative Exploration of New Categories at Mondelēz
 
The Future in Focus
The Future in FocusThe Future in Focus
The Future in Focus
 
The Future in Focus
The Future in FocusThe Future in Focus
The Future in Focus
 
The State of Insights – September 2023
The State of Insights – September 2023The State of Insights – September 2023
The State of Insights – September 2023
 
Research Thinking in the age of AI
Research Thinking in the age of AIResearch Thinking in the age of AI
Research Thinking in the age of AI
 
How might AI impact Research and Insights over the next two years?
How might AI impact Research and Insights over the next two years?How might AI impact Research and Insights over the next two years?
How might AI impact Research and Insights over the next two years?
 
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
 
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
 
Using Generative AI to Assess the Quality of Open-Ended Responses in Surveys
Using Generative AI to Assess the Quality of Open-Ended Responses in SurveysUsing Generative AI to Assess the Quality of Open-Ended Responses in Surveys
Using Generative AI to Assess the Quality of Open-Ended Responses in Surveys
 
Exploring the future of verbatim coding with ChatGPT
Exploring the future of verbatim coding with ChatGPTExploring the future of verbatim coding with ChatGPT
Exploring the future of verbatim coding with ChatGPT
 
Using Generative AI to bring Qualitative Capabilities to Quantitative Surveys
Using Generative AI to bring Qualitative Capabilities to Quantitative SurveysUsing Generative AI to bring Qualitative Capabilities to Quantitative Surveys
Using Generative AI to bring Qualitative Capabilities to Quantitative Surveys
 
How AI / ChatGPT Drives Business Growth
How AI / ChatGPT Drives Business GrowthHow AI / ChatGPT Drives Business Growth
How AI / ChatGPT Drives Business Growth
 
Tech for tech’s sake? Learnings from experiments with AI in consumer research
Tech for tech’s sake? Learnings from experiments with AI in consumer researchTech for tech’s sake? Learnings from experiments with AI in consumer research
Tech for tech’s sake? Learnings from experiments with AI in consumer research
 

Último

How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSCeline George
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17Celine George
 
Third Battle of Panipat detailed notes.pptx
Third Battle of Panipat detailed notes.pptxThird Battle of Panipat detailed notes.pptx
Third Battle of Panipat detailed notes.pptxAmita Gupta
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxnegromaestrong
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxRamakrishna Reddy Bijjam
 
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxSKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxAmanpreet Kaur
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxVishalSingh1417
 
ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701bronxfugly43
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17Celine George
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.pptRamjanShidvankar
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...christianmathematics
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseAnaAcapella
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxAreebaZafar22
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsTechSoup
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfAdmir Softic
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.MaryamAhmad92
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptxMaritesTamaniVerdade
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introductionMaksud Ahmed
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxVishalSingh1417
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfNirmal Dwivedi
 

Último (20)

How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 
Third Battle of Panipat detailed notes.pptx
Third Battle of Panipat detailed notes.pptxThird Battle of Panipat detailed notes.pptx
Third Battle of Panipat detailed notes.pptx
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxSKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptx
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 

The Hole, Not The Drill. Why reporting should focus on the solution (and not the story!)

  • 1. The Hole, Not The Drill: Why Reporting Should Focus On The Solution (And Not The Story!) Mike Sherman & Davina Stanley September 2021
  • 3. Creating Better Research Reports The Hole, Not The Drill: Why Reporting Should Focus On The Solution (And Not The Story!) Mike Sherman & Davina Stanley
  • 4. The Hole, Not The Drill: Why Reporting Should Focus On The Solution (And Not The Story!) 1. Clients are not happy! (and we don’t realize it) 2. Reports are too long and lack a clear answer to the client’s business issues 3. Preparing concise, synthesized reports will improve client satisfaction as well as your productivity
  • 6. In 2019 Only 30% Of Report Recipients Rated Reports Very Good or Excellent 7% 6% 28% 26% 32% 28% 23% 28% 7% 8% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Very poor Poor Fair Good Very good Excellent Source: NewMR “Quality of Market Research Reports” survey, March 2019, “How would you describe the quality of that report?” n=98
  • 7. In 2021 The Results Are Similarly Poor (But Slightly Improved) Source: NewMR “Quality of Market Research Reports” survey, March 2019 and Summer 2021, “How would you describe the quality of that report?” n=130 n=98 2019 2021 30% 36% 7% 6% 27% 26% 32% 28% 23% 28% 7% 8% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Very poor Poor Fair Good Very good Excellent
  • 8. Report Creators Didn’t Recognize The Problem - 2019 7% 1% 28% 7% 33% 24% 23% 47% 7% 20% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Very poor Poor Fair Good Very good Excellent Source: NewMR “Quality of Market Research Reports” survey, March 2019, “How would you describe the quality of that report?” Report Receivers Report Creators n=382 n=98 37 point gap
  • 9. They Still Don’t - 2021 2% 0% 6% 0% 26% 6% 28% 23% 28% 46% 8% 23% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Very poor Poor Fair Good Very good Excellent 33 point gap Source: NewMR “Quality of Market Research Reports” survey, summer 2021, “How would you describe the quality of that report?” Report Receivers Report Creators n=361 n=130
  • 10. Gap Exists In Other Industries 20% 4% 56% 44% 24% 49% 0% 3% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Poor Good Very Good Outstanding Source: Clarity Client Survey, summer 2021“How would you describe the quality of that report?” n=122 n=46 Authors Audience 28 point gap
  • 11. 1. Clients are not happy! (and we don’t realize it) 2. Reports are too long and lack a clear answer to the client’s business issues 3. Preparing concise, synthesized reports will improve client satisfaction as well as your productivity The Hole, Not The Drill: Why Reporting Should Focus On The Solution (And Not The Story!)
  • 12. Everybody Agrees What Is Important Report Receivers (n=130) 0% 20% 40% 60% 80% 100% Detailed Rigorous Objective Practical Concise Insightful Report Creators (n=361) 0% 20% 40% 60% 80% 100% Detailed Rigorous Objective Practical Concise Insightful Source: NewMR “Quality of Market Research Reports” survey, summer 2021, “Which of the following do you think are most important for an ‘Excellent’ report?”
  • 13. Biology Is Part Of The Problem 2% of body weight 20% of calorie burn
  • 14. So Is The Curse Of Knowledge
  • 15. 3 Bad (But Common) Examples 1. The “War and Peace” Report 2. The Data Drop Report 3. The Agatha Christie Report
  • 16. “Many researchers are still uncomfortable with providing clear, concise recommendations.” - Marjolein Van Nieuwkasteele, former Head of Insights, Philips, Research World, April 2005 These Are Long Standing Problems Source: Research World, April 2005, pages 13-14
  • 17. In what ways was the report poor? • “Presentation was a large 100pp pdf (with typos!) that didn’t provide easily shareable insights to distribute to other stakeholders” • “Too many slides, difficult navigation” • “Too much info on each page. Too many huge tables” • “Volume of data presented overwhelmed non research trained stakeholders” • “Fantastic work, but likely too long to be truly accessible” Reports Are “Too Long” … Source: NewMR “Quality of Market Research Reports” survey, Summer 2021, “In what ways was the report poor/good?” REPORT RECEIVERS
  • 18. In what ways was the report poor? • “Very dense & difficult to surface the so what?” • “The recommendations didn’t speak to some of the key challenges we’re facing as an organization” • “Overly descriptive of data rather than what we learned and what the implications are. Structure followed the questionnaire design rather than a narrative answering the business questions” • “Only report the findings but can’t interpret the data” … And Lack Insights Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?” REPORT RECEIVERS
  • 19. What is most important for making a report excellent? • “Answers the business issues” • “Clearly answers the questions the stakeholders want answers to” • “Provocative or has a point of view” • “Identifies clear action steps, shows patterns, going beyond just observations” Clients Want Answers! Source: NewMR “Quality of Market Research Reports” survey, March 2019, “In what ways was the report poor/good?” REPORT RECEIVERS
  • 20. 1. Clients are not happy! (and we don’t realize it) 2. Reports are too long and lack a clear answer to the client’s business issues 3. Preparing concise, synthesized reports will improve client satisfaction as well as your productivity The Hole, Not The Drill: Why Reporting Should Focus On The Solution (And Not The Story!)
  • 21. Provide A Clear Message That Adds Value Before – 640 words After – 266 words
  • 22. Focus On Outcomes, Not Inputs
  • 23. Convey Your Main Insights As An Elevator Pitch 1. Main issue 2. Hypothesis 3. Next steps
  • 24. Love it! How Do We Implement It?
  • 25. Coonawarra Storyboard – Short Deck What it is Executive summary: for a presentation Where it came from Tracker Tracker Tracker E X A M P L E
  • 26. Make A Strawman For Your Messages Early
  • 27. 90 mins prep Fast decision > From 15 hours prep and no decision to … > From 90-min. detailed discussion to … 2 questions 8 minutes > From red penning multiple lengthy drafts to … 30-minute briefing 1 quick review Focus On Both Clarity AND Productivity
  • 28. There Is An Opportunity To Use Your Time Envelope Wisely The old envelope Key messages Materials Analysis Time Your new one Analysis Storyline Communication materials Have a complete draft storyline half way through your time
  • 29. 1. Clients are not happy! (and we don’t realize it) 2. Reports are too long and lack a solution focus. 3. Concise, synthesized reports will improve client satisfaction. The Hole, Not The Drill: Why Reporting Should Focus On The Solution (And Not The Story!)
  • 30.
  • 31. Q & A Ray Poynter Davina Stanley Mike Sherman