SlideShare uma empresa Scribd logo
1 de 29
You’re Not Getting
What You Paid For
September 2017
Augustine Fou, PhD.
acfou [at] mktsci.com
212. 203 .7239
Marketers run their
own ROI experiments
September 2017 / Page 2marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Chase: 99% reach had no impact
“JPMorgan had already decided
last year to oversee its own
programmatic buying operation.
Advertisements for JPMorgan
Chase were appearing on about
400,000 websites a month. [But]
only 12,000, or 3 percent, led to
activity beyond an impression.
[Then, Chase] limited its display
ads to about 5,000 websites. We
haven’t seen any deterioration on
our performance metrics,” Ms.
Lemkau said.”
“99% reduction in ‘reach’ … Same Results.”
Source: NYTimes, March 29, 2017
(because it wasn’t real, human reach)
September 2017 / Page 3marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
P&G: $140M in digital, no impact
“Procter & Gamble's concerns
about where its ads were
showing up online contributed
to a $140 million cutback in
the company's digital ad
spending last quarter, the
company said Thursday. That
helped the world's biggest
advertiser beat earnings
expectations. Perhaps even
more noteworthy, however,
organic sales outperformed
both analyst forecasts and key
rivals at 2% growth despite
the drop in ad support.
Source: AdAge, July 2017
September 2017 / Page 4marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Restoration Hardware: cut all keywords
“[W]e’ve found out that 98%
of our business was coming
from 22 words. So, wait, we’re
buying 3,200 words and 98%
of the business is coming from
22 words. What are the 22
words? And they said, well, it’s
the word Restoration
Hardware and the 21 ways to
spell it wrong, okay?
Immediately the next day, we
cancelled all the words,
including our own name.”
Source: BusinessInsider, Sept 2017
September 2017 / Page 5marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Uber Sues Mobile Agency for Ad Fraud
“Between 2015 and the first quarter of 2017,
Uber paid more than $82.5 million for
the ad effort coordinated by Fetch, court
documents show.
Uber alleges to have found… a Fetch
transparency report that showed the number of
weekly reported clicks on Uber ads on one
website was nearly equal to the site’s monthly
active users.
Uber was spending millions of dollars a week on
mobile ad inventory that was “purportedly
attributable to hundreds of thousands (even
millions) of Uber App installs per week,”
according to the complaint. However, when the
mobile ad effort was suspended, Uber said it
saw “no material drop in total installations.”
Source: WSJ, Sept 2017
If you don’t have 100%
measurement or very detailed
reports… you’re NOT
getting what you paid for.
September 2017 / Page 7marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Thought you bought ESPN? Nope
publisherA.com
ALL fake inventory because, PublisherA
does NOT sell any ads on any exchanges!
“Fake sites must pretend to be mainstream
ones in order to sell inventory.”
September 2017 / Page 8marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Thought you bought reach? Nope
$1 CPM
Top 10 sites = 66% of imps
$5 CPM
Top 10 sites = 74% of imps
$0.50 CPM
Top 5 sites = 100% of imps
$10 CPM
Top 10 sites = 71% of imps
Majority of your ads ran on 5-10 sites/apps
September 2017 / Page 9marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
In daily reports, you wont notice…
Most of budget wasted
between 12a – 4a; to bots
98% impressions blown
in 1st hour (12a-1a)
HOURLY CHART
September 2017 / Page 10marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Fraud filters don’t reduce fraud
1. Fraud filters are no better
than manual blacklists
2. In some cases it’s worse
when filter is on
3. Using fraud filters adds 20
– 24% to costs; manual
blacklists are free
September 2017 / Page 11marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Paid extra for geotargeting, but it’s faked
Not Normal – in both campaigns
1. 100% mobile apps; 100% Android; same top 15 apps in both markets
2. 100% of impressions generated between 4a – 5a local time
3. 100% fake devices; 15 unique devices generated top 95% impressions
4. 100% data center traffic, randomized through residential proxies
September 2017 / Page 12marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Paid extra for targeting, but didn’t work
“Verified Bots” “Verified Humans”
“Fraud-free Apps”Control: No Targeting
+$0.25 data CPM
+$0.25 data CPM+$0.25 data CPM
September 2017 / Page 13marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Targeting recent purchasers, didn’t work
“Frequent Buyers” “Heavy Buyers”
“Recent Purchaser - Books”Control: No Targeting
+$1.00 data CPM
+$1.00 data CPM+$1.75 data CPM
September 2017 / Page 14marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
90-99% of geolocation bad or faked
Source: Placed
Source: SafeGraph
September 2017 / Page 15marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
9% of apps caused 80% of fake impressions
1 (52% of impressions) 2 (48% of impr)
66% avg fraud
18% avg fraud
1. 9% of the apps caused 52% of impressions; 66% outright fraud
2. Remaining 91% of apps caused 48% of impressions, 18% outright fraud
September 2017 / Page 16marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
3 bad apps eat 75% of mobile budget
com.jiubang com.flashlight com.latininput
75% of the
dark red
September 2017 / Page 17marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
34 Mobile Networks >50% Fraud
Source: June 2017, Tune
average 20% fraud
100% fraud
> 50% fraud
September 2017 / Page 18marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Some ads are called without webpages
“Naked ad calls” are ad impressions served without webpages
Context and Sizing
September 2017 / Page 20marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Fraud on such a massive scale…
May 26 Forbes “Judy Malware”
• 40 bad apps to load ads
• 36 million fake devices to load
bad apps
• e.g. 30 ads per device /minute
• 30 ads per minute = 1 billion
fraud impressions per minute
June 1 Checkpoint “Fireball”
• 250 million infected computers
• primary use = traffic for ad
fraud
• 4 ads /pageview (2s load time)
• fraudulent impressions at the
rate of 30 billion per minute
September 2017 / Page 21marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Fraud diverts ad spend to fraudsters
Good Publishers “sites that carry ads”
• No content
• Few humans
• Low CPMS
$40 Search Spend Display Spend $40
$21$30
$3
Google Search FB+Google Display
$29
(outside Google/Facebook)
$83 Digital Spend Source: eMarketer March 2017
47%
programmatic
September 2017 / Page 22marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
$29
(outside Google/Facebook)
There’s 160X more “sites with ads”
Good Publishers “sites with ads”
Source: Verisign, Q4 2016
329M
domains
est. 164 million
“sites that carry ads”
“sites you’ve heard of”
WSJ
ESPN
NYTimes
Economist
Reuters
Elle
3%
no ads
carry ads
160X more
47%
programmatic
est. 1 million
September 2017 / Page 23marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
700X more
There’s 700X more fake apps
7M
apps
Source: Statista, March 2017
6.99 million
96% “apps that carry ads”
10,000
“apps you’ve heard of”
Facebook
Spotify
Pandora
Zynga
Pokemon
YouTube
$29
(outside Google/Facebook)
47%
programmatic
Facebook, 2015
Users use 8 – 15 apps on their
phones.
Spotify, 2016
People have 25 apps on their
phones, use 5-8 regularly
Forrester Research, May 2017
Humans “use 9 apps per day, 30
per month”
September 2017 / Page 24marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Examples of fake sites, fake apps
Fake Sites (10s of millions)
Source: Sadbottrue.com
Fake Apps (millions)
September 2017 / Page 25marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Current detection cannot catch it
In-Ad
(billions of ads)
• Limitations –
tag is in foreign
iframe, cannot look
outside itself
ad tag / pixel
(in-ad measurement)
In-Network
(trillions of bids)
On-Site
(millions of pageviews)
javascript embed
(on-site measurement)
• Limitations –
most detailed
analysis of visitors,
bots still get by
• Limitations –
relies on blacklists
or probabilistic
algorithms, least info
ad
served
bot
human
fraud site
good site
September 2017 / Page 26marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Just because you can’t measure it
100% fraud
> 50% fraud
… doesn’t mean it’s not there.
September 2017 / Page 27marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
About the Author
September 2017
Augustine Fou, PhD.
acfou [@] mktsci.com
212. 203 .7239
September 2017 / Page 28marketing.scienceconsulting group, inc.
linkedin.com/in/augustinefou
Dr. Augustine Fou – Independent Ad Fraud Researcher
2013
2014
Follow me on LinkedIn (click) and on Twitter
@acfou (click)
Further reading:
http://www.slideshare.net/augustinefou/presentations
https://www.linkedin.com/today/author/augustinefou
2016
2015

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

State of Digital Ad Fraud Q2 2017 by Augustine Fou
State of Digital Ad Fraud Q2 2017 by Augustine FouState of Digital Ad Fraud Q2 2017 by Augustine Fou
State of Digital Ad Fraud Q2 2017 by Augustine Fou
 
Display Ad Click Through Rate Benchmarks vs Search Ads
Display Ad Click Through Rate Benchmarks vs Search AdsDisplay Ad Click Through Rate Benchmarks vs Search Ads
Display Ad Click Through Rate Benchmarks vs Search Ads
 
Fraud Detection is Easily Fooled
Fraud Detection is Easily FooledFraud Detection is Easily Fooled
Fraud Detection is Easily Fooled
 
State of Digital Ad Fraud August 2017
State of Digital Ad Fraud August 2017State of Digital Ad Fraud August 2017
State of Digital Ad Fraud August 2017
 
Procurement to Help Fight Ad Fraud
Procurement to Help Fight Ad FraudProcurement to Help Fight Ad Fraud
Procurement to Help Fight Ad Fraud
 
Mobile Ad Fraud - Betcha Didn't Know
Mobile Ad Fraud - Betcha Didn't KnowMobile Ad Fraud - Betcha Didn't Know
Mobile Ad Fraud - Betcha Didn't Know
 
60 Cents per Dollar Goes to Working Digital Media
60 Cents per Dollar Goes to Working Digital Media60 Cents per Dollar Goes to Working Digital Media
60 Cents per Dollar Goes to Working Digital Media
 
Bots Range in Sophistication
Bots Range in SophisticationBots Range in Sophistication
Bots Range in Sophistication
 
At-Scale Ad Fraud Absorbs Most Digital Dollars
At-Scale Ad Fraud Absorbs Most Digital DollarsAt-Scale Ad Fraud Absorbs Most Digital Dollars
At-Scale Ad Fraud Absorbs Most Digital Dollars
 
Good Publishers Will Save Digital
Good Publishers Will Save DigitalGood Publishers Will Save Digital
Good Publishers Will Save Digital
 
Chase example of reducing reach by 99 percent
Chase example of reducing reach by 99 percentChase example of reducing reach by 99 percent
Chase example of reducing reach by 99 percent
 
January 2018 Ad Blocking Update
January 2018 Ad Blocking UpdateJanuary 2018 Ad Blocking Update
January 2018 Ad Blocking Update
 
June 2017 - Ad Blocking Update
June 2017 - Ad Blocking UpdateJune 2017 - Ad Blocking Update
June 2017 - Ad Blocking Update
 
August 2017 - Naked Ad Calls Study
August 2017 - Naked Ad Calls StudyAugust 2017 - Naked Ad Calls Study
August 2017 - Naked Ad Calls Study
 
Publishers Experiments on Supply Chain Inefficiencies
Publishers Experiments on Supply Chain InefficienciesPublishers Experiments on Supply Chain Inefficiencies
Publishers Experiments on Supply Chain Inefficiencies
 
Most popular browsers mimicked by fraud bots
Most popular browsers mimicked by fraud botsMost popular browsers mimicked by fraud bots
Most popular browsers mimicked by fraud bots
 
Procurement to Help Reduce Ad Fraud
Procurement to Help Reduce Ad FraudProcurement to Help Reduce Ad Fraud
Procurement to Help Reduce Ad Fraud
 
Better Media Means Better Outcomes and ROI Augustine Fou
Better Media Means Better Outcomes and ROI Augustine FouBetter Media Means Better Outcomes and ROI Augustine Fou
Better Media Means Better Outcomes and ROI Augustine Fou
 
Fraud Diverts Ad Spend to Bad Guys
Fraud Diverts Ad Spend to Bad GuysFraud Diverts Ad Spend to Bad Guys
Fraud Diverts Ad Spend to Bad Guys
 
Low-Cost, No-Tech Ways to Fight Fraud vMiMA
Low-Cost, No-Tech Ways to Fight Fraud vMiMALow-Cost, No-Tech Ways to Fight Fraud vMiMA
Low-Cost, No-Tech Ways to Fight Fraud vMiMA
 

Semelhante a You're Not Getting What You Bought

Semelhante a You're Not Getting What You Bought (20)

DMA_PPT_Analytics FINAL Sept 2017
DMA_PPT_Analytics FINAL Sept 2017DMA_PPT_Analytics FINAL Sept 2017
DMA_PPT_Analytics FINAL Sept 2017
 
Context of Fraud in Digital Advertising Ecosystem
Context of Fraud in Digital Advertising EcosystemContext of Fraud in Digital Advertising Ecosystem
Context of Fraud in Digital Advertising Ecosystem
 
Digital Ad Fraud - Betcha Didn't Know
Digital Ad Fraud - Betcha Didn't KnowDigital Ad Fraud - Betcha Didn't Know
Digital Ad Fraud - Betcha Didn't Know
 
How Ad Fraud Impacts Good Publishers
How Ad Fraud Impacts Good PublishersHow Ad Fraud Impacts Good Publishers
How Ad Fraud Impacts Good Publishers
 
Better Media Means Better Outcomes by Augustine Fou
Better Media Means Better Outcomes by Augustine FouBetter Media Means Better Outcomes by Augustine Fou
Better Media Means Better Outcomes by Augustine Fou
 
State of Ad Fraud #RampUp17
State of Ad Fraud #RampUp17State of Ad Fraud #RampUp17
State of Ad Fraud #RampUp17
 
State of digital ad fraud 2017 by augustine fou
State of digital ad fraud 2017 by augustine fouState of digital ad fraud 2017 by augustine fou
State of digital ad fraud 2017 by augustine fou
 
Digital ad fraud impact on class action notice industry
Digital ad fraud impact on class action notice industryDigital ad fraud impact on class action notice industry
Digital ad fraud impact on class action notice industry
 
State of Digital Ad Fraud Q4 2018
State of Digital Ad Fraud Q4 2018State of Digital Ad Fraud Q4 2018
State of Digital Ad Fraud Q4 2018
 
Case Studies of Reducing Bots Fraud by Augustine Fou
Case Studies of Reducing Bots Fraud by Augustine FouCase Studies of Reducing Bots Fraud by Augustine Fou
Case Studies of Reducing Bots Fraud by Augustine Fou
 
Where the Wild Bots are OPSNY June 2016
Where the Wild Bots are OPSNY June 2016Where the Wild Bots are OPSNY June 2016
Where the Wild Bots are OPSNY June 2016
 
History and Impact of Digital Ad Fraud
History and Impact of Digital Ad FraudHistory and Impact of Digital Ad Fraud
History and Impact of Digital Ad Fraud
 
How Brands are Solving Ad Fraud Themselves
How Brands are Solving Ad Fraud ThemselvesHow Brands are Solving Ad Fraud Themselves
How Brands are Solving Ad Fraud Themselves
 
Ad Fraud in Mobile Research by Augustine Fou
Ad Fraud in Mobile Research by Augustine FouAd Fraud in Mobile Research by Augustine Fou
Ad Fraud in Mobile Research by Augustine Fou
 
Good Publishers Will Save Digital Marketing v2019
Good Publishers Will Save Digital Marketing v2019Good Publishers Will Save Digital Marketing v2019
Good Publishers Will Save Digital Marketing v2019
 
Dr. Augustine Fou - The Lowdown on Ad Fraud for Advertisers - Seattle Interac...
Dr. Augustine Fou - The Lowdown on Ad Fraud for Advertisers - Seattle Interac...Dr. Augustine Fou - The Lowdown on Ad Fraud for Advertisers - Seattle Interac...
Dr. Augustine Fou - The Lowdown on Ad Fraud for Advertisers - Seattle Interac...
 
Ad fraud update for publishers Feb 2020
Ad fraud update for publishers Feb 2020Ad fraud update for publishers Feb 2020
Ad fraud update for publishers Feb 2020
 
Mobile display fraud is rampant beyond belief
Mobile display fraud is rampant beyond beliefMobile display fraud is rampant beyond belief
Mobile display fraud is rampant beyond belief
 
Piracy and Ad Fraud - Bad Guys Rip Off Studios Twice
Piracy and Ad Fraud - Bad Guys Rip Off Studios TwicePiracy and Ad Fraud - Bad Guys Rip Off Studios Twice
Piracy and Ad Fraud - Bad Guys Rip Off Studios Twice
 
What The Hell Happened to Good Publishers 1995 2015
What The Hell Happened to Good Publishers 1995 2015What The Hell Happened to Good Publishers 1995 2015
What The Hell Happened to Good Publishers 1995 2015
 

Mais de Dr. Augustine Fou - Independent Ad Fraud Researcher

Mais de Dr. Augustine Fou - Independent Ad Fraud Researcher (20)

Forensic Auditing of Digital Media.pdf
Forensic Auditing of Digital Media.pdfForensic Auditing of Digital Media.pdf
Forensic Auditing of Digital Media.pdf
 
Q1 2022 Update on ad fraud for AMM
Q1 2022 Update on ad fraud for AMMQ1 2022 Update on ad fraud for AMM
Q1 2022 Update on ad fraud for AMM
 
Ad blocking benchmarks q4 2021
Ad blocking benchmarks q4 2021Ad blocking benchmarks q4 2021
Ad blocking benchmarks q4 2021
 
Digital ad dollars trickle down chart
Digital ad dollars trickle down chartDigital ad dollars trickle down chart
Digital ad dollars trickle down chart
 
Still nothing but ad fraud 2021 dr augustine fou
Still nothing but ad fraud 2021 dr augustine fouStill nothing but ad fraud 2021 dr augustine fou
Still nothing but ad fraud 2021 dr augustine fou
 
Bad guys optimize ad fraud efficiency
Bad guys optimize ad fraud efficiencyBad guys optimize ad fraud efficiency
Bad guys optimize ad fraud efficiency
 
Alternative to ANA's end to end supply chain transparency study v final
Alternative to ANA's end to end supply chain transparency study v finalAlternative to ANA's end to end supply chain transparency study v final
Alternative to ANA's end to end supply chain transparency study v final
 
Impact of Loss of 3P Cookies on Publishers' Ad Revenue
Impact of Loss of 3P Cookies on Publishers' Ad RevenueImpact of Loss of 3P Cookies on Publishers' Ad Revenue
Impact of Loss of 3P Cookies on Publishers' Ad Revenue
 
Entire ecosystem supporting ad fraud 2018
Entire ecosystem supporting ad fraud 2018Entire ecosystem supporting ad fraud 2018
Entire ecosystem supporting ad fraud 2018
 
Digital Media Trust Collaborative
Digital Media Trust CollaborativeDigital Media Trust Collaborative
Digital Media Trust Collaborative
 
Programmatic reach analysis 2021
Programmatic reach analysis 2021Programmatic reach analysis 2021
Programmatic reach analysis 2021
 
2021 update on ad fraud brand safety privacy
2021 update on ad fraud brand safety privacy2021 update on ad fraud brand safety privacy
2021 update on ad fraud brand safety privacy
 
Browser and OS Share Jan 2021
Browser and OS Share Jan 2021Browser and OS Share Jan 2021
Browser and OS Share Jan 2021
 
Checking abnormal referrer traffic in google analytics
Checking abnormal referrer traffic in google analyticsChecking abnormal referrer traffic in google analytics
Checking abnormal referrer traffic in google analytics
 
Digital Fraud Viewability Benchmarks Q4 2020
Digital Fraud Viewability Benchmarks Q4 2020Digital Fraud Viewability Benchmarks Q4 2020
Digital Fraud Viewability Benchmarks Q4 2020
 
What CFEs can do about digital ad fraud
What CFEs can do about digital ad fraudWhat CFEs can do about digital ad fraud
What CFEs can do about digital ad fraud
 
Four types of digital ad spend updated august 2020
Four types of digital ad spend updated august 2020Four types of digital ad spend updated august 2020
Four types of digital ad spend updated august 2020
 
How to Use FouAnalytics For Marketers
How to Use FouAnalytics   For MarketersHow to Use FouAnalytics   For Marketers
How to Use FouAnalytics For Marketers
 
FouAnalytics DIY site media analytics fraud detection baked in
FouAnalytics DIY site media analytics fraud detection baked inFouAnalytics DIY site media analytics fraud detection baked in
FouAnalytics DIY site media analytics fraud detection baked in
 
Investigating digital ad fraud spi virtual meeting
Investigating digital ad fraud   spi virtual meetingInvestigating digital ad fraud   spi virtual meeting
Investigating digital ad fraud spi virtual meeting
 

Último

Jual obat aborsi Bandung ( 085657271886 ) Cytote pil telat bulan penggugur ka...
Jual obat aborsi Bandung ( 085657271886 ) Cytote pil telat bulan penggugur ka...Jual obat aborsi Bandung ( 085657271886 ) Cytote pil telat bulan penggugur ka...
Jual obat aborsi Bandung ( 085657271886 ) Cytote pil telat bulan penggugur ka...
Klinik kandungan
 
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
nirzagarg
 
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
Health
 
怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制
怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制
怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制
vexqp
 
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 
Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...
Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...
Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...
gajnagarg
 
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
gajnagarg
 
Reconciling Conflicting Data Curation Actions: Transparency Through Argument...
Reconciling Conflicting Data Curation Actions:  Transparency Through Argument...Reconciling Conflicting Data Curation Actions:  Transparency Through Argument...
Reconciling Conflicting Data Curation Actions: Transparency Through Argument...
Bertram Ludäscher
 
一比一原版(UCD毕业证书)加州大学戴维斯分校毕业证成绩单原件一模一样
一比一原版(UCD毕业证书)加州大学戴维斯分校毕业证成绩单原件一模一样一比一原版(UCD毕业证书)加州大学戴维斯分校毕业证成绩单原件一模一样
一比一原版(UCD毕业证书)加州大学戴维斯分校毕业证成绩单原件一模一样
wsppdmt
 
Cytotec in Jeddah+966572737505) get unwanted pregnancy kit Riyadh
Cytotec in Jeddah+966572737505) get unwanted pregnancy kit RiyadhCytotec in Jeddah+966572737505) get unwanted pregnancy kit Riyadh
Cytotec in Jeddah+966572737505) get unwanted pregnancy kit Riyadh
Abortion pills in Riyadh +966572737505 get cytotec
 
怎样办理圣路易斯大学毕业证(SLU毕业证书)成绩单学校原版复制
怎样办理圣路易斯大学毕业证(SLU毕业证书)成绩单学校原版复制怎样办理圣路易斯大学毕业证(SLU毕业证书)成绩单学校原版复制
怎样办理圣路易斯大学毕业证(SLU毕业证书)成绩单学校原版复制
vexqp
 
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
vexqp
 
PLE-statistics document for primary schs
PLE-statistics document for primary schsPLE-statistics document for primary schs
PLE-statistics document for primary schs
cnajjemba
 
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
nirzagarg
 

Último (20)

Jual obat aborsi Bandung ( 085657271886 ) Cytote pil telat bulan penggugur ka...
Jual obat aborsi Bandung ( 085657271886 ) Cytote pil telat bulan penggugur ka...Jual obat aborsi Bandung ( 085657271886 ) Cytote pil telat bulan penggugur ka...
Jual obat aborsi Bandung ( 085657271886 ) Cytote pil telat bulan penggugur ka...
 
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
 
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
 
怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制
怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制
怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制
 
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...
Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...
Top profile Call Girls In dimapur [ 7014168258 ] Call Me For Genuine Models W...
 
Capstone in Interprofessional Informatic // IMPACT OF COVID 19 ON EDUCATION
Capstone in Interprofessional Informatic  // IMPACT OF COVID 19 ON EDUCATIONCapstone in Interprofessional Informatic  // IMPACT OF COVID 19 ON EDUCATION
Capstone in Interprofessional Informatic // IMPACT OF COVID 19 ON EDUCATION
 
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
 
Harnessing the Power of GenAI for BI and Reporting.pptx
Harnessing the Power of GenAI for BI and Reporting.pptxHarnessing the Power of GenAI for BI and Reporting.pptx
Harnessing the Power of GenAI for BI and Reporting.pptx
 
Aspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - AlmoraAspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - Almora
 
Reconciling Conflicting Data Curation Actions: Transparency Through Argument...
Reconciling Conflicting Data Curation Actions:  Transparency Through Argument...Reconciling Conflicting Data Curation Actions:  Transparency Through Argument...
Reconciling Conflicting Data Curation Actions: Transparency Through Argument...
 
一比一原版(UCD毕业证书)加州大学戴维斯分校毕业证成绩单原件一模一样
一比一原版(UCD毕业证书)加州大学戴维斯分校毕业证成绩单原件一模一样一比一原版(UCD毕业证书)加州大学戴维斯分校毕业证成绩单原件一模一样
一比一原版(UCD毕业证书)加州大学戴维斯分校毕业证成绩单原件一模一样
 
Cytotec in Jeddah+966572737505) get unwanted pregnancy kit Riyadh
Cytotec in Jeddah+966572737505) get unwanted pregnancy kit RiyadhCytotec in Jeddah+966572737505) get unwanted pregnancy kit Riyadh
Cytotec in Jeddah+966572737505) get unwanted pregnancy kit Riyadh
 
Discover Why Less is More in B2B Research
Discover Why Less is More in B2B ResearchDiscover Why Less is More in B2B Research
Discover Why Less is More in B2B Research
 
怎样办理圣路易斯大学毕业证(SLU毕业证书)成绩单学校原版复制
怎样办理圣路易斯大学毕业证(SLU毕业证书)成绩单学校原版复制怎样办理圣路易斯大学毕业证(SLU毕业证书)成绩单学校原版复制
怎样办理圣路易斯大学毕业证(SLU毕业证书)成绩单学校原版复制
 
Sequential and reinforcement learning for demand side management by Margaux B...
Sequential and reinforcement learning for demand side management by Margaux B...Sequential and reinforcement learning for demand side management by Margaux B...
Sequential and reinforcement learning for demand side management by Margaux B...
 
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
 
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
 
PLE-statistics document for primary schs
PLE-statistics document for primary schsPLE-statistics document for primary schs
PLE-statistics document for primary schs
 
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
 

You're Not Getting What You Bought

  • 1. You’re Not Getting What You Paid For September 2017 Augustine Fou, PhD. acfou [at] mktsci.com 212. 203 .7239
  • 2. Marketers run their own ROI experiments
  • 3. September 2017 / Page 2marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Chase: 99% reach had no impact “JPMorgan had already decided last year to oversee its own programmatic buying operation. Advertisements for JPMorgan Chase were appearing on about 400,000 websites a month. [But] only 12,000, or 3 percent, led to activity beyond an impression. [Then, Chase] limited its display ads to about 5,000 websites. We haven’t seen any deterioration on our performance metrics,” Ms. Lemkau said.” “99% reduction in ‘reach’ … Same Results.” Source: NYTimes, March 29, 2017 (because it wasn’t real, human reach)
  • 4. September 2017 / Page 3marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou P&G: $140M in digital, no impact “Procter & Gamble's concerns about where its ads were showing up online contributed to a $140 million cutback in the company's digital ad spending last quarter, the company said Thursday. That helped the world's biggest advertiser beat earnings expectations. Perhaps even more noteworthy, however, organic sales outperformed both analyst forecasts and key rivals at 2% growth despite the drop in ad support. Source: AdAge, July 2017
  • 5. September 2017 / Page 4marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Restoration Hardware: cut all keywords “[W]e’ve found out that 98% of our business was coming from 22 words. So, wait, we’re buying 3,200 words and 98% of the business is coming from 22 words. What are the 22 words? And they said, well, it’s the word Restoration Hardware and the 21 ways to spell it wrong, okay? Immediately the next day, we cancelled all the words, including our own name.” Source: BusinessInsider, Sept 2017
  • 6. September 2017 / Page 5marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Uber Sues Mobile Agency for Ad Fraud “Between 2015 and the first quarter of 2017, Uber paid more than $82.5 million for the ad effort coordinated by Fetch, court documents show. Uber alleges to have found… a Fetch transparency report that showed the number of weekly reported clicks on Uber ads on one website was nearly equal to the site’s monthly active users. Uber was spending millions of dollars a week on mobile ad inventory that was “purportedly attributable to hundreds of thousands (even millions) of Uber App installs per week,” according to the complaint. However, when the mobile ad effort was suspended, Uber said it saw “no material drop in total installations.” Source: WSJ, Sept 2017
  • 7. If you don’t have 100% measurement or very detailed reports… you’re NOT getting what you paid for.
  • 8. September 2017 / Page 7marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Thought you bought ESPN? Nope publisherA.com ALL fake inventory because, PublisherA does NOT sell any ads on any exchanges! “Fake sites must pretend to be mainstream ones in order to sell inventory.”
  • 9. September 2017 / Page 8marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Thought you bought reach? Nope $1 CPM Top 10 sites = 66% of imps $5 CPM Top 10 sites = 74% of imps $0.50 CPM Top 5 sites = 100% of imps $10 CPM Top 10 sites = 71% of imps Majority of your ads ran on 5-10 sites/apps
  • 10. September 2017 / Page 9marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou In daily reports, you wont notice… Most of budget wasted between 12a – 4a; to bots 98% impressions blown in 1st hour (12a-1a) HOURLY CHART
  • 11. September 2017 / Page 10marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Fraud filters don’t reduce fraud 1. Fraud filters are no better than manual blacklists 2. In some cases it’s worse when filter is on 3. Using fraud filters adds 20 – 24% to costs; manual blacklists are free
  • 12. September 2017 / Page 11marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Paid extra for geotargeting, but it’s faked Not Normal – in both campaigns 1. 100% mobile apps; 100% Android; same top 15 apps in both markets 2. 100% of impressions generated between 4a – 5a local time 3. 100% fake devices; 15 unique devices generated top 95% impressions 4. 100% data center traffic, randomized through residential proxies
  • 13. September 2017 / Page 12marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Paid extra for targeting, but didn’t work “Verified Bots” “Verified Humans” “Fraud-free Apps”Control: No Targeting +$0.25 data CPM +$0.25 data CPM+$0.25 data CPM
  • 14. September 2017 / Page 13marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Targeting recent purchasers, didn’t work “Frequent Buyers” “Heavy Buyers” “Recent Purchaser - Books”Control: No Targeting +$1.00 data CPM +$1.00 data CPM+$1.75 data CPM
  • 15. September 2017 / Page 14marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou 90-99% of geolocation bad or faked Source: Placed Source: SafeGraph
  • 16. September 2017 / Page 15marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou 9% of apps caused 80% of fake impressions 1 (52% of impressions) 2 (48% of impr) 66% avg fraud 18% avg fraud 1. 9% of the apps caused 52% of impressions; 66% outright fraud 2. Remaining 91% of apps caused 48% of impressions, 18% outright fraud
  • 17. September 2017 / Page 16marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou 3 bad apps eat 75% of mobile budget com.jiubang com.flashlight com.latininput 75% of the dark red
  • 18. September 2017 / Page 17marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou 34 Mobile Networks >50% Fraud Source: June 2017, Tune average 20% fraud 100% fraud > 50% fraud
  • 19. September 2017 / Page 18marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Some ads are called without webpages “Naked ad calls” are ad impressions served without webpages
  • 21. September 2017 / Page 20marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Fraud on such a massive scale… May 26 Forbes “Judy Malware” • 40 bad apps to load ads • 36 million fake devices to load bad apps • e.g. 30 ads per device /minute • 30 ads per minute = 1 billion fraud impressions per minute June 1 Checkpoint “Fireball” • 250 million infected computers • primary use = traffic for ad fraud • 4 ads /pageview (2s load time) • fraudulent impressions at the rate of 30 billion per minute
  • 22. September 2017 / Page 21marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Fraud diverts ad spend to fraudsters Good Publishers “sites that carry ads” • No content • Few humans • Low CPMS $40 Search Spend Display Spend $40 $21$30 $3 Google Search FB+Google Display $29 (outside Google/Facebook) $83 Digital Spend Source: eMarketer March 2017 47% programmatic
  • 23. September 2017 / Page 22marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou $29 (outside Google/Facebook) There’s 160X more “sites with ads” Good Publishers “sites with ads” Source: Verisign, Q4 2016 329M domains est. 164 million “sites that carry ads” “sites you’ve heard of” WSJ ESPN NYTimes Economist Reuters Elle 3% no ads carry ads 160X more 47% programmatic est. 1 million
  • 24. September 2017 / Page 23marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou 700X more There’s 700X more fake apps 7M apps Source: Statista, March 2017 6.99 million 96% “apps that carry ads” 10,000 “apps you’ve heard of” Facebook Spotify Pandora Zynga Pokemon YouTube $29 (outside Google/Facebook) 47% programmatic Facebook, 2015 Users use 8 – 15 apps on their phones. Spotify, 2016 People have 25 apps on their phones, use 5-8 regularly Forrester Research, May 2017 Humans “use 9 apps per day, 30 per month”
  • 25. September 2017 / Page 24marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Examples of fake sites, fake apps Fake Sites (10s of millions) Source: Sadbottrue.com Fake Apps (millions)
  • 26. September 2017 / Page 25marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Current detection cannot catch it In-Ad (billions of ads) • Limitations – tag is in foreign iframe, cannot look outside itself ad tag / pixel (in-ad measurement) In-Network (trillions of bids) On-Site (millions of pageviews) javascript embed (on-site measurement) • Limitations – most detailed analysis of visitors, bots still get by • Limitations – relies on blacklists or probabilistic algorithms, least info ad served bot human fraud site good site
  • 27. September 2017 / Page 26marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Just because you can’t measure it 100% fraud > 50% fraud … doesn’t mean it’s not there.
  • 28. September 2017 / Page 27marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou About the Author September 2017 Augustine Fou, PhD. acfou [@] mktsci.com 212. 203 .7239
  • 29. September 2017 / Page 28marketing.scienceconsulting group, inc. linkedin.com/in/augustinefou Dr. Augustine Fou – Independent Ad Fraud Researcher 2013 2014 Follow me on LinkedIn (click) and on Twitter @acfou (click) Further reading: http://www.slideshare.net/augustinefou/presentations https://www.linkedin.com/today/author/augustinefou 2016 2015