SlideShare a Scribd company logo
1 of 19
Mobile A/B Testing: Best Practices,
Pretotyping and Why It's a Good
Alternative to App Prototyping
Lina Danilchik
Marketing Manager Senior ASO consultant
Maggie Ngai
Pretotyping. What is it?
Pretotype is an image that conveys the idea of a product.
Mobile app title, icon, description and screenshots designed to reflect its
setting and features together make up an app’s pretotype.
What can serve as app pretotypes?
How publishers
validate app ideas
via pretotyping
Once you’re ready with your app’s
pretotypes – several versions of app
title, description, icon & screenshots –
proceed to validating your app idea with
the help of a third-party A/B testing
platform.
How mobile A/B
testing works together
with pretotyping
A/B Testing Capabilities for Mobile
App Idea Validation
Test your mobile
app idea
Test mobile game
setting
Compare a few mobile
app concepts
Validate or
prioritize app
features
Decide on targeting
& positioning
Test your app idea
and decide if you
should build it
Compare a few app concepts & select the best
one
Decide on targeting
and positioning
Decide on localization
Feature validation: prioritize your app features
Test mobile game setting
Test mobile game styles and characters
Main metrics to rely
on when running A/B
tests on SplitMetrics
7 Biggest Mistakes in Mobile A/B Testing
Mistake №2
Finishing an experiment before
7 days have passed
Mistake №1
Finishing an experiment before you
get the right amount of traffic
7 Biggest Mistakes in Mobile A/B Testing
Mistake №4
Your banner ads have the same design
as one of the app store visual assets
Mistake №3
Testing too small changes
in design
7 Biggest Mistakes in Mobile A/B Testing
Mistake №5
Testing several hypotheses at once
7 Biggest Mistakes in Mobile A/B Testing
Mistake №6
Misinterpreting the situation when two
variations are the same but you get a
winner
Mistake №7
Getting upset when a new variation
loses to the current one
Thank you!
If you have any questions, feel free to reach out to us on LinkedIn or via email:
lina.d@splitmetrics.com & maggie.ngai@phiture.com

More Related Content

What's hot

Optimizely Partner Ecosystem
Optimizely Partner EcosystemOptimizely Partner Ecosystem
Optimizely Partner EcosystemOptimizely
 
Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough Optimizely
 
VWO Webinar: How To Plan Your Optimisation Roadmap
VWO Webinar: How To Plan Your Optimisation RoadmapVWO Webinar: How To Plan Your Optimisation Roadmap
VWO Webinar: How To Plan Your Optimisation RoadmapVWO
 
Getting Started with Server-Side Testing
Getting Started with Server-Side TestingGetting Started with Server-Side Testing
Getting Started with Server-Side TestingOptimizely
 
7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...
7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...
7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...Optimizely
 
The anatomy of an A/B Test - JSConf Colombia Workshop
The anatomy of an A/B Test - JSConf Colombia WorkshopThe anatomy of an A/B Test - JSConf Colombia Workshop
The anatomy of an A/B Test - JSConf Colombia WorkshopEduardo Shiota Yasuda
 
MAU Vegas 2016 — How to Build an Internal Growth Culture
MAU Vegas 2016 — How to Build an Internal Growth CultureMAU Vegas 2016 — How to Build an Internal Growth Culture
MAU Vegas 2016 — How to Build an Internal Growth CultureGrow.co
 
Ahead of the Curve: How 23andMe Improved UX with Performance Edge
Ahead of the Curve: How 23andMe Improved UX with Performance EdgeAhead of the Curve: How 23andMe Improved UX with Performance Edge
Ahead of the Curve: How 23andMe Improved UX with Performance EdgeOptimizely
 
Test for Success: A Guide to A/B Testing on Emails & Landing Pages
Test for Success: A Guide to A/B Testing on Emails & Landing PagesTest for Success: A Guide to A/B Testing on Emails & Landing Pages
Test for Success: A Guide to A/B Testing on Emails & Landing PagesOptimizely
 
Optimizely X Seminar Amsterdam Nov 10
Optimizely X Seminar Amsterdam Nov 10Optimizely X Seminar Amsterdam Nov 10
Optimizely X Seminar Amsterdam Nov 10Optimizely
 
Preparing for a Website Redesign | SEO Design
Preparing for a Website Redesign | SEO DesignPreparing for a Website Redesign | SEO Design
Preparing for a Website Redesign | SEO DesignRaven Tools
 
Retain or Die: The Retention Playbook
Retain or Die: The Retention PlaybookRetain or Die: The Retention Playbook
Retain or Die: The Retention PlaybookOptimizely
 
Product Analytics 101 by Pendo VP of Products
Product Analytics 101 by Pendo VP of ProductsProduct Analytics 101 by Pendo VP of Products
Product Analytics 101 by Pendo VP of ProductsProduct School
 
How To Launch A Product No Matter Where You Work By PM From American Express
How To Launch A Product No Matter Where You Work By PM From American ExpressHow To Launch A Product No Matter Where You Work By PM From American Express
How To Launch A Product No Matter Where You Work By PM From American ExpressProduct School
 
MAU Vegas 2016 — Tackling Retention During Activation
MAU Vegas 2016 — Tackling Retention During ActivationMAU Vegas 2016 — Tackling Retention During Activation
MAU Vegas 2016 — Tackling Retention During ActivationGrow.co
 
Optimizely Experience - LA - Disney-ABC
Optimizely Experience - LA - Disney-ABCOptimizely Experience - LA - Disney-ABC
Optimizely Experience - LA - Disney-ABCOptimizely
 
4 Steps Toward Scientific A/B Testing
4 Steps Toward Scientific A/B Testing4 Steps Toward Scientific A/B Testing
4 Steps Toward Scientific A/B TestingJanessa Lantz
 
Workshop 6: Build Your Organization's Optimization Culture
Workshop 6: Build Your Organization's Optimization CultureWorkshop 6: Build Your Organization's Optimization Culture
Workshop 6: Build Your Organization's Optimization CultureOptimizely
 
Website Redesigns: Why they Fail and How to Ensure Success
Website Redesigns: Why they Fail and How to Ensure SuccessWebsite Redesigns: Why they Fail and How to Ensure Success
Website Redesigns: Why they Fail and How to Ensure SuccessOptimizely
 
Cox Automotive: Testing Across Multiple Brands
Cox Automotive: Testing Across Multiple BrandsCox Automotive: Testing Across Multiple Brands
Cox Automotive: Testing Across Multiple BrandsOptimizely
 

What's hot (20)

Optimizely Partner Ecosystem
Optimizely Partner EcosystemOptimizely Partner Ecosystem
Optimizely Partner Ecosystem
 
Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough
 
VWO Webinar: How To Plan Your Optimisation Roadmap
VWO Webinar: How To Plan Your Optimisation RoadmapVWO Webinar: How To Plan Your Optimisation Roadmap
VWO Webinar: How To Plan Your Optimisation Roadmap
 
Getting Started with Server-Side Testing
Getting Started with Server-Side TestingGetting Started with Server-Side Testing
Getting Started with Server-Side Testing
 
7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...
7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...
7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...
 
The anatomy of an A/B Test - JSConf Colombia Workshop
The anatomy of an A/B Test - JSConf Colombia WorkshopThe anatomy of an A/B Test - JSConf Colombia Workshop
The anatomy of an A/B Test - JSConf Colombia Workshop
 
MAU Vegas 2016 — How to Build an Internal Growth Culture
MAU Vegas 2016 — How to Build an Internal Growth CultureMAU Vegas 2016 — How to Build an Internal Growth Culture
MAU Vegas 2016 — How to Build an Internal Growth Culture
 
Ahead of the Curve: How 23andMe Improved UX with Performance Edge
Ahead of the Curve: How 23andMe Improved UX with Performance EdgeAhead of the Curve: How 23andMe Improved UX with Performance Edge
Ahead of the Curve: How 23andMe Improved UX with Performance Edge
 
Test for Success: A Guide to A/B Testing on Emails & Landing Pages
Test for Success: A Guide to A/B Testing on Emails & Landing PagesTest for Success: A Guide to A/B Testing on Emails & Landing Pages
Test for Success: A Guide to A/B Testing on Emails & Landing Pages
 
Optimizely X Seminar Amsterdam Nov 10
Optimizely X Seminar Amsterdam Nov 10Optimizely X Seminar Amsterdam Nov 10
Optimizely X Seminar Amsterdam Nov 10
 
Preparing for a Website Redesign | SEO Design
Preparing for a Website Redesign | SEO DesignPreparing for a Website Redesign | SEO Design
Preparing for a Website Redesign | SEO Design
 
Retain or Die: The Retention Playbook
Retain or Die: The Retention PlaybookRetain or Die: The Retention Playbook
Retain or Die: The Retention Playbook
 
Product Analytics 101 by Pendo VP of Products
Product Analytics 101 by Pendo VP of ProductsProduct Analytics 101 by Pendo VP of Products
Product Analytics 101 by Pendo VP of Products
 
How To Launch A Product No Matter Where You Work By PM From American Express
How To Launch A Product No Matter Where You Work By PM From American ExpressHow To Launch A Product No Matter Where You Work By PM From American Express
How To Launch A Product No Matter Where You Work By PM From American Express
 
MAU Vegas 2016 — Tackling Retention During Activation
MAU Vegas 2016 — Tackling Retention During ActivationMAU Vegas 2016 — Tackling Retention During Activation
MAU Vegas 2016 — Tackling Retention During Activation
 
Optimizely Experience - LA - Disney-ABC
Optimizely Experience - LA - Disney-ABCOptimizely Experience - LA - Disney-ABC
Optimizely Experience - LA - Disney-ABC
 
4 Steps Toward Scientific A/B Testing
4 Steps Toward Scientific A/B Testing4 Steps Toward Scientific A/B Testing
4 Steps Toward Scientific A/B Testing
 
Workshop 6: Build Your Organization's Optimization Culture
Workshop 6: Build Your Organization's Optimization CultureWorkshop 6: Build Your Organization's Optimization Culture
Workshop 6: Build Your Organization's Optimization Culture
 
Website Redesigns: Why they Fail and How to Ensure Success
Website Redesigns: Why they Fail and How to Ensure SuccessWebsite Redesigns: Why they Fail and How to Ensure Success
Website Redesigns: Why they Fail and How to Ensure Success
 
Cox Automotive: Testing Across Multiple Brands
Cox Automotive: Testing Across Multiple BrandsCox Automotive: Testing Across Multiple Brands
Cox Automotive: Testing Across Multiple Brands
 

Similar to Mobile A/B Testing Best Practices for App Idea Validation by SplitMetrics and Phiture

Mob4Hire Mobile App Usability (MobExperience) Overview
Mob4Hire Mobile App Usability (MobExperience) OverviewMob4Hire Mobile App Usability (MobExperience) Overview
Mob4Hire Mobile App Usability (MobExperience) OverviewStephen King
 
Mobile Usability Overview
Mobile Usability OverviewMobile Usability Overview
Mobile Usability Overviewrsimiele
 
Mobile App Development Proposal Template PowerPoint Presentation Slides
Mobile App Development Proposal Template PowerPoint Presentation SlidesMobile App Development Proposal Template PowerPoint Presentation Slides
Mobile App Development Proposal Template PowerPoint Presentation SlidesSlideTeam
 
A Guide for Anyone Who Wants to Turn App Development Idea into Reality
A Guide for Anyone Who Wants to Turn App Development Idea into RealityA Guide for Anyone Who Wants to Turn App Development Idea into Reality
A Guide for Anyone Who Wants to Turn App Development Idea into RealityIndianAppDevelopers
 
Are you a lean mobile startup? Applying lean startup principles to mobile app...
Are you a lean mobile startup? Applying lean startup principles to mobile app...Are you a lean mobile startup? Applying lean startup principles to mobile app...
Are you a lean mobile startup? Applying lean startup principles to mobile app...Aravind Krishnaswamy
 
Competitive analysis for mobile apps.pptx
Competitive analysis for mobile apps.pptxCompetitive analysis for mobile apps.pptx
Competitive analysis for mobile apps.pptxComboApp, Inc
 
Industry Experts on How to Build Really Good Mobile Application
Industry Experts on How to Build Really Good Mobile ApplicationIndustry Experts on How to Build Really Good Mobile Application
Industry Experts on How to Build Really Good Mobile ApplicationIndianAppDevelopers
 
One-Pager: App Intelligence
One-Pager: App IntelligenceOne-Pager: App Intelligence
One-Pager: App IntelligenceWes McCabe
 
Benefits & Best Practices to Develop Minimum Viable Product For Startups
Benefits & Best Practices to Develop Minimum Viable Product For StartupsBenefits & Best Practices to Develop Minimum Viable Product For Startups
Benefits & Best Practices to Develop Minimum Viable Product For StartupsRosalie Lauren
 
Top 10 questions to answer before you hire mobile app developers
Top 10 questions to answer before you hire mobile app developersTop 10 questions to answer before you hire mobile app developers
Top 10 questions to answer before you hire mobile app developersInnofied Solution
 
Top 10 questions to answer before you hire mobile app developers
Top 10 questions to answer before you hire mobile app developersTop 10 questions to answer before you hire mobile app developers
Top 10 questions to answer before you hire mobile app developersSwarnendu De
 
Testing Mobile Apps
Testing Mobile AppsTesting Mobile Apps
Testing Mobile AppsSuresh Kumar
 
10 stages of mobile app development process 2022
10 stages of mobile app development process 202210 stages of mobile app development process 2022
10 stages of mobile app development process 2022SynapseIndia
 
PhoenixGMN - How To Go About An App Idea - Guide by SuperHitApps.com
PhoenixGMN - How To Go About An App Idea - Guide by SuperHitApps.comPhoenixGMN - How To Go About An App Idea - Guide by SuperHitApps.com
PhoenixGMN - How To Go About An App Idea - Guide by SuperHitApps.comPhoenixGMN WebAndAppsDevelopment
 
7 Factors to Consider While Developing Mobile Apps
7 Factors to Consider While Developing Mobile Apps7 Factors to Consider While Developing Mobile Apps
7 Factors to Consider While Developing Mobile Apps99tests
 
How much does it cost to develop an app? - The million dollar question
How much does it cost to develop an app? - The million dollar questionHow much does it cost to develop an app? - The million dollar question
How much does it cost to develop an app? - The million dollar questionNew Generation Applications
 
App Testing Tools and Frameworks A Comparative Analysis.pdf
App Testing Tools and Frameworks A Comparative Analysis.pdfApp Testing Tools and Frameworks A Comparative Analysis.pdf
App Testing Tools and Frameworks A Comparative Analysis.pdflubnayasminsebl
 
7 mobile app usability testing best practices by UserTesting
7 mobile app usability testing best practices by UserTesting7 mobile app usability testing best practices by UserTesting
7 mobile app usability testing best practices by UserTestingUserTesting
 

Similar to Mobile A/B Testing Best Practices for App Idea Validation by SplitMetrics and Phiture (20)

Mob4Hire Mobile App Usability (MobExperience) Overview
Mob4Hire Mobile App Usability (MobExperience) OverviewMob4Hire Mobile App Usability (MobExperience) Overview
Mob4Hire Mobile App Usability (MobExperience) Overview
 
Mobile Usability Overview
Mobile Usability OverviewMobile Usability Overview
Mobile Usability Overview
 
Mobile App Development Proposal Template PowerPoint Presentation Slides
Mobile App Development Proposal Template PowerPoint Presentation SlidesMobile App Development Proposal Template PowerPoint Presentation Slides
Mobile App Development Proposal Template PowerPoint Presentation Slides
 
Apps are destroyed in these ways....
Apps are destroyed in these ways....Apps are destroyed in these ways....
Apps are destroyed in these ways....
 
A Guide for Anyone Who Wants to Turn App Development Idea into Reality
A Guide for Anyone Who Wants to Turn App Development Idea into RealityA Guide for Anyone Who Wants to Turn App Development Idea into Reality
A Guide for Anyone Who Wants to Turn App Development Idea into Reality
 
Are you a lean mobile startup? Applying lean startup principles to mobile app...
Are you a lean mobile startup? Applying lean startup principles to mobile app...Are you a lean mobile startup? Applying lean startup principles to mobile app...
Are you a lean mobile startup? Applying lean startup principles to mobile app...
 
Competitive analysis for mobile apps.pptx
Competitive analysis for mobile apps.pptxCompetitive analysis for mobile apps.pptx
Competitive analysis for mobile apps.pptx
 
Industry Experts on How to Build Really Good Mobile Application
Industry Experts on How to Build Really Good Mobile ApplicationIndustry Experts on How to Build Really Good Mobile Application
Industry Experts on How to Build Really Good Mobile Application
 
One-Pager: App Intelligence
One-Pager: App IntelligenceOne-Pager: App Intelligence
One-Pager: App Intelligence
 
Benefits & Best Practices to Develop Minimum Viable Product For Startups
Benefits & Best Practices to Develop Minimum Viable Product For StartupsBenefits & Best Practices to Develop Minimum Viable Product For Startups
Benefits & Best Practices to Develop Minimum Viable Product For Startups
 
Top 10 questions to answer before you hire mobile app developers
Top 10 questions to answer before you hire mobile app developersTop 10 questions to answer before you hire mobile app developers
Top 10 questions to answer before you hire mobile app developers
 
Top 10 questions to answer before you hire mobile app developers
Top 10 questions to answer before you hire mobile app developersTop 10 questions to answer before you hire mobile app developers
Top 10 questions to answer before you hire mobile app developers
 
Testing Mobile Apps
Testing Mobile AppsTesting Mobile Apps
Testing Mobile Apps
 
10 stages of mobile app development process 2022
10 stages of mobile app development process 202210 stages of mobile app development process 2022
10 stages of mobile app development process 2022
 
Sayanti Mondal CV
Sayanti Mondal CVSayanti Mondal CV
Sayanti Mondal CV
 
PhoenixGMN - How To Go About An App Idea - Guide by SuperHitApps.com
PhoenixGMN - How To Go About An App Idea - Guide by SuperHitApps.comPhoenixGMN - How To Go About An App Idea - Guide by SuperHitApps.com
PhoenixGMN - How To Go About An App Idea - Guide by SuperHitApps.com
 
7 Factors to Consider While Developing Mobile Apps
7 Factors to Consider While Developing Mobile Apps7 Factors to Consider While Developing Mobile Apps
7 Factors to Consider While Developing Mobile Apps
 
How much does it cost to develop an app? - The million dollar question
How much does it cost to develop an app? - The million dollar questionHow much does it cost to develop an app? - The million dollar question
How much does it cost to develop an app? - The million dollar question
 
App Testing Tools and Frameworks A Comparative Analysis.pdf
App Testing Tools and Frameworks A Comparative Analysis.pdfApp Testing Tools and Frameworks A Comparative Analysis.pdf
App Testing Tools and Frameworks A Comparative Analysis.pdf
 
7 mobile app usability testing best practices by UserTesting
7 mobile app usability testing best practices by UserTesting7 mobile app usability testing best practices by UserTesting
7 mobile app usability testing best practices by UserTesting
 

More from SplitMetrics

Conversion optimization with A/B testing throughout app lifecycle
Conversion optimization with A/B testing throughout app lifecycleConversion optimization with A/B testing throughout app lifecycle
Conversion optimization with A/B testing throughout app lifecycleSplitMetrics
 
How to fortify UA strategy with creatives testing
How to fortify UA strategy with creatives testingHow to fortify UA strategy with creatives testing
How to fortify UA strategy with creatives testingSplitMetrics
 
The impact of COVID-19 on Apple Search Ads
The impact of COVID-19 on Apple Search AdsThe impact of COVID-19 on Apple Search Ads
The impact of COVID-19 on Apple Search AdsSplitMetrics
 
Apple Search Ads (RU): advantages, strategies, correlation with ASO
Apple Search Ads (RU): advantages, strategies, correlation with ASOApple Search Ads (RU): advantages, strategies, correlation with ASO
Apple Search Ads (RU): advantages, strategies, correlation with ASOSplitMetrics
 
Apple Search Ads - Keyword expansion with discovery campaigns & Performance b...
Apple Search Ads - Keyword expansion with discovery campaigns & Performance b...Apple Search Ads - Keyword expansion with discovery campaigns & Performance b...
Apple Search Ads - Keyword expansion with discovery campaigns & Performance b...SplitMetrics
 
How to Create High Converting App Previews
How to Create High Converting App PreviewsHow to Create High Converting App Previews
How to Create High Converting App PreviewsSplitMetrics
 
First Look at Apple Search Ads Benchmarks by SearchAdsHQ
First Look at Apple Search Ads Benchmarks by SearchAdsHQFirst Look at Apple Search Ads Benchmarks by SearchAdsHQ
First Look at Apple Search Ads Benchmarks by SearchAdsHQSplitMetrics
 
Apple Search Ads Scaling and Optimization by SearchAdsHQ
Apple Search Ads Scaling and Optimization by SearchAdsHQApple Search Ads Scaling and Optimization by SearchAdsHQ
Apple Search Ads Scaling and Optimization by SearchAdsHQSplitMetrics
 
All You Need to Know About ASA Keywords by AppTweak
All You Need to Know About ASA Keywords by AppTweakAll You Need to Know About ASA Keywords by AppTweak
All You Need to Know About ASA Keywords by AppTweakSplitMetrics
 
Apple Search Ads for Gaming / Non-Gaming by AppsFlyer
Apple Search Ads for Gaming / Non-Gaming by AppsFlyerApple Search Ads for Gaming / Non-Gaming by AppsFlyer
Apple Search Ads for Gaming / Non-Gaming by AppsFlyerSplitMetrics
 
ASA Influence on Organic Ranking by AppTweak
ASA Influence on Organic Ranking by AppTweakASA Influence on Organic Ranking by AppTweak
ASA Influence on Organic Ranking by AppTweakSplitMetrics
 

More from SplitMetrics (11)

Conversion optimization with A/B testing throughout app lifecycle
Conversion optimization with A/B testing throughout app lifecycleConversion optimization with A/B testing throughout app lifecycle
Conversion optimization with A/B testing throughout app lifecycle
 
How to fortify UA strategy with creatives testing
How to fortify UA strategy with creatives testingHow to fortify UA strategy with creatives testing
How to fortify UA strategy with creatives testing
 
The impact of COVID-19 on Apple Search Ads
The impact of COVID-19 on Apple Search AdsThe impact of COVID-19 on Apple Search Ads
The impact of COVID-19 on Apple Search Ads
 
Apple Search Ads (RU): advantages, strategies, correlation with ASO
Apple Search Ads (RU): advantages, strategies, correlation with ASOApple Search Ads (RU): advantages, strategies, correlation with ASO
Apple Search Ads (RU): advantages, strategies, correlation with ASO
 
Apple Search Ads - Keyword expansion with discovery campaigns & Performance b...
Apple Search Ads - Keyword expansion with discovery campaigns & Performance b...Apple Search Ads - Keyword expansion with discovery campaigns & Performance b...
Apple Search Ads - Keyword expansion with discovery campaigns & Performance b...
 
How to Create High Converting App Previews
How to Create High Converting App PreviewsHow to Create High Converting App Previews
How to Create High Converting App Previews
 
First Look at Apple Search Ads Benchmarks by SearchAdsHQ
First Look at Apple Search Ads Benchmarks by SearchAdsHQFirst Look at Apple Search Ads Benchmarks by SearchAdsHQ
First Look at Apple Search Ads Benchmarks by SearchAdsHQ
 
Apple Search Ads Scaling and Optimization by SearchAdsHQ
Apple Search Ads Scaling and Optimization by SearchAdsHQApple Search Ads Scaling and Optimization by SearchAdsHQ
Apple Search Ads Scaling and Optimization by SearchAdsHQ
 
All You Need to Know About ASA Keywords by AppTweak
All You Need to Know About ASA Keywords by AppTweakAll You Need to Know About ASA Keywords by AppTweak
All You Need to Know About ASA Keywords by AppTweak
 
Apple Search Ads for Gaming / Non-Gaming by AppsFlyer
Apple Search Ads for Gaming / Non-Gaming by AppsFlyerApple Search Ads for Gaming / Non-Gaming by AppsFlyer
Apple Search Ads for Gaming / Non-Gaming by AppsFlyer
 
ASA Influence on Organic Ranking by AppTweak
ASA Influence on Organic Ranking by AppTweakASA Influence on Organic Ranking by AppTweak
ASA Influence on Organic Ranking by AppTweak
 

Recently uploaded

Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksSoftradix Technologies
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 

Recently uploaded (20)

Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other Frameworks
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 

Mobile A/B Testing Best Practices for App Idea Validation by SplitMetrics and Phiture

  • 1. Mobile A/B Testing: Best Practices, Pretotyping and Why It's a Good Alternative to App Prototyping Lina Danilchik Marketing Manager Senior ASO consultant Maggie Ngai
  • 2. Pretotyping. What is it? Pretotype is an image that conveys the idea of a product.
  • 3. Mobile app title, icon, description and screenshots designed to reflect its setting and features together make up an app’s pretotype. What can serve as app pretotypes?
  • 4. How publishers validate app ideas via pretotyping Once you’re ready with your app’s pretotypes – several versions of app title, description, icon & screenshots – proceed to validating your app idea with the help of a third-party A/B testing platform.
  • 5. How mobile A/B testing works together with pretotyping
  • 6. A/B Testing Capabilities for Mobile App Idea Validation Test your mobile app idea Test mobile game setting Compare a few mobile app concepts Validate or prioritize app features Decide on targeting & positioning
  • 7. Test your app idea and decide if you should build it
  • 8. Compare a few app concepts & select the best one
  • 11. Feature validation: prioritize your app features
  • 12. Test mobile game setting
  • 13. Test mobile game styles and characters
  • 14. Main metrics to rely on when running A/B tests on SplitMetrics
  • 15. 7 Biggest Mistakes in Mobile A/B Testing Mistake №2 Finishing an experiment before 7 days have passed Mistake №1 Finishing an experiment before you get the right amount of traffic
  • 16. 7 Biggest Mistakes in Mobile A/B Testing Mistake №4 Your banner ads have the same design as one of the app store visual assets Mistake №3 Testing too small changes in design
  • 17. 7 Biggest Mistakes in Mobile A/B Testing Mistake №5 Testing several hypotheses at once
  • 18. 7 Biggest Mistakes in Mobile A/B Testing Mistake №6 Misinterpreting the situation when two variations are the same but you get a winner Mistake №7 Getting upset when a new variation loses to the current one
  • 19. Thank you! If you have any questions, feel free to reach out to us on LinkedIn or via email: lina.d@splitmetrics.com & maggie.ngai@phiture.com