SlideShare uma empresa Scribd logo
1 de 18
The Power Of The Crowd Mobile Testing for Scale and Global Coverage Sept 30, 2010 John Carpenter PEng, CTO  www.mob4hire.com
“Trism has made $250,000 for its developer, Steve Demeter, in just two month”1 “5 out of 6 app developers will not break even”2 “Joel Comm, whose virtual flatulence app, iFart, was at one point earning him £5,000 every day”3 “[Only] one in 8 - will break even its programming costs in six months of downloads” 2 Wired Magazine.  http://www.wired.com/gadgetlab/2008/09/app-store-is-a/#ixzz0upLJqgzq 3. Telegraph UK. http://www.telegraph.co.uk/technology/apple/5163678/Apples-iPhone-is-a-developers-goldmine.html 2. TomiAhonenhttp://communities-dominate.blogs.com/brands/2010/03/paid-smartphone-apps-half-get-under-1000-downloads-what-does-this-mean.html
Would you buy it?
Don’t Suck–  How do Users Respond to Your App?  Get Sticky–  User Feedback / Customer  Loyalty Starts Here?  What Features Will Go In  The Next Version  Don’t Crash –  Do Your Unit Testing. White Box Testing.
7 years ago developing a mobile application, ...to deploy on 3 carriers for around 3% of phones  [Blister] says that they are the first location based fishing game, which we're sure is true, since we're not even sure there is a market for one of these things.1 took a team of 15, 6 months and cost ~$500,000  Engadget . http://www.engadget.com/2004/10/02/gps-cellphone-swordfish-game/
Today, $30,000 and take less than 6 weeks.. Android Lib Stats. http://www.androlib.com/appstats.aspx ...expectations are higher. Budgets are lower.
Today, User Feedback is Even More Important ..69% of users discovery apps through rankings, reviews and recommendation
The Crowd Are Amateurs The Crowd are Your Customers
FLIRT model for planning open collaboration Focus Language Incentives Rules Tools Sami Viitamaki www.samiviitamaki.com
What do you need done? What results are you looking for? In what format?  What is the objective of engaging the community?  Who is managing it?  Focus Language Incentives Rules Tools Sami Viitamaki www.samiviitamaki.com
Does the Tester Understand the Tasks?  Is There a Mutual Understanding and Respect? Focus Language Incentives Rules Tools Sami Viitamaki www.samiviitamaki.com
Is There a Reasonable Incentive to Complete The Task? Are There Reasonable Safe Guards Against Unknowns? What Non-Monetary Value Can You Offer? Focus Language Incentives Rules Tools Sami Viitamaki www.samiviitamaki.com
Are You Protecting Your IP? Copyright Issues? What Is The Criteria For Completion? What Constraints on Testing Are Needed? Focus Language Incentives Rules Tools Sami Viitamaki www.samiviitamaki.com
Do You Have The Ability To Monitor The Work? How Do You Correct Deficiencies? How Do You Handle App Distribution? Focus Language Incentives Rules Tools Sami Viitamaki www.samiviitamaki.com
Rule 1 Don’t Crowd Source Your Development
Rule 2 Don’t Internal Source Your Usability Testing “Thankfully, the theory behind such poor scoring isn’t an inherent bug or an outright failure to work, but users’ annoyance at not being able to access the app without stumping up the necessary £9.99-per-month premium subscription.”. T3 UK
LIVEprojects http://www.mob4hire.com/the-mob/projects 1,700 developers registered in the Mob4Hire community
Thanks! john@mob4hire.com www.mob4hire.com www.mob4hire.blogspot.com www.twitter.com/mob4hire m.mob4hire.com

Mais conteúdo relacionado

Mais de Stephen King

Eleven Essentials To Fiscal Excellence for Entrepreneurs
Eleven Essentials To Fiscal Excellence for EntrepreneursEleven Essentials To Fiscal Excellence for Entrepreneurs
Eleven Essentials To Fiscal Excellence for EntrepreneursStephen King
 
Eleven Essentials for Salespeople
Eleven Essentials for SalespeopleEleven Essentials for Salespeople
Eleven Essentials for SalespeopleStephen King
 
Eleven Essentials for Communicators
Eleven Essentials for CommunicatorsEleven Essentials for Communicators
Eleven Essentials for CommunicatorsStephen King
 
Stephdokin Digital Brand Services (Audit, Dashboard, Marketing)
Stephdokin Digital Brand Services (Audit, Dashboard, Marketing)Stephdokin Digital Brand Services (Audit, Dashboard, Marketing)
Stephdokin Digital Brand Services (Audit, Dashboard, Marketing)Stephen King
 
Total Customer Experience Management Overview #TCE #CEM -- The Why, What and...
Total Customer Experience Management Overview #TCE #CEM  -- The Why, What and...Total Customer Experience Management Overview #TCE #CEM  -- The Why, What and...
Total Customer Experience Management Overview #TCE #CEM -- The Why, What and...Stephen King
 
Eleven Essentials For Entrepreneurs
Eleven Essentials For EntrepreneursEleven Essentials For Entrepreneurs
Eleven Essentials For EntrepreneursStephen King
 
Global wireless network operator and mobile satisfaction / customer loyalty s...
Global wireless network operator and mobile satisfaction / customer loyalty s...Global wireless network operator and mobile satisfaction / customer loyalty s...
Global wireless network operator and mobile satisfaction / customer loyalty s...Stephen King
 
Make Money with Big Data (TCELab)
Make Money with Big Data (TCELab)Make Money with Big Data (TCELab)
Make Money with Big Data (TCELab)Stephen King
 
Jazzit score sample_32_page_report
Jazzit score sample_32_page_reportJazzit score sample_32_page_report
Jazzit score sample_32_page_reportStephen King
 
Mob4Hire What is mobile app and website usability?
Mob4Hire What is mobile app and website usability?Mob4Hire What is mobile app and website usability?
Mob4Hire What is mobile app and website usability?Stephen King
 
Mob4Hire Mobile App Usability (MobExperience) Overview
Mob4Hire Mobile App Usability (MobExperience) OverviewMob4Hire Mobile App Usability (MobExperience) Overview
Mob4Hire Mobile App Usability (MobExperience) OverviewStephen King
 
Mob4Hire releases Mobile Apps report from "Global Wireless Satisfaction Surve...
Mob4Hire releases Mobile Apps report from "Global Wireless Satisfaction Surve...Mob4Hire releases Mobile Apps report from "Global Wireless Satisfaction Surve...
Mob4Hire releases Mobile Apps report from "Global Wireless Satisfaction Surve...Stephen King
 
Commercialization Challenges Of Mobile Software Development In A Fragmented M...
Commercialization Challenges Of Mobile Software Development In A Fragmented M...Commercialization Challenges Of Mobile Software Development In A Fragmented M...
Commercialization Challenges Of Mobile Software Development In A Fragmented M...Stephen King
 

Mais de Stephen King (13)

Eleven Essentials To Fiscal Excellence for Entrepreneurs
Eleven Essentials To Fiscal Excellence for EntrepreneursEleven Essentials To Fiscal Excellence for Entrepreneurs
Eleven Essentials To Fiscal Excellence for Entrepreneurs
 
Eleven Essentials for Salespeople
Eleven Essentials for SalespeopleEleven Essentials for Salespeople
Eleven Essentials for Salespeople
 
Eleven Essentials for Communicators
Eleven Essentials for CommunicatorsEleven Essentials for Communicators
Eleven Essentials for Communicators
 
Stephdokin Digital Brand Services (Audit, Dashboard, Marketing)
Stephdokin Digital Brand Services (Audit, Dashboard, Marketing)Stephdokin Digital Brand Services (Audit, Dashboard, Marketing)
Stephdokin Digital Brand Services (Audit, Dashboard, Marketing)
 
Total Customer Experience Management Overview #TCE #CEM -- The Why, What and...
Total Customer Experience Management Overview #TCE #CEM  -- The Why, What and...Total Customer Experience Management Overview #TCE #CEM  -- The Why, What and...
Total Customer Experience Management Overview #TCE #CEM -- The Why, What and...
 
Eleven Essentials For Entrepreneurs
Eleven Essentials For EntrepreneursEleven Essentials For Entrepreneurs
Eleven Essentials For Entrepreneurs
 
Global wireless network operator and mobile satisfaction / customer loyalty s...
Global wireless network operator and mobile satisfaction / customer loyalty s...Global wireless network operator and mobile satisfaction / customer loyalty s...
Global wireless network operator and mobile satisfaction / customer loyalty s...
 
Make Money with Big Data (TCELab)
Make Money with Big Data (TCELab)Make Money with Big Data (TCELab)
Make Money with Big Data (TCELab)
 
Jazzit score sample_32_page_report
Jazzit score sample_32_page_reportJazzit score sample_32_page_report
Jazzit score sample_32_page_report
 
Mob4Hire What is mobile app and website usability?
Mob4Hire What is mobile app and website usability?Mob4Hire What is mobile app and website usability?
Mob4Hire What is mobile app and website usability?
 
Mob4Hire Mobile App Usability (MobExperience) Overview
Mob4Hire Mobile App Usability (MobExperience) OverviewMob4Hire Mobile App Usability (MobExperience) Overview
Mob4Hire Mobile App Usability (MobExperience) Overview
 
Mob4Hire releases Mobile Apps report from "Global Wireless Satisfaction Surve...
Mob4Hire releases Mobile Apps report from "Global Wireless Satisfaction Surve...Mob4Hire releases Mobile Apps report from "Global Wireless Satisfaction Surve...
Mob4Hire releases Mobile Apps report from "Global Wireless Satisfaction Surve...
 
Commercialization Challenges Of Mobile Software Development In A Fragmented M...
Commercialization Challenges Of Mobile Software Development In A Fragmented M...Commercialization Challenges Of Mobile Software Development In A Fragmented M...
Commercialization Challenges Of Mobile Software Development In A Fragmented M...
 

Último

"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demoHarshalMandlekar2
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embeddingZilliz
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsNathaniel Shimoni
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 

Último (20)

"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demo
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embedding
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 

The Power of the Crowd: Mobile Testing for Scale and Global Coverage

  • 1. The Power Of The Crowd Mobile Testing for Scale and Global Coverage Sept 30, 2010 John Carpenter PEng, CTO www.mob4hire.com
  • 2. “Trism has made $250,000 for its developer, Steve Demeter, in just two month”1 “5 out of 6 app developers will not break even”2 “Joel Comm, whose virtual flatulence app, iFart, was at one point earning him £5,000 every day”3 “[Only] one in 8 - will break even its programming costs in six months of downloads” 2 Wired Magazine.  http://www.wired.com/gadgetlab/2008/09/app-store-is-a/#ixzz0upLJqgzq 3. Telegraph UK. http://www.telegraph.co.uk/technology/apple/5163678/Apples-iPhone-is-a-developers-goldmine.html 2. TomiAhonenhttp://communities-dominate.blogs.com/brands/2010/03/paid-smartphone-apps-half-get-under-1000-downloads-what-does-this-mean.html
  • 4. Don’t Suck– How do Users Respond to Your App? Get Sticky– User Feedback / Customer Loyalty Starts Here? What Features Will Go In The Next Version Don’t Crash – Do Your Unit Testing. White Box Testing.
  • 5. 7 years ago developing a mobile application, ...to deploy on 3 carriers for around 3% of phones  [Blister] says that they are the first location based fishing game, which we're sure is true, since we're not even sure there is a market for one of these things.1 took a team of 15, 6 months and cost ~$500,000 Engadget . http://www.engadget.com/2004/10/02/gps-cellphone-swordfish-game/
  • 6. Today, $30,000 and take less than 6 weeks.. Android Lib Stats. http://www.androlib.com/appstats.aspx ...expectations are higher. Budgets are lower.
  • 7. Today, User Feedback is Even More Important ..69% of users discovery apps through rankings, reviews and recommendation
  • 8. The Crowd Are Amateurs The Crowd are Your Customers
  • 9. FLIRT model for planning open collaboration Focus Language Incentives Rules Tools Sami Viitamaki www.samiviitamaki.com
  • 10. What do you need done? What results are you looking for? In what format? What is the objective of engaging the community? Who is managing it? Focus Language Incentives Rules Tools Sami Viitamaki www.samiviitamaki.com
  • 11. Does the Tester Understand the Tasks? Is There a Mutual Understanding and Respect? Focus Language Incentives Rules Tools Sami Viitamaki www.samiviitamaki.com
  • 12. Is There a Reasonable Incentive to Complete The Task? Are There Reasonable Safe Guards Against Unknowns? What Non-Monetary Value Can You Offer? Focus Language Incentives Rules Tools Sami Viitamaki www.samiviitamaki.com
  • 13. Are You Protecting Your IP? Copyright Issues? What Is The Criteria For Completion? What Constraints on Testing Are Needed? Focus Language Incentives Rules Tools Sami Viitamaki www.samiviitamaki.com
  • 14. Do You Have The Ability To Monitor The Work? How Do You Correct Deficiencies? How Do You Handle App Distribution? Focus Language Incentives Rules Tools Sami Viitamaki www.samiviitamaki.com
  • 15. Rule 1 Don’t Crowd Source Your Development
  • 16. Rule 2 Don’t Internal Source Your Usability Testing “Thankfully, the theory behind such poor scoring isn’t an inherent bug or an outright failure to work, but users’ annoyance at not being able to access the app without stumping up the necessary £9.99-per-month premium subscription.”. T3 UK
  • 17. LIVEprojects http://www.mob4hire.com/the-mob/projects 1,700 developers registered in the Mob4Hire community
  • 18. Thanks! john@mob4hire.com www.mob4hire.com www.mob4hire.blogspot.com www.twitter.com/mob4hire m.mob4hire.com

Notas do Editor

  1. Introduction.Development backgroundPassion around development. Agenda, why, when and how to do testing.
  2. Glu and EA mobile
  3. Tighter budget, lower timeline, higher expectation
  4. Tighter budget, lower timeline, higher expectation
  5. We can predict 4 and 5 star apps, and we can also analyze user feedback to see how you need to improve the app.$100M opp with 1,000,000 developersWe see a lot of mobile brands doing MobTest … alsoMobTasks, like GCI and SIM Roaming testingWe’re seeing a lot of Big Brands doing usability testing … MobExperience … trying to ensure and understand how they are positioning (and how they can position) in marketplace