SlideShare uma empresa Scribd logo
1 de 53
Test Innovation for Everyone



     Alan Page, Microsoft




                                      @esconfs
        www.eurostarconferences.com
                                      #esconfs
Innovation
Ideas
Test
Innovation
Test
Ideas
I know quite certainly that I myself have no special
talent. Curiosity, obsession and dogged endurance,
combined with self-criticism, have brought me to
my ideas.
Ideas
We don’t know where we get our ideas
from. What we do know is that we do
   not get them from our laptops.
Ideas
                                Ideas
  Ideas

                Ideas            Ideas
Ideas
                 Ideas
                                   Ideas

                                  Ideas
        Ideas
                                   Ideas
                        Ideas
The Adjacent
   Possible
  “The premise that
 innovation prospers
   when ideas can
   serendipitously
    connect and
recombine with other
       ideas”
Optimizing Application
    Performance
program.exe
program.exe
program.exe
program.exe - coverage report
Function       Total Blocks Blocks Covered
Foo               12           10
Bar               16           8
Baz               7            6
Fizz              19           12
Component   Coverage

Fizz        70%

Buzz        62%

FizzBuzz    81%
Component   Coverage

Fizz        70%

Buzz        62%

FizzBuzz    81%
Component   Tests

Fizz        a,b,d,e,f,g,y

Buzz        b,c,d,r,s,t

FizzBuzz    a,b,d,e,f,r,t,u,v,z
Test                   Pass Rate
Test This              90%
Test That              95%
Test the other thing   98%
Test                   Pass Rate
Test This              90%
Test That              95%
Test the other thing   98%
Test          History (Last 5)   Bugs
Test This     P, P, P, F, F      134, 157,154
Test That     F, P, F, P, F      174
Test the      P, P, P, P, P      132
other thing
“We now know a
thousand ways
not to build a
light bulb”
Know The Problem

Question The Problem

 Fail at the Problem

  See the (bigger)
      Problem
The unit of progress
for Lean Startups is
validated learning - a
rigorous method for
demonstrating
progress when one is
embedded in the soil
of extreme uncertainty
“The way to get good ideas is to get lots
of ideas and throw the bad ones away”
- Linus Pauling
Test
Ideas
If you have one
person you’re
influenced by,
everyone will say
you’re the next
whoever. But if you
rip off a hundred
people, everyone will
say you’re so original.

- Gary Panter
http://angryweasel.com/blog
http://twitter.com/alanpage
Photo Credits
• Passport / safe slide
  – Some rights reserved by IceSabre (safe)
  – Some rights reserved by The Wide Wide World
    (passports)
  – Some rights reserved by Samantha Decker (map)
• Microwave
  – Some rights reserved by samsungtomorrow
• Dead End
  – Some rights reserved by freefotouk
• Others are book covers or from Microsoft
  Clipart collection

Mais conteúdo relacionado

Destaque

Automation Benefits and its future
Automation Benefits and its futureAutomation Benefits and its future
Automation Benefits and its futureRIA RUI Society
 
Peering into the white box: A testers approach to Code Reviews
Peering into the white box: A testers approach to Code ReviewsPeering into the white box: A testers approach to Code Reviews
Peering into the white box: A testers approach to Code ReviewsAlan Page
 
Thoughts on Test Strategy
Thoughts on Test StrategyThoughts on Test Strategy
Thoughts on Test StrategyAlan Page
 
The Benefits of Automation - Digiday Programmatic Rome, 11/10/15
The Benefits of Automation - Digiday Programmatic Rome, 11/10/15The Benefits of Automation - Digiday Programmatic Rome, 11/10/15
The Benefits of Automation - Digiday Programmatic Rome, 11/10/15Digiday
 
Save Time and Money with Automation
Save Time and Money with AutomationSave Time and Money with Automation
Save Time and Money with AutomationChris Jean
 
Don't Skirt Using Humor at Work: Gender Differences in Workplace Humor and Ho...
Don't Skirt Using Humor at Work: Gender Differences in Workplace Humor and Ho...Don't Skirt Using Humor at Work: Gender Differences in Workplace Humor and Ho...
Don't Skirt Using Humor at Work: Gender Differences in Workplace Humor and Ho...Society of Women Engineers
 
Ride the gravy train - and other career tips
Ride the gravy train - and other career tipsRide the gravy train - and other career tips
Ride the gravy train - and other career tipsAlan Page
 

Destaque (7)

Automation Benefits and its future
Automation Benefits and its futureAutomation Benefits and its future
Automation Benefits and its future
 
Peering into the white box: A testers approach to Code Reviews
Peering into the white box: A testers approach to Code ReviewsPeering into the white box: A testers approach to Code Reviews
Peering into the white box: A testers approach to Code Reviews
 
Thoughts on Test Strategy
Thoughts on Test StrategyThoughts on Test Strategy
Thoughts on Test Strategy
 
The Benefits of Automation - Digiday Programmatic Rome, 11/10/15
The Benefits of Automation - Digiday Programmatic Rome, 11/10/15The Benefits of Automation - Digiday Programmatic Rome, 11/10/15
The Benefits of Automation - Digiday Programmatic Rome, 11/10/15
 
Save Time and Money with Automation
Save Time and Money with AutomationSave Time and Money with Automation
Save Time and Money with Automation
 
Don't Skirt Using Humor at Work: Gender Differences in Workplace Humor and Ho...
Don't Skirt Using Humor at Work: Gender Differences in Workplace Humor and Ho...Don't Skirt Using Humor at Work: Gender Differences in Workplace Humor and Ho...
Don't Skirt Using Humor at Work: Gender Differences in Workplace Humor and Ho...
 
Ride the gravy train - and other career tips
Ride the gravy train - and other career tipsRide the gravy train - and other career tips
Ride the gravy train - and other career tips
 

Semelhante a Test innovation for everyone

Artificial Neural Network Seminar - Google Brain
Artificial Neural Network Seminar - Google BrainArtificial Neural Network Seminar - Google Brain
Artificial Neural Network Seminar - Google BrainRawan Al-Omari
 
A Programmer's Guide to Humans
A Programmer's Guide to HumansA Programmer's Guide to Humans
A Programmer's Guide to HumansArty Starr
 
Creativity to Innovation
Creativity to Innovation Creativity to Innovation
Creativity to Innovation Mike Cardus
 
Design thinking for geeks
Design thinking for geeksDesign thinking for geeks
Design thinking for geeksNina Khosla
 
David Williamson Shaffer: Epistemic Games (Paris juin 2011)
David Williamson Shaffer: Epistemic Games (Paris juin 2011)David Williamson Shaffer: Epistemic Games (Paris juin 2011)
David Williamson Shaffer: Epistemic Games (Paris juin 2011)Thomas Constant
 
Ricardo Sosa: Ideation, a conversation
Ricardo Sosa: Ideation, a conversationRicardo Sosa: Ideation, a conversation
Ricardo Sosa: Ideation, a conversationR. Sosa
 
Requirementless testing
Requirementless testingRequirementless testing
Requirementless testingJulen Mohanty
 
Edutalk f2013
Edutalk f2013Edutalk f2013
Edutalk f2013Mel Chua
 
Nick Fine - Scientific Design
Nick Fine - Scientific Design Nick Fine - Scientific Design
Nick Fine - Scientific Design uxbri
 
Valtech - Innovation Needs Waste
Valtech - Innovation Needs WasteValtech - Innovation Needs Waste
Valtech - Innovation Needs WasteValtech
 
Applying AI to Root-cause Analysis Webinar
Applying AI to Root-cause Analysis WebinarApplying AI to Root-cause Analysis Webinar
Applying AI to Root-cause Analysis WebinarDeborah Schalm
 
Applying AI to Root-cause Analysis Webinar
Applying AI to Root-cause Analysis WebinarApplying AI to Root-cause Analysis Webinar
Applying AI to Root-cause Analysis WebinarDevOps.com
 
Becoming a software testing expert
Becoming a software testing expertBecoming a software testing expert
Becoming a software testing expertmoosix
 
Angina Monologues: Ten Essential Steps to Get Through Your Dissertation
Angina Monologues: Ten Essential Steps to Get Through Your DissertationAngina Monologues: Ten Essential Steps to Get Through Your Dissertation
Angina Monologues: Ten Essential Steps to Get Through Your DissertationSara Stetson
 

Semelhante a Test innovation for everyone (20)

Artificial Neural Network Seminar - Google Brain
Artificial Neural Network Seminar - Google BrainArtificial Neural Network Seminar - Google Brain
Artificial Neural Network Seminar - Google Brain
 
A Programmer's Guide to Humans
A Programmer's Guide to HumansA Programmer's Guide to Humans
A Programmer's Guide to Humans
 
Creativity to Innovation
Creativity to Innovation Creativity to Innovation
Creativity to Innovation
 
Design thinking for geeks
Design thinking for geeksDesign thinking for geeks
Design thinking for geeks
 
David Williamson Shaffer: Epistemic Games (Paris juin 2011)
David Williamson Shaffer: Epistemic Games (Paris juin 2011)David Williamson Shaffer: Epistemic Games (Paris juin 2011)
David Williamson Shaffer: Epistemic Games (Paris juin 2011)
 
Ricardo Sosa: Ideation, a conversation
Ricardo Sosa: Ideation, a conversationRicardo Sosa: Ideation, a conversation
Ricardo Sosa: Ideation, a conversation
 
Requirementless testing
Requirementless testingRequirementless testing
Requirementless testing
 
Edutalk f2013
Edutalk f2013Edutalk f2013
Edutalk f2013
 
The Rule of Three
The Rule of ThreeThe Rule of Three
The Rule of Three
 
Nick Fine - Scientific Design
Nick Fine - Scientific Design Nick Fine - Scientific Design
Nick Fine - Scientific Design
 
How to find an idea
How to find an ideaHow to find an idea
How to find an idea
 
ATD2K16
ATD2K16ATD2K16
ATD2K16
 
Valtech - Innovation Needs Waste
Valtech - Innovation Needs WasteValtech - Innovation Needs Waste
Valtech - Innovation Needs Waste
 
Design thinking
Design thinkingDesign thinking
Design thinking
 
Presentation: Philips
Presentation: PhilipsPresentation: Philips
Presentation: Philips
 
Applying AI to Root-cause Analysis Webinar
Applying AI to Root-cause Analysis WebinarApplying AI to Root-cause Analysis Webinar
Applying AI to Root-cause Analysis Webinar
 
Applying AI to Root-cause Analysis Webinar
Applying AI to Root-cause Analysis WebinarApplying AI to Root-cause Analysis Webinar
Applying AI to Root-cause Analysis Webinar
 
Mob Testing
Mob TestingMob Testing
Mob Testing
 
Becoming a software testing expert
Becoming a software testing expertBecoming a software testing expert
Becoming a software testing expert
 
Angina Monologues: Ten Essential Steps to Get Through Your Dissertation
Angina Monologues: Ten Essential Steps to Get Through Your DissertationAngina Monologues: Ten Essential Steps to Get Through Your Dissertation
Angina Monologues: Ten Essential Steps to Get Through Your Dissertation
 

Test innovation for everyone

  • 1. Test Innovation for Everyone Alan Page, Microsoft @esconfs www.eurostarconferences.com #esconfs
  • 6. I know quite certainly that I myself have no special talent. Curiosity, obsession and dogged endurance, combined with self-criticism, have brought me to my ideas.
  • 8. We don’t know where we get our ideas from. What we do know is that we do not get them from our laptops.
  • 9. Ideas Ideas Ideas Ideas Ideas Ideas Ideas Ideas Ideas Ideas Ideas Ideas
  • 10. The Adjacent Possible “The premise that innovation prospers when ideas can serendipitously connect and recombine with other ideas”
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19. Optimizing Application Performance
  • 23. program.exe - coverage report Function Total Blocks Blocks Covered Foo 12 10 Bar 16 8 Baz 7 6 Fizz 19 12
  • 24.
  • 25. Component Coverage Fizz 70% Buzz 62% FizzBuzz 81%
  • 26. Component Coverage Fizz 70% Buzz 62% FizzBuzz 81%
  • 27. Component Tests Fizz a,b,d,e,f,g,y Buzz b,c,d,r,s,t FizzBuzz a,b,d,e,f,r,t,u,v,z
  • 28. Test Pass Rate Test This 90% Test That 95% Test the other thing 98%
  • 29. Test Pass Rate Test This 90% Test That 95% Test the other thing 98%
  • 30. Test History (Last 5) Bugs Test This P, P, P, F, F 134, 157,154 Test That F, P, F, P, F 174 Test the P, P, P, P, P 132 other thing
  • 31.
  • 32.
  • 33.
  • 34.
  • 35.
  • 36.
  • 37.
  • 38. “We now know a thousand ways not to build a light bulb”
  • 39.
  • 40. Know The Problem Question The Problem Fail at the Problem See the (bigger) Problem
  • 41.
  • 42. The unit of progress for Lean Startups is validated learning - a rigorous method for demonstrating progress when one is embedded in the soil of extreme uncertainty
  • 43.
  • 44. “The way to get good ideas is to get lots of ideas and throw the bad ones away” - Linus Pauling
  • 45.
  • 47.
  • 48.
  • 49. If you have one person you’re influenced by, everyone will say you’re the next whoever. But if you rip off a hundred people, everyone will say you’re so original. - Gary Panter
  • 50.
  • 51.
  • 53. Photo Credits • Passport / safe slide – Some rights reserved by IceSabre (safe) – Some rights reserved by The Wide Wide World (passports) – Some rights reserved by Samantha Decker (map) • Microwave – Some rights reserved by samsungtomorrow • Dead End – Some rights reserved by freefotouk • Others are book covers or from Microsoft Clipart collection

Notas do Editor

  1. Anyone can be a test innovator – why not you? Here’s a dirty little secret from innovators. There’s no secret to innovation. Innovation is certainly more difficult than tying your shoe, but it’s not a concept exclusive to entrepreneurs, artists, or conference speakers either. The software tester’s nature for system thinking, and for identifying problems and patterns makes them well-suited for innovation, yet few testers take the time to apply their skills and experience to this end. Successful innovation is not purely a matter of skill, intelligence, or luck. Innovation begins with careful identification and analysis of a problem, obstacle, or bottleneck; followed by a solution that not only solves the problem, but frequently solves it in a way that has widespread benefit – or in a way that changes the basic nature of the problem entirely. Alan Page breaks down the cogs and wheels of innovation and shows examples of how some testers are applying game-changing creativity to discover new ways to improve tests, testers, and testing on their organizations. Problems, solutions, tips, tricks, and more are all on the radar for this whirlwind tour of pragmatic test innovation. Best of all, you’ll walk away knowing that anyone, especially you, can be a test innovator.
  2. http://www.kickstarter.com/projects/ostrich-pillow
  3. All work is problem solving. Creativity is simply another word for the process of solving problems. If you give me a tough problem and I solve it for you, you may tell me “wow you are so creative” but really what I did was solve a set of problems. I may have used some old ideas, or some new ones, but to you it’s all the same since your problem was solved. Obsessing about how innovative you are is a mistake because it distracts from the real goal of solving important problems. The more ambitious the goals of a team, the more problem solving skills they will need to be successful and they better they need to be at identifying the real problems to solve.
  4. All work is problem solving. Creativity is simply another word for the process of solving problems. If you give me a tough problem and I solve it for you, you may tell me “wow you are so creative” but really what I did was solve a set of problems. I may have used some old ideas, or some new ones, but to you it’s all the same since your problem was solved. Obsessing about how innovative you are is a mistake because it distracts from the real goal of solving important problems. The more ambitious the goals of a team, the more problem solving skills they will need to be successful and they better they need to be at identifying the real problems to solve.
  5. Two kinds of problems: Problemswe know wehaveProblems wedontknowwehave
  6. Some rights reserved by samsungtomorrowInvention was an accidentIt solved a problem people didn’t know they hadLike many of today's great inventions, the microwave oven was a by-product of another technology. It was during a radar-related research project around 1946 that Dr. Percy Spencer, a self-taught engineer with the Raytheon Corporation, noticed something very unusual. He was testing a new vacuum tube called a magnetron (we are searching for a picture of an actual 1946 magnetron), when he discovered that the candy bar in his pocket had melted. This intrigued Dr. Spencer, so he tried another experiment. This time he placed some popcorn kernels near the tube and, perhaps standing a little farther away, he watched with an inventive sparkle in his eye as the popcorn sputtered, cracked and popped all over his lab.The next morning, Scientist Spencer decided to put the magnetron tube near an egg. Spencer was joined by a curious colleague, and they both watched as the egg began to tremor and quake. The rapid temperature rise within the egg was causing tremendous internal pressure. Evidently the curious colleague moved in for a closer look just as the egg exploded and splattered hot yolk all over his amazed face.
  7. Make fun of test pass rates here.
  8. Let’s talk about failure
  9. When it didn't work the first time, Edison made a note of exactly what he'd done and what components he had used. Then he made an adjustment to the experiment and tried again. And when that "failed" he made a note of that, readjusted and tried again. He kept learning from every experiment. He learned all the ways that it wouldn't work. He discovered all the chemicals and elements that wouldn't work. And each time he found a way that wouldn't work, he knew he was closer to finding a way that would work.
  10. Iterate – ericries, the lean startup
  11. Don’t get blockedSome rights reserved by freefotouk
  12. Initiative
  13. Experiment - Pilot / small team
  14. Gary Panter (cartoonist)If you have one person you’re influenced by, everyone will say you’re the next whoever. But if you rip off a hundred people, everyone will say you’re so original.
  15. Myths of Innovation – Scott BerkunWhere Good Ideas Come From – Steven JohnsonThey All Laughed – Ira FlatowBrain Rules – John MedinaSteal Like an Artist – Austin KleonThe Innovators Dilemma – Clayton Christensen