How Much Do Developers Test
What do we know about software testing in the real world? It seems we know from Fred Brooks’ seminal work “The Mythical Man-Month” that 50% of project effort is spent on testing. However, due to the enormous advances in software engineering in the past 40 years, the question stands: Is this observation still true? In fact, was it ever true? The vision for our research is to settle the discussion about Brooks’ estimation once and for all: How much do developers test? Does developers’ estimation on how much they test match reality? How frequently do they execute their tests, and is there a relationship between test runtime and execution frequency? What are the typical reactions to failing tests? Do developers solve actual defects in the production code, or do they merely relax their test assertions? Emerging results from 40 software engineering students show that students overestimate their testing time threefold, and 50% of them test as little as 4% of their time, or less.
Recomendados
Recomendados
Mais conteúdo relacionado
Mais procurados
Mais procurados (20)
Destaque
Destaque (16)
Semelhante a How Much Do Developers Test
Semelhante a How Much Do Developers Test (20)
Último
Último (20)
How Much Do Developers Test
- 1. How (Much) Do Developers Test? Moritz Beller @Inventitech Andy Zaidman, Georgios Gousios, Annibale Panichella, Igor Levaja
- 7. Thou shalt not have less than 80% coverage
- 10. Brooks, 1975
- 11. 50% … of Project Effort Brooks, 1975
- 19. 34
- 23. Students
- 24. 4.2 yr
- 25. OMG!!!
- 26. Histogram of Testing Time 50% of students test only 4% of their time, or less
- 28. Thou shalt not have less than 75% coverage
- 29. Thou shalt not have less than 75% coverage Students
- 31. Estimated 27%
- 35. >1,000
- 36. 13 yr
- 38. Estimated 48%
- 40. 65% of test executions fail.
- 42. 50% of test failures are fixed within 10 minutes.
- 45. Nobody follows TDD (strictly). Image source: http://www.agilenutshell.com/test_driven_development
- 56. @Inventitech Moritz Beller, TU Delft How (Much) Do Developers Test? TestRoots.org
- 57. @Inventitech Moritz Beller, TU Delft How (Much) Do Developers Test? TestRoots.org
- 58. @Inventitech Moritz Beller, TU Delft How (Much) Do Developers Test? TestRoots.org
- 59. @Inventitech Moritz Beller, TU Delft How (Much) Do Developers Test? TestRoots.org