מצגת המראה מגמות ומספרים המתייחסים לשוק הבדיקות והבטחת האיכות בישראל

1. QA Trends
Galit Fein
EVP & Senior Analyst
Office of the CIO Strategies
www.galitfein.blogspot.com

2. Agenda
QA & Testing Services Israeli Market
Factors Influencing QA Staffing Level
Your Text here Your Text here
IT Trends Influencing QA Staffing Level
Pricing Models
Galit Fein’s work Copyright 2010 @STKI Do not remove source or attribution from any graphic or portion of graphic 2

3. QA & Testing Services Israeli Market
Software Testing
Outsourcing:
An Idea
Whose Time Has
Come?
2008 2009 2010 2011 2012
240.0 -10.42% 215.0 13.95% 245.0 2.04% 250.0 2.00% 255.0 Q/A & Testing
20.0 -10.00% 18.0 38.89% 25.0 40.00% 35.0 20.00% 42.0 Project Management Office
Galit Fein’s work Copyright 2010 @STKI 3
Do not remove source or attribution from any graphic or portion of graphic

4. QA & Testing Main Players
Matrix
MALAM/TEAM Category 1
NESS
Tesnet
Category 2
Tescom
Your Text here Mertens Hoffman Your Text here
Calanit Carmon
Taldor
Category 3
Top Group
One1
Netwise
EL AD Systems
Galit Fein’s work Copyright 2010 @STKI 4
Do not remove source or attribution from any graphic or portion of graphic

5. QA Staffing Level
 The skills of a capable QA group are essential to
improving application development & maintenance:
• Early discovery of inconsistencies
• Errors reduce
• Rework prevention
Your Text here Your Text here
 Yet, the appropriate level of QA
staffing is often difficult to determine
Galit Fein’s work Copyright 2010 @STKI 5
Do not remove source or attribution from any graphic or portion of graphic

6. Factors Influencing QA Staffing
Requirements
When ITO requires higher level of QA staffing:
 Orgs that produce their own SW other than orgs that
implement commercial SW packages
 Orgs relying here SW for mission-critical functions here
Your Text on Your Text
 Highly regulated industries
 Orgs that produce SW as a part of their services to customers
 Companies devoting their efforts to steady process
improvement (Six Sigma/ CMMI…)
Galit Fein’s work Copyright 2010 @STKI 6
Do not remove source or attribution from any graphic or portion of graphic

7. QA & Testing Ratios
• QA unit* ratio to total IT
25 percentile 1.70% - Do some orgs have
Median 3.40% lower needs & are
75 percentile 5.30% they more efficient in
• SW developers per QA FTE their use of QA staff ?
OR
Per FTE
- Are they understaffed
25 percentile 4
in this position?
Median 6
75 percentile 18
*Includes employees who are part of a dedicated QA or testing function. It does not include employees who perform
testing as part of their other job responsibilities, such as application programmers who also perform their own unit testing
Source: ComputerEconomics
Galit Fein’s work Copyright 2010 @STKI 7
Do not remove source or attribution from any graphic or portion of graphic

8. QA Staff Ratio / total IT
Government 0.70%
High Tech Text here
Your 2.20% Your Text here
Finance 3.90%
Source: ComputerEconomics
Galit Fein’s work Copyright 2010 @STKI 8
Do not remove source or attribution from any graphic or portion of graphic

9. Find The Right Balance
Too often QA is viewed as an obstacle to getting work done
Desire to
meet
deadlines &
enhance
Your Text here Your Text here
Need to systems
ensure
quality,
reduce
waste &
enforce
standards
Galit Fein’s work Copyright 2010 @STKI 9
Do not remove source or attribution from any graphic or portion of graphic

10. IT Trends Influencing QA Staffing
Requirements
 New regulations
Agile
 Cloud computing
 Agile
Your Text here Your Text here
 Outsourcing
 Office of the CIO
Galit Fein’s work Copyright 2010 @STKI 10
Do not remove source or attribution from any graphic or portion of graphic

11. New Regulations Requirements
 In recent years, the quality & integrity of information
systems are being examined more closely because of
regulations that address the security and privacy of
information
Your Text here Your Text here
 QA function becomes even more important in light of
these requirements
Galit Fein’s work Copyright 2010 @STKI 11
Do not remove source or attribution from any graphic or portion of graphic

12. Office of the CIO
Israeli Trends
 After many years of talking OTC is actually happening!
 Financial crisis & budget reduction in 2009 forced better ITG:
• Increased focus on IT costs - efficiency increasing
• New regulations requested better transparency
Your Text here Your Text here
 Most ITOs have expanded their OTC/ PMO department:
• IT budget control & mng, PPM, rewrite methodologies & WF definition,
tools evaluation, HR - resource allocation & mng, QA, GRC…
Galit Fein’s work Copyright 2010 @STKI 12
Do not remove source or attribution from any graphic or portion of graphic

13. The PMO goals are:
 Keep all this in the right balance:
• Scope of Work
• Budget
• Time
Your Text here Your Text here
• Quality
Galit Fein’s work Copyright 2010 @STKI 13
Do not remove source or attribution from any graphic or portion of graphic

14. SW metrics
 Bugs - How many bugs (including severity)
• When the bug was open, when it was closed
• Number of bugs correspondingly to closing date of the version
• When was the bug found(dev, functional test, regression, prod = escaping bugs)
 Test coverage (what part of SW was tested)
 Percentage of automatic tests (from the complete project = automatic +
manual)Your Text here Your Text here
 Progress of project compared to plan
 How many (and percentage of) passed builds
 Development of new functionality vs. effort to correct bugs from prod &
from tests
STKI recommends: change your metrics once in a while
Galit Fein’s work Copyright 2010 @STKI 14
Do not remove source or attribution from any graphic or portion of graphic

15. SW Measurement Insights
 Bugs are the most easy metric to measure & track
 Sometimes too much effort is spent on bugs (example:
minor memory leak) while important functionality is
delayed
 How much effort should developer put in “non-dev”
Your Text here Your Text here
missions (like detailed progress report)?
 Should maintenance be part of the general development
team or should maintenance have a special “team”?
Galit Fein’s work Copyright 2010 @STKI 15
Do not remove source or attribution from any graphic or portion of graphic

16. Agile Project Management
12
9
Implement
Analysis
Analysis
Code
Code
Test
Test
6
Your Text here Your Text here
3
3 6 9 12
Source: Cutter
Galit Fein’s work Copyright 2010 @STKI 16
Do not remove source or attribution from any graphic or portion of graphic

17. Agile SW Development Israeli Trends
 Agile is catching up in ITOs
 Clients see the benefits of Agile in SMPs
 Large Agile projects (50 people) are
more challengeable mainly when there is high
interdependencies between the SW modulesYour Text here
Your Text here
 Israeli ISV’s report that sometimes their clients demand Agile
 Agile requires change in the hierarchical structure that is
extremely difficult to large conservative organizations
Galit Fein’s work Copyright 2010 @STKI 17
Do not remove source or attribution from any graphic or portion of graphic

18. Outsourcing
 While Professional Services market significantly dropped
last year, the QA & testing PS remained stable
 QA - rapidly growing sourcing segment
Your Text here Your Text here
 Acknowledging the advantage & cost saving (up to 50%)
by local nearshore
Galit Fein’s work Copyright 2010 @STKI 18
Do not remove source or attribution from any graphic or portion of graphic

19. Israeli Nearshore
 Israeli ITOs do not offshore QA, except global orgs
 Israeli nearshore existing clients have broaden their
scope
Your Text here Your Text here
 Added Value Professional Services : ISTQB
• Best Practices – ISTQB, ISO 27001 CMMI
• Automation Testing Tools ISO
Six
Sigma
Galit Fein’s work Copyright 2010 @STKI 19
Do not remove source or attribution from any graphic or portion of graphic

20. Israeli Nearshore Main Players
 Matrix Global (Talpiot)
 Ness
 Malam Team
 Ness
 Aman Your Text here
– Tehila Your Text here
 Manpower
 Galil Software
 Many more…
Galit Fein’s work Copyright 2010 @STKI 20
Do not remove source or attribution from any graphic or portion of graphic

21. Pricing Models
 Traditionally QA was priced on a fixed-time/fixed-price
basis (most tenders still are)
 Today:
There Youra real difficulty to evaluate QAYour Text here work,
is Text here scope of
therefore most contracts priced on time & material basis
 Israeli ITOs prefer in-house responsibility & QA PS, both
• On premises
• Off premises – nearshore
Galit Fein’s work Copyright 2010 @STKI 21
Do not remove source or attribution from any graphic or portion of graphic

22. Developers vs. Testers
Advantage: Disadvantage:
Your Text here Your Text here
Already knows the system Must learn the system
But But
- Driven by “delivery” - Seek the problems
- Driven by “hours”
Galit Fein’s work Copyright 2010 @STKI 22
Do not remove source or attribution from any graphic or portion of graphic