This presentation supported the speech delivered by Gabriele Ruffatti, founder of the SpagoWorld initiative and founder and OW2 President (www.ow2.org), at OSS 2013 - the International Conference on Open Source Systems (Koper, Slovenia, 25th-28th June 2013). The first part of the presentation focuses on open source, innovation and next challenges in the context of the "nexus of events". The second part provides various examples of how Spago4Q (www.spago4q.org) - SpagoBI analytic for quality - supports a quality assurance and trustworthiness program. It includes a preview of the speech to be delivered at IT Confidence 2013 in Rio de Janeiro (Brazil), presenting how Spago4Q is being used as the key tool inside a complete Application Lifecycle Management process. Spago4Q allows the evaluation of corporate performances through a 3D model integrating data coming from three dimensions of analysis: Technical, Economical and Social.

1. 1
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
June 27th 2013
Gabriele Ruffatti
Technical, Innovation & Research Division of Engineering Group
President of OW2 Consortium
OPEN SOURCE FROM DISRUPTION TO INNOVATION
Can we measure and evaluate the outcomes?
OSS 2013
The Ninth International Conference on Open Source Systems
Koper-Capodistria, Slovenia, 25th-28th June, 2013

2. 2
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Background information: Engineering Group and OSS
Brazil
Benelux
ItalyArgentina
Lebanon
The leading Italian independent, privately-owned software and IT
services company
One of the top 10 in Europe in software and services
43 branches in Italy, Belgium, Latin America and the MENA area
> 770M€ Value of Production in 2012, 1,000 large accounts in all
market sectors
www.eng.itwww.eng.it
OSS Competency CenterOSS Competency Center
Innovation & Research DivisionInnovation & Research Division
Engineering GroupEngineering Group
www.spagoworld.orgwww.spagoworld.org

3. 3
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Background information: OW2 Consortium
www.ow2.orgwww.ow2.org

4. 4
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Open Source

5. 5
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Open Source refers to software freedom
Credits to: www.ow2.org and Cedric Thomas

6. 6
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Open Source: Linux story
Don’t dream big
Give it all away
http://www.spagoworld.org/blog/
Don’t have a plan
Don’t be nice

7. 7
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Distribution: who can play
Community: who plays the game
Architecture: the playing field
Freedom to play the game
Open
Architecture
Open
Licensing
Open
Community
Open Source is a game of freedom
Commercial Model
Commercial model: how to sustain the game

8. 8
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Open Source has disrupted the software industry
Economically
efficientTechnically efficient
Strategically
efficient
Socially efficient

9. 9
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Open Source: quality gains momentum
Source: The 2013 Future of Open Source Survey, Black Duck Software

10. 10
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
OSS is an innovation factor
Where it’s leading
Stack up, from the bottom of technology
Decision factors
Source: The 2013 Future of Open Source Survey,
Black Duck Software

11. 11
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Linus Torvalds was looking for building an open operating system: we have Linux
Steve Jobs was looking for selling user experience: we have the iPad
It’s dependent on the context
It refers to research or production activities
It relates to new things or changes in mature markets
Sometimes it’s mistaken for re-organization or simplification
Innovation is giving shape to ideas
Does open source drive innovation?
What is innovation?

12. 12
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Open Source and Innovation
Open Source refers to
collaboration, sharing and diversity
Are they sufficient conditions to innovate?
Collaboration, sharing and diversity
are powerful tools to support innovation

13. 13
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Building Innovation Momentum
GETTING THINGS STARTED
FROM NEXUS OF EVENTS

14. 14
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Event #1: Era of digital economy

15. 15
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Event #2: Nexus of Forces
Networks and behaviors
dynamism
Complete re-desing
of IT processes
New approaches for
information management
A new way to
acquire technology

16. 16
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Identifying value that people need and delivering it
Today we can provide it:
at lower cost
with faster development times
with greater impact on user experience than any-thing that came before
Today we can think about opportunity differently
and make the difference
Event #3: Era of Digital Disruption
IT applications from a prescriptive to a
consumer-driven approach
Bottom-up innovation

17. 17
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Event #4: entering a new society
Saatchi & Saatchi CEO Kevin Roberts
… to SuperVUCAFrom VUCA …

18. 18
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Open Source and Innovation at work
Big data is the killer app
for the cloud

19. 19
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Open Source is here to stay
in these innovation areas

20. 20
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Samples
IoT (Choreos)
M2M
Cloud CompatibleOne
FI-Ware

21. 21
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
The next challenge

22. 22
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Platform
Name of plane and resistant surfaces, fixed or mobile,
generally having support or connection purposes.
Translation from the Italian language:
Dizionario delle Scienze Fisiche (2012)
www.treccani.it
A solid and plane surface, artificially created with various materials,
at the level or above the level of the surrounding area, used as the
base for many applications.
Translation from the Italian language:
Grande Dizionario Italiano di Gabrielli – HOEPLI
www.grandidizionari.it

23. 23
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Platform for Sustainability
Technical InfrastructureTechnical Infrastructure ServicesServices
Governance and CommunityGovernance and Community ServicesServices
Marketing and CommunicationMarketing and Communication ServicesServices
The Community Ecosystem PlatformThe Community Ecosystem Platform
for open source softwarefor open source software
Credits to: www.ow2.org and Cedric Thomas

24. 24
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Rules

25. 25
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Rules
Rules make us confident of our next behavior
Rules drive decisions
Emotions drive actions

26. 26
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Rules?
We need
We don’t need

27. 27
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Values
Credits to: www.londonlovesbusiness.com http://fda.gov/ www.blinkerart.net/ http://foolsjournals.wordpress.com/

28. 28
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Valuable outcomes
PlanPlan
MeasureMeasure
ImproveImprove
AssessAssess
set of metrics &
dimensions of analysis
collection of data, computation of metric values
& global performance value
presentation of results
(dashboards & reports)
detailed analysis
to find problems or bottlenecks

29. 29
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Spago4Q, the OSS platform for Quality
www.spago4q.orgwww.spago4q.org
partially funded by:

30. 30
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Example #1: Quality assessment of a single project

31. 31
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Example #1: Quality assessment of SpagoBI project

32. 32
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Example #2: OW2 SQuaAT
IP verification
License verification
• FOSSology
Source code origin
• Antelink
Code quality
OW2 rules
• Sonar
Business readiness
• Qualipso MOSST, OMM
Reputation
• Trustie Trustworthiness Assessment (TSRR)
Functionality
• China Software Testing Center (CSTC)

33. 33
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Application Lifecycle Management and process monitoring through an integrated
and low-cost solution, mainly based on Open Source Software products
Example #3: ALM at Engineering Group

34. 34
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Technical, Innovation & Research Division
Engineering’s Software Labs (ESL)
PRODUCTION
ESL3: Application
Management
ESL1-2: Project
development
RFPs technical support
MANAGED OPERATIONS
Infrastructures & System Services
Architectural design Research
&
Development
Competency
Centers
Resource
management
Business Units (BUs) for different market sector
Account
Managers
Sales Managers
Service
Desk
Business Analysis
Project
Managers
Business
Competency
Center
Worldwide Customers
Example #3: background - software factory

35. 35
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Continuous Quality Improvement in Engineering's
projects
Unified Infrastructure supporting quality processes
granting flexibility and adaptability
CMMi-DEV and ISO certifications, as independent
method to validate the compliance of processes and
infrastructure with quality standards
Set-up of Engineering’s Software Labs to enhance and
measure productivity and improve quality practices
Example #3: background - goals

36. 36
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Example #3: development scenario

37. 37
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Example #3: ALM at work

38. 38
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
• Spago4Q, the open source platform to measure, analyze and monitor
quality of products, processes and services
www.spago4q.org
“Productivity Intelligence” by
• QEST nD model, a conceptual framework for measuring process
performance based on multiple analysis dimensions (e.g. economic,
social, and technological dimensions)
www.semq.eu/leng/modtechqlm.htm
Example #3: QEST nD with Spago4Q

39. 39
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Method: Performance is expressed as the combination of the specific ratios
selected for each of the 3 dimensions of the quantitative assessment
(Productivity - PR) and the perceived product quality level of the qualitative
assessment (Quality - Q)
Performance = PR + Q
Model: QEST (Quality factor + Economic,
Social & Technical dimensions) is a
“structured shell” to be filled according
to management objectives in relation to
a specific project
Such a model has the ability to handle
independent sets of dimensions without
predefined ratios and weights - referred
to as an open model
Source: Buglione L. & Abran A., QEST nD: n-dimensional extension and generalisation of a Software Performance Measurement Model, International
Journal of Advances in Engineering Software, Elsevier Science Publisher, Vol. 33, No. 1, January 2002, pp.1-7
Example #3: QEST nD model

40. 40
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
• Three dimensions of analysis:
1. Economical (EE)
2. Social (SS)
3. Technical (TT)
• Performance values for each dimension allow to identify
process areas that need improvements
Example #3: nD analysis – 3 main dimensions

41. 41
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
The model defined for the ESL takes into account three analysis dimensions and
goals as follows:
1. Economical (EE)
E.G1 Reduce the effort of corrective maintenance
E.G2 Improve ESL Resource allocation
E.G3 reduce the effort of hardware system unavailability
E.G4 Reduce the rework (intended as impact of defects in UAT or production environment)
2. Social (SS)
S.G1 Reduce the number of non-conformity issues (QA inspection)
S.G2 Improve artifacts reuse
S.G3 Improve the number of delayed deliverables
S.G4 Improve quality of documents and source code
3.Technical (TT)
T.G1 Improve the deploy process
T.G2 Reduce the resolution time for defects and technical issues
T.G3 Improve the skills of resources
T.G4 Improve the development (FP per work/month)
Example #3: nD analysis – goals of 3 main dimensions

42. 42
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Metric ID Metric Desc Formula Source
E.M1.1 Incidence of corrective maintenance effort Corrective Maintenance Effort/FP ALM & prj registry
E.M2.1 Allocation of ESL resources Nr. Of hours allocated on prj/Tot of hours ALM & Corp. Systems
E.M3.1 Hardware System Availability Percentage System Availability System Monitoring
E.M4.1 Incidence of errors Errors (defects after release)/(erros+defects) ALM
E.M4.2 Incidence of analysis defects Analysis defects/(errors + defects) ALM
S.M1.1 n. Of Non Conformity issue Nr. Of NC/nr of Projects ALM & QA Registry
S.M2.1 Incidence of artifact reuse Nr downloads/total nr of artifacts stored Component repo
S.M3.1 Incidence of delayed deliverable Nr-delayed deliv./Tot of delayed deliv. ALM
S.M4.1 Software Complexity Results of automatic static code Code analysis tool
S.M4.2 Software mantainability Results of automatic static code Code analysis tool
T.M1.1 Incidence of deploy defects Deploy defects/(errors + defects) ALM
T.M2.1 Defects Mean Resolution Time Tot. Resolution time/Tot. Defects ALM
T.M2.2 Incidence of design defects Design defects/(errors + defects) ALM
T.M3.1 Incidence of training courses Nr. Of hours allocated on training/Tot of hours Corp. Systems
T.M4.1 Development Capability FP/effort Prj registry & Corp. Sys
Example #3: metrics

43. 43
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Top Manager
ESL Manager
Level 1
Level 2
Level 3
Project Manager
PRJ n
ESL
ESL 1 ESL 2 ESL 3
PRJ 1
PRJ n
PRJ 1
PRJ n
PRJ 1
Project developmentProject development Application maintenanceApplication maintenanceProject developmentProject development
EngineeringEngineering’’s Software Labss Software Labs
Example #3: drill-down through the organization tree levels

44. 44
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
• Unified view on Engineering Software Labs
• Unique performance indicator
• Performance comparison
Example #3: QEST nD dashboard

45. 45
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Example #3: QEST nD dashboard

46. 46
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Metrics
Reqs & Bugs
Risks
Tasks & Issues
Docs
Detailed view
Tracking and trends
Example #3: a single dimension view – project dashboard

47. 47
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Example #3: a single dimension view – ALM tool

48. 48
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Example #3: a single dimension view – quality audits

49. 49
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it
Next: Innovation Factory • Goal 1: Innovation Level Improvement
Q1.1: Which is the level of innovative
knowledge exploited in the
Organization?
Q1.2: How much are the new
products innovative?
•Goal 2 : Quality of Innovation Sources
Q2.1: Which is the quality of the
sources of the innovation process?
• Goal 3: Open Innovation Permeability
Q3.1: To what extent is the customer’s
contribution exploited?
Q3.2: To what extent are the concepts coming
from competitors' sites exploited?
Q3.3: Evaluate the level of technologies that
are transferred by the analysis of competitors
Q3.4: How much do internal proposals
influence innovative products?
• Goal 4: Return of Innovation Investment
Q4.1: How much do innovation process
produces profits?
Q4.2: How much do innovation process costs?
Q4.3: Indirect Advantages

50. 50
Creative Commons Attribution-Share Alike 3.0 Italia License
www.eng.it 50
Conclusions: how to make this happen
Open source has not intrinsic value per se
Prepare the environment and build the platform(s)
Stimulate creativity
Help bring innovation into market
Measure, assess and value the results
Finally, what’s your vision of the world where open source is a major part of
computing?
[…]
In the meshed world, what helps you be successful in a business is
influence. And, you get influence not by power but by being valuable. My
vision is that we’re switching over to this new world of influence instead of
control, of value instead of power, of participation instead of distribution.
[…] Interview to Simon Phipps, OSI Director
Linux Journal, June 2007
Let’s make it happen!