The presentation supported the speech by Stefano Scamuzzo and Antonio Majori at SIMPDA 2011, the First International Symposium on Data-Driven Process Discovery and Analysis, taking place in Campione d'Italia (Italy) from 29th June to 1st July 2011.
SIMPDA 2011 - Business opportunities in applying Process Mining to operational and management enterprise processes
1. Business opportunities in applying Process Mining
to operational and management enterprise processes
The point of view of a Systems Integrator
Antonio Majori, Stefano Scamuzzo
Research & Innovation Division
Engineering Group
antonio.majori@eng.it stefano.scamuzzo@eng.it
www.spagoworld.org
2. Introduction to Engineering Group
Process mining goals & prospective
Process mining & integration middleware
Process mining & Intelligence
Use Cases
Conclusion
www.spagoworld.org
3. Engineering Group
The leading Italian independent privately-owned software and Information Technology
services company, in the top 10 European software and services provider list.
A complete and integrated offering: software development, systems integration,
consultancy, outsourcing, proprietary and open source products.
Benelux
Brazil
Argentina Italy
Lebanon
40 BRANCHES IN ITALY, BENELUX, LATIN AMERICA AND THE MENA AREA
1,000 LARGE ACCOUNTS IN ALL MARKET SECTOR
758.6 M€ REVENUE (2010)
www.spagoworld.org
4. Engineering Group and Innovation
Production environments aimed at continuous innovation, flexible approach, knowledge of
vertical business models, cross-market technological expertise in best brand and
proprietary solutions, sustained by the training-research-innovation virtuous circle.
Research Innovation
PA and Healthcare
System Integration
& Consultancy
Open Source and Business Intelligence
Enterprise Resource Planning
Automation and Controls
Enterprise Content Management
Broadband Media Services
Geographic Information System
Industry
Finance
Managed
Utility
Telco
operations
Solutions
Training
6.500 IT SPECIALISTS
400 R&I SPECIALISTS
www.spagoworld.org
5. Engineering Group and Industrial Open Source
The only entirely open source,
The open source platform for the
innovative and flexible business
governance of middleware services and
intelligence suite
the development of SOA/BPM applications
eclipse Business Process extended Business Activity
Management Monitoring
www.spagoworld.org
The java enterprise framework for the
The open source platform to measure,
development of web and multichannel
analyze and monitor the quality of
applications in SOA environments
product, procersses and services
SpagoBI, Spagic, Spago4Q and Spago are hosted by the forge of:
eBPM and eBAM are hosted by the forge of:
www.spagoworld.org
6. Goals and proposals
To enrich open source platforms providing them with functionalities that
support a process-based approach
To support As Is analysis activities
To support the usage of mining techniques on existing information
To provide simulation solutions in the context of process refactoring
To manage the separation between Operational and Intelligence data,
making easier the adoption of intelligence services in projects
www.spagoworld.org
7. SOA Universal Middleware / context
High
Business sponsorship
Business-Led Enterprise
Projects Projects
Drivers
Drivers
Unified Information with SOA
Unified Information with SOA
Process IT-Led
Projects Projects Designing your own information
Designing your own information
system, starting from strategic
system, starting from strategic
High planning
planning
Low
SOA Complexity
www.spagoworld.org
8. From information silos to Universal Middleware
Information Silos
Information systems are unable to properly manage
interactions with the related information systems.
Manufacturing
Financial
Booking
Financ.
CRM
CRM
……..
…
SOA Enterprise Service Bus
Unified logical application
The Integration Bus facilitates relationships with user’s views on services organized
between systems, but …it’s still an organization by rules, processes and compositions
made of separated units and we are lacking:
unified information
collaboration
definition of a strategic plan.
www.spagoworld.org
9. Architectural Framework
We need an architectural framework to support new projects in aacollaborative components
We need an architectural framework to support new projects in collaborative components
development model through a process-based design where services work in synergy on
development model through a process-based design where services work in synergy on
information that is unique, consistent and shared.
information that is unique, consistent and shared.
Due to time constraints, related to various organisation rules and opportunities, aanew service is
Due to time constraints, related to various organisation rules and opportunities, new service is
carried out in two phases: integrating existing systems; re-engineering processes and the
carried out in two phases: integrating existing systems; re-engineering processes and the
business logic.
business logic.
Where is the
Requirements ? information ?
New components ? Reuse ?
Components deploy on
infrastructural nodes
Standard
Connectors
Process diagrams
Application services New Platform
Infrastructure services
Methodologies Monitoring &
Unified Information Management
www.spagoworld.org
10. Platform & Process Mining
Process Mining Universal Middleware
Analysis – discovery
from legacy log of user activity, services Middleware
Services manager
and process
Process
& Rules
Front-end modules
Runtime – conformance
verify a new process model
Back-end modules
modules
Integrat.
Refactoring – extension
test the possible extensions to the
WS/SOAP
Unified
DBMS
DOC
JMS
processes.
….
Information
External systems
(application, DBMS, middleware, ..)
www.spagoworld.org
11. Planning & Process Mining
Process Mining techniques can be adopted throughout the whole project life cycle:
As-Is Activity Analysis
To-Be Activity Analysis
Develop the first release
Define/develop new extensions in order to substitute some external systems.
www.spagoworld.org
12. Governance & Project team organization
User Interface
User Interface Processes & Rules
Processes & Rules Components
Components
Architect/Developer
Architect/Developer Analyst
Analyst Architect/Developer
Architect/Developer
Design User Interface
Design User Interface Design new components
Design new components
Discovery
Discovery Search widget
Search widget Search components
Search components
on catalog
on catalog on catalog
on catalog
Rules
Rules
Develop Ajax UI
Develop Ajax UI Develop components
Develop components
(rules engine)
(rules engine) Conformance
Conformance
Develop User
Develop User BPM Process
BPM Process Complete BPMN
Complete BPMN
Business Logic UI
Business Logic UI (BPMN)
(BPMN) (technical information)
(technical information)
Develop User
Develop User
Business Logic UI
Business Logic UI
Publishing
Publishing Publishing
Publishing
on Catalog
on Catalog on Catalog
on Catalog
Publication
Publication
Proxy Configuration
Proxy Configuration configuration
configuration
Application war
Application war
Extension
Extension
www.spagoworld.org
13. Spagic: open source SOA Universal Middleware
Governance
Process &
BPM
Service
modeling
management
Business
Business Rules
Activity
management t
en Inte
monitoring
m
age gra
tion
eForm an /Co
ope
M rati
d on M
Lifecycle an BPM/ETL
iddl
g Engine ewa
in
el re
od Cooperation
M
ss Connectors
ine Integration
B us SOA ESB
Application
(Web-Mobile)
(Web-
www.spagoworld.org
15. Use case: tree years for the new ERP / As IS
Accounting Suppliers
CRM
Back-office
Resources Portals
(Legacy)
Counter
DW Services
HR IDM
(security)
Unrelated application silos: each area contains multiple unrelated applications.
Unrelated application silos: each area contains multiple unrelated applications.
Non-homogeneous technologies (Java, Access, Cobol, ..).
Non-homogeneous technologies (Java, Access, Cobol, ..).
Organizational processes relying on individual relations (e.g. telephone
Organizational processes relying on individual relations (e.g. telephone
calls) where data exchange can not be controlled (e.g. MS-excel and manual entry).
calls) where data exchange can not be controlled (e.g. MS-excel and manual entry).
Information is fragmented and often duplicated in different systems.
Information is fragmented and often duplicated in different systems.
Governance on systems and not on processes; therefore lack of SLA.
Governance on systems and not on processes; therefore lack of SLA.
Difficult professional growth of the corporate staff.
Difficult professional growth of the corporate staff.
www.spagoworld.org
16. Use case / To Be
No more silos: two dashboards for all services supported by an integration bus
(ESB) and defined by processes and rules. Governance on a single monitoring
environment.
Back office Dashboard Front-office Dashboard
Front End modules Front End modules
External Systems
External Systems
User User User User
Component Component Component Component
Service Manager Service Manager
Business Business Business Business
Components Components Components Components
Interf. Interf. Interf. Interf. Interf. Interf.
Integration BUS Integration BUS
Connect. Connect. Connect. Connect. Connect. Connect.
Middleware Services
RULES Management
Registry BPM ETL DOCUM. IDM
Engine Monitoring
www.spagoworld.org
17. Use Case / Solution with Process Mining
As IS pre analysis
Organizational processes designed through the ARIS modeler
To Be analysis
Functional &
Business Transaction
Technical
Component Log
Analysis
Detail Process BPM Spagic Execution
(ARIS) generation BPM Process log
Extraction of
ProM Mining
Knowledge
Tuning & Refactory
www.spagoworld.org
18. Business Intelligence / context
New data sources
Traditional BI is over
The need to discover information in data
The growing importance of time and space
www.spagoworld.org
19. Business Intelligence / emerging requests
Business Performance Management
Business Activity Monitoring
Real Time Business Intelligence
www.spagoworld.org
20. Business Intelligence / real time
… is not analyzing all your operational data …
… is not loading all your operational data into
the Data Warehouse aside historical ones …
IT’S ABOUT DETECTING RELEVANT EVENTS
Complex
Event
Processing
Process Mining emerges as a crucial technique
to discover hidden information
www.spagoworld.org
22. Business Intelligence / PM in SpagoBI
Extract unknown or hidden information from process data
in some structured form, such as events and logs
Detecting inconsistencies between process models and
process instances
Gathering hidden information that suggests the creation
of new process models
www.spagoworld.org
23. Business Intelligence / an example
On-line reservation systems for healthcare systems,
through the single point of contact, named CUP
The goal is to monitor the quality of health information
systems for citizens
www.spagoworld.org
24. Business Intelligence / how RT and BAM work
Data Source
Events
REAL TIME
Real Time
Console Other SpagoBI
Complex Engines
Event Processing
Engine
HISTORICAL
ANALYSIS
Database
• Integrated with BPM
– Start/stop of processes
• Interacting with monitored objects
www.spagoworld.org
26. Conclusion
Process Mining
Design
Operational Intelligence
Environment Environment
Process Mining
Process Mining can be the bridge between operational and intelligence
environments in enterprise projects where the design activity crosses all
domains and departments: analysis and refactoring
www.spagoworld.org