Outline
• Research team presentation
• Global view of the project
• Service registry
– QoS properties
– Transactional properties
– Registry organization
• Our approach
– Planer engine
– Executor engine
• Future project
– Service discovery
– Composite service selection
– Composite service execution
2
Research team presentation
• Researchers from
• Project initiated in 2006 by:
Marta Rukoz
(Univ. Paris X)
Joyce El Haddad
Maude Manouvrier
3
Research team presentation
• French-venezuelian cooperation with the Universidad Simón
Bolívar, team of Y. Cardinale:
• Submission in Oct. 2013 to the ANR (Agence Nationale de la
Recherche) of an extension of the project, including Operational
Research, multi-criteria and, simulation/evaluation colleagues of:
LSIS
4
Global view of the project
From El Haddad, J., Manouvrier, M., & Rukoz, M. TQoS: Transactional and QoS-Aware Selection Algorithm for
Automatic Web Service Composition. IEEE Transactions on Services Computing: 3(1), 73-85 (2010) - 108
5
citations according to Google Scholar in Nov. 2013.
Global view of the project
Input and output attributes
From El Haddad, J., Manouvrier, M., & Rukoz, M. TQoS: Transactional and QoS-Aware Selection Algorithm for
Automatic Web Service Composition. IEEE Transactions on Services Computing: 3(1), 73-85 (2010) - 108
6
citations according to Google Scholar in Nov. 2013.
Service registry
Set of services, each service being described by:
• Quality of Service (QoS) properties
– Price: Fee that a requester has to pay for invoking of the
service
– Duration: Time taken to send a request and receive a
response
– Reliability: Ratio of the number of error messages to total
messages
–…
QWS Dataset: QoS values extracted from 5,000 web services
(http://www.uoguelph.ca/~qmahmoud/qws/)
• Transactional properties : to ensure reliable execution of the
service
7
Service registry
Set of services, each service being described by:
• Quality of Service (QoS) properties
– Price: Fee that a requester has to pay for invoking of the
service
– Duration: Time taken to send a request and receive a
response
– Reliability: Ratio of the number of error messages to total
messages
–…
QWS Dataset: QoS values extracted from 5,000 web services
(http://www.uoguelph.ca/~qmahmoud/qws/)
• Transactional properties : to ensure reliable execution of the
service
8
Transactional properties
From Y. Cardinale, J. El Haddad, M. Manouvrier, M. Rukoz. Transactional-aware Web Service Composition: A
Survey, Book chapter, pp 116-141, 2011. Handbook of Research on Non-Functional Properties for Service9
oriented Systems: Future Directions, IGI Global. S. Reiff-Marganiec and M. Tilly, editor(s)
Transactional properties
Properties used in:
Bhiri, S., Perrin, O. & Godart, C. (2005). Ensuring required failure atomicity of composite Web services. In
International Conference on World Wide Web (pp. 138-147). ACM
Maamar, Z., Narendra, N. C., Benslimane, D., & Subramanian, S. (2007). Policies for context-driven
transactional web services. In International Conference on Advanced information Systems Engineering (pp.
249-263). Lecture Notes in Computer Science. Berlin, Heidelberg: Springer-Verlag
Montagut, F., Molva, R., & Tecumseh Golega, S. (2008). Automating the Composition of Transactional Web
Services. International Journal Web Service Research, 5(1), 24-41. IGI Global
Zhao, Z., Wei, J., Lin, L., & Ding, X. (2008). A Concurrency Control Mechanism for Composite Service
Supporting User-Defined Relaxed Atomicity. In IEEE international Computer Software and Applications
10
Conference (pp. 275-278).
Transactional properties
• Pivot: once successfully completes, its effects remain and cannot be semantically
undone - In in: of failure: backward recovery
Properties used case
Bhiri, S., Perrin, O. & Godart, C. (2005). Ensuring required
• Compensatable: it exists another failure atomicityor composite Web services. In International Conference on World
service, of compensation policies, which can
Wide Web (pp. 138-147). ACM
Maamar, Z., Narendra, N. C., the service execution (semantic recovery) - In case of
semantically undoBenslimane, D., & Subramanian, S. (2007). Policies for context-driven transactional web services. Infailure:
International Conference on Advanced information Systems Engineering (pp. 249-263). Lecture Notes in Computer Science. Berlin,
backward recovery
Heidelberg: Springer-Verlag
Montagut, F., Molva, R., & Tecumseh Golega, S. (2008). Automating the Composition of Transactional Web Services. International Journal
• Retriable: guaranteeIGI Global successfully termination after a finite number of
Web Service Research, 5(1), 24-41. of a
Zhao, Z., Wei, J.,
invocations Lin,May beX. (2008). A Concurrency Control Mechanism for Composite Service Supporting User-Defined Relaxed
- L., & Ding, combined as pivot retriable or compensatable retriable 11
Atomicity. In IEEE international Computer Software and Applications Conference (pp. 275-278).
Service registry organization
• Classes of services:
– grouping services with similar functionalities (e.g. services
sending email or weather services)
– When user input is a workflow (business process
decomposed into activities, each activity corresponding to a
set of services)
Service composition: selection of one service per activity
12
Service registry organization
• Dependency graph:
– Services linked by their inputs and outputs
– When user query is composed of input and output attributes
Service composition: selection of a set of paths in the graph
allowing to obtain the user output attributes from the input ones
13
Our approach
Planner engine:
• Inputs:
– A user query (workflow or I/O attributes)
– A service registry (set of classes or dependency graph)
• Outputs: A composite service
– Corresponding to user query
– Reliable (all component services successfully executed or
none of them) selecting services with appropriate
transactional properties
– Locally (using heuristic) or globally (using linear
programming – cplex solver) optimizing the QoS
Y. Cardinale, J. El Haddad, M. Manouvrier, Marta Rukoz: CPN-TWS: a coloured petri-net approach for transactionalQoS driven Web Service composition. IJWGS 7(1): 91-115 (2011)
V. Gabrel, M. Manouvrier, I. Megdiche, C. Murat: A new 0-1 linear program for QoS and transactional-aware web
14
service composition. IEEE Symposium on Computers and Communications (ICCS) : 845-850, 2012
Our approach
Planner engine:
• Inputs:
– A user query (workflow or I/O attributes)
– A service registry (set of classes or dependency graph)
• Outputs: A composite service
– Corresponding to user query
– Reliable (all component services successfully executed or
none of them) selecting services with appropriate
transactional properties
– Locally (using heuristic) or globally (using linear
programming – cplex solver) optimizing the QoS
Y. Cardinale, J. El Haddad, M. Manouvrier, Marta Rukoz: CPN-TWS: a coloured petri-net approach for transactionalQoS driven Web Service composition. IJWGS 7(1): 91-115 (2011)
V. Gabrel, M. Manouvrier, I. Megdiche, C. Murat: A new 0-1 linear program for QoS and transactional-aware web
15
service composition. IEEE Symposium on Computers and Communications (ICCS) : 845-850, 2012
Our approach
Executor engine:
• Inputs: a reliable composite service
• Outputs: a fault-tolerant execution of the composite service
• In case of failure:
– Mechanisms to substitute the failed service by another one,
guaranteeing a similar QoS (forward recovery)
– Mechanisms to compensate the results of the component
service executed before the failure (semantic recovery)
– Checkpoint mechanisms to restart the execution from an
advanced point of execution (checkpoint) corresponding to
a reliable execution of a subset of the components
Y. Cardinale, M. Rukoz: A framework for reliable execution of transactional composite web services. Proc. Of the Intt. Conf.
on Management of Emergent Digital EcoSystems, MEDES : 129-136, 2011
M. Rukoz, Y. Cardinale, R. Angarita: FACETA*: Checkpointing for Transactional Composite Web Service Execution based
on Petri-Nets. Proc. of the 3rd Int. Conf. on Ambient Systems, Networks and Technologies (ANT 2012), the 9th Int. Conf. on
16
Mobile Web Information Systems (MobiWIS-2012): 874-879, 2012
Future project
Service discovery:
• New models for Services-Users Social Network Ecosystem
• To boost the service discovery process, to propose recommendation
techniques to enhance reliable service composition and, to manage
fault-tolerant execution
• Input:
– the web (i.e. the set of available internet services)
– a user query specifying the composition he wants, the quality of
service he needs and, the fault tolerance level he may accept
• Output:
a specific view or a filtering mechanism to identify the services
(and their properties) that may answer the user’s requirements
• Based on social networking organizing previously successful
service interactions and on historical usage of services
A. Louati, J. El Haddad, S. Pinson: Trust-Based Service Discovery in Multi-relation Social Networks. Proc. of 10th Int.
18
Conf. on Service-Oriented Computing (ICSOC): 664-671, 2012
Future project
Composite service selection:
• New robust solutions by applying optimization approaches of
operational research
• For better understanding the combinatorial and multi-criteria
dimensions of the transactional service composition problem
in various contexts
• Input: subset of existing services discovered
recommended during the discovery phase
and/or
• Output: A reliable composite service
• Service recommendation mechanisms can also be used during
this step to facilitate the service selection
19
Future project
Composite service execution:
• Fault tolerance control execution mechanisms and a
quantitative and qualitative multi-criteria evaluation
allowing recommended composite services according to the
user’s goal
• Inputs: The selected service components
• Outputs: Results obtained by the reliable execution of the
composite service
• Using evaluation and fault-tolerance mechanisms associated
with operational research and recommendation-based
approaches
20
To go further
•
•
•
•
Y. Cardinale, J. El Haddad, M. Manouvrier, M. Rukoz. Transactional-aware
Web Service Composition: A Survey, Book chapter, pp 116-141. Handbook of
Research on Non-Functional Properties for Service-oriented Systems: Future
Directions, IGI Global. S. Reiff-Marganiec and M. Tilly, editor(s), 2011
Papazoglou, M.; Pohl, K.; Parkin, M.; Metzger, A. (Eds.), Service Research
Challenges and Solutions for the Future Internet: S-Cube - Towards
Engineering, Managing and Adapting Service-Based Systems, Series: Lecture
Notes in Computer Science, Vol. 6500 Subseries: Computer Communication
Networks and Telecommunications, 2010
Y. Syu, S.-P. Ma, J.-Y. Kuo, and Y.-Y FanJiang. A Survey on Automated Service
Composition Methods and Related Techniques. In Proc. of the 2012 IEEE 9th
Int. Conf. on Services Computing (SCC '12). IEEE Computer Society,
Washington, DC, USA, 290-297, 2012
A. Aleti, B. Buhnova, L. Grunske, A. Koziolek, and I. Meedeniya. Software
Architecture Optimization Methods: A Systematic Literature Review. IEEE
Trans. Softw. Eng. 39, 5 (May 2013), 658-683, 2013.
manouvrier@lamsade.dauphine.fr
21
Experimental results
Workflow-based service selection:
• Scenario 1:
– Nb of activities from 1 to 62
– Nb of services per activity and per transactional property from 1
to 2
Total of 712 services
Computational
cost almost
independent
from the
workflow size
From El Haddad, J., Manouvrier, M., & Rukoz, M. TQoS: Transactional and QoS-Aware Selection Algorithm for
Automatic Web Service Composition. IEEE Transactions on Services Computing: 3(1), 73-85 (2010) - 108
23
citations according to Google Scholar in Nov. 2013.
Experimental results
Workflow-based service selection:
• Scenario 1:
– Nb of activities from 1 to 62
– Nb of services per activity and per transactional property from 1
to 2
Total of 712 services
Computational
cost almost
independent
from the
workflow size
From El Haddad, J., Manouvrier, M., & Rukoz, M. TQoS: Transactional and QoS-Aware Selection Algorithm for
Automatic Web Service Composition. IEEE Transactions on Services Computing: 3(1), 73-85 (2010) - 108
24
citations according to Google Scholar in Nov. 2013.
Experimental results
Workflow-based service selection:
• Scenario 2:
– Nb of services per activity and per transactional property from 1
to 8 with steps of 2
Between 712 (min) to 3602 (max) services
Increase of the
computational cost with
the number of WSs
(e.g. 1,15s for 2651 WSs
= 30 to 36 potential
WSs/activity for a 40
activities workflow)
From El Haddad, J., Manouvrier, M., & Rukoz, M. TQoS: Transactional and QoS-Aware Selection Algorithm for
Automatic Web Service Composition. IEEE Transactions on Services Computing: 3(1), 73-85 (2010) - 108
25
citations according to Google Scholar in Nov. 2013.
Experimental results
Workflow-based service selection:
• 100 activities and 50 x 4 WS per activity 20000 services
• Optimal solution found in less than 5s
V. Gabrel, M. Manouvrier, I. Megdiche, C. Murat: A new 0-1 linear program for QoS and transactionalaware web service composition. IEEE Symposium on Computers and Communications (ICCS) : 845-850,
26
2012
Experimental results
Workflow-based service selection:
• 100 activities
• Complex workflows (combining parallel and XOR choice)
V. Gabrel, M. Manouvrier, I. Megdiche, C. Murat: A new 0-1 linear program for QoS and transactionalaware web service composition. IEEE Symposium on Computers and Communications (ICCS) : 845-850,
27
2012
Experimental results
Workflow-based service selection:
• By varying the number of activities
• Optimal solution found in maximum 120s for big instances
V. Gabrel, M. Manouvrier, I. Megdiche, C. Murat: A new 0-1 linear program for QoS and transactionalaware web service composition. IEEE Symposium on Computers and Communications (ICCS) : 845-850,
28
2012
Experimental results
Dependency graph-based service selection:
• Problem complexity: O(card(S)2), with card(S) the registry
size
• No increase of execution time increase due to transactional
properties
R0 : guarantee of a
compensatable resulting
composite service
R1 : no guarantee of a
compensatable resulting
composite service
NT: without considering
transactional properties
Y. Cardinale, J. El Haddad, M. Manouvrier, Marta Rukoz: CPN-TWS: a coloured petri-net
approach for transactional-QoS driven Web Service composition. IJWGS 7(1): 91-115 (2011)
29
Y. Cardinale, J. El Haddad, M. Manouvrier, M. Rukoz. Transactional-aware Web Service Composition: A
Survey, Book chapter, pp 116-141. Handbook of Research on Non-Functional Properties for Service- 30
oriented Systems: Future Directions, IGI Global. S. Reiff-Marganiec and M. Tilly, editor(s), 2011