1. BPEL Conformance
in Open Source Engines
Simon Harrer, Jörg Lenhard and Guido Wirtz
Distributed Systems Group
University of Bamberg
Bamberg, Germany
{simon.harrer,joerg.lenhard,guido.wirtz}@uni-bamberg.de

2. Business
Process
Execution
Language
2.0

3. Source: Jens Rasch / pixelio.de

4. Travel Booking Service
BPEL 2.0

5. BPEL 2.0
Open OASIS Standard; finalized in 2007
De facto Standard for Orchestrations
Used in many approaches

6. BPEL 2.0
Open OASIS Standard; finalized in 2007
De facto Standard for Orchestrations
Used in many approaches
Fully Conformant Engines ensure
- Portability
- Avoidance of Vendor Lock-In

7. BPEL 2.0
Open OASIS Standard; finalized in 2007
De facto Standard for Orchestrations
Used in many approaches
Fully Conformant Engines ensure
- Portability
- Avoidance of Vendor Lock-In
Are we there, yet?

8. 5 Open Source BPEL Engines
128 BPEL Test Cases
10 Hours
640 Test Results

9. 5 Open Source BPEL Engines

10. 5 Open Source BPEL Engines
Apache ODE*
bpel-g**
OpenESB
Orchestra
Petals ESB
* Used in WSO2 Business Process Server, Intalio|BPMS and JBoss RiftSaw
** Based on ActiveBPEL, a previously commercial product of active endpoint

11. 5 Open Source BPEL Engines
Apache ODE Maintained
bpel-g
OpenESB Latest Release
Orchestra
Petals ESB Mature

12. 5 Open Source BPEL Engines
“BPEL 2.0 conformant”
Apache ODE Maintained
bpel-g
OpenESB Latest Release
Orchestra
Petals ESB Mature

13. 128 BPEL Test Cases

14. 128 BPEL Test Cases
BPEL
Specification

15. 128 BPEL Test Cases
BPEL
Specification
basic structured
scopes
activities activities
Chapter 10 Chapter 12 Chapter 11

16. 128 BPEL Test Cases
BPEL
Specification
basic structured
scopes
activities activities
Assign EventHandlers If
Empty FaultHandlers While
…. …. ….

17. 128 BPEL Test Cases
BPEL
Specification
basic structured
scopes
activities activities
Assign EventHandlers If
Empty FaultHandlers While
…. …. ….

18. 128 BPEL Test Cases
While
<process>
<partnerLinks />
<variables />
<sequence>
<receive />
<!−−MAIN EXTENSION POINT−−>
<assign />
<reply />
</sequence>
</process>

19. 128 BPEL Test Cases
While
<process>
<partnerLinks />
<variables />
<sequence>
<receive />
<assign name="InitializeLoopCounter">
<!-- $Counter = 0 -->
</assign>
<while name="While">
<condition>$Counter < $Input</condition>
<assign name="IncrementLoopCounter“ >
<!-- $Counter++ -->
</assign>
</while>
<assign />
<reply />
</sequence>
</process>

20. 128 BPEL Test Cases
While
<process>
<partnerLinks />
<variables />
<sequence>
<receive />
<assign name="InitializeLoopCounter">
<!-- $Counter = 0 -->
</assign>
<while name="While">
<condition>$Counter < $Input</condition>
<assign name="IncrementLoopCounter“ >
<!-- $Counter++ -->
</assign>
</while>
<assign />
<reply />
</sequence> Test Input Assertions
</process> synchronous: 5 output: 5

21. 128 BPEL Test Cases
tests
Assign 18
Empty 1
Exit 1
Invoke 11
Receive 5
basic
ReceiveReply 11
Rethrow 3
Throw 5
Validate 2
Variables 3
Wait 3
Compensation 5
CorrelationSets 2
EventHandlers 8
scopes
FaultHandlers 6
MessageExchanges 3
PartnerLinks 1
Scope-Attributes 3
TerminationHandlers 2
Variables 2
Flow 9
structured
ForEach 10
If 5
Pick 5
RepeatUntil 2
Sequence 1
While 1

22. 128 BPEL Test Cases
tests
Assign 18
Empty 1
Exit 1
Invoke 11
Receive 5 Quality Assurance
basic
ReceiveReply 11
Rethrow 3
Throw 5
Validate 2
Variables
Wait
3
3
- Permutate Configuration
Compensation
CorrelationSets
5
2 - XML Schema Validation
EventHandlers
- Peer—Review in Group
8
scopes
FaultHandlers 6
MessageExchanges 3
PartnerLinks
Scope-Attributes
1
3 - Publicly availability
- 95% of Test Cases run
TerminationHandlers 2
Variables 2
Flow 9
on at least one engine
structured
ForEach 10
If 5
Pick 5
RepeatUntil 2
Sequence 1
While 1

23. 10 Hours
Source: Bernd Deschauer / pixelio.de

24. 10 Hours
Generate
Reports
per engine and per test case
Generate Generate Install Start Deploy Execute Stop
BPEL Test Engine Engine BPEL Test Engine
Prepare
Folders

25. 10 Hours
Generate
Reports
640 times = 5 engines * 128 test cases
Generate Generate Install Start Deploy Execute Stop
BPEL Test Engine Engine BPEL Test Engine
Prepare
Folders

26. 10 Hours
Generate
Reports
640 times = 5 engines * 128 test cases
Generate Generate Install Start Deploy Execute Stop
BPEL Test Engine Engine BPEL Test Engine
Prepare
Folders 8 hours
for test isolation

27. 640 Test Results
Source: S. Hofschlaeger / pixelio.de

28. 640 Test Results
bpel-g
1
Apache ODE
2
OpenESB
3
Orchestra
4
PetalsESB
5

29. 640 Test Results in %
bpel-g
67 80
Apache ODE
OpenESB
Orchestra
66
PetalsESB
49 24

30. 640 Test Results in %
bpel-g Apache ODE OpenESB Orchestra Petals ESB
basic
activities78 60 54 41 25
scopes 78 78 84 47 22
structured
88 70 70
activities 58 24
Σ 80 67 66 49 24

31. 640 Test Results
••••• 100
•••• 75-99
••• 50-74
•• 1-49
• 0
bpel-g Apache ODE OpenESB Orchestra Petals ESB
Assign ••• ••• ••• •• ••
Empty ••••• ••••• ••••• ••••• •••••
Exit ••••• ••••• ••••• ••••• •••••
Invoke ••• ••• •• ••• ••
Receive •••• ••• •• •• ••
basic
ReceiveReply ••• •• •• •• ••
Rethrow ••••• ••• •• • •
Throw ••••• ••••• •••• • •
Validate ••••• • ••••• • •
Variables ••••• ••• ••• •• ••
Wait •• ••••• ••••• ••• ••
Compensation ••••• •••• ••••• •• •
CorrelationSets ••••• ••••• ••• • •
EventHandlers •• •••• •••• ••• •
scopes
FaultHandlers ••••• ••••• ••••• •• ••••
MessageExchanges ••••• •• •• •• •
PartnerLinks ••••• ••••• ••••• ••••• •
Scope-Attributes ••••• ••• ••••• •• •••
TerminationHandlers • • ••••• ••••• •
Variables ••••• ••••• ••••• ••••• •
Flow ••••• ••••• •• •••• •
structured
ForEach •••• •• •••• • ••
If ••••• •••• •••• •••• ••••
Pick ••• ••••• •••• •••• ••
RepeatUntil ••••• ••• ••••• ••••• •
Sequence ••••• ••••• ••••• ••••• •••••
While ••••• ••••• ••••• ••••• •••••

32. Portability ?
0,8
0,59
0,45
0,25
0,15
1 2 3 4 5

33. Portability ?
0,8
0,59
0,45
0,25
0,15
1 2 3 4 5

34. 5 Open Source BPEL Engines
128 BPEL Test Cases
10 Hours
640 Test Results

35. 5 Open Source BPEL Engines
128 BPEL Test Cases
10 Hours
640 Test Results
Limited Portability

36. Source: Karl Dichtler / pixelio.de

37. 5 BPEL Engines
128 BPEL Test Cases
10 Hours
640 Test Results

38. 5 BPEL Engines
128 BPEL Test Cases
10 Hours
640 Test Results

39. 5 BPEL Engines
128 BPEL Test Cases
10 Hours
640 Test Results

40. Try it!
Web Site https://github.com/uniba-dsg/betsy/
Source Code https://github.com/uniba-dsg/betsy/tree/soca-2012
We ♥ Feedback