This document provides an overview of building a risk-based testing strategy for SAP applications. It discusses the need for such a strategy due to the constant changes in SAP systems and digital technologies. It then introduces Worksoft Certify Impact, a solution that helps identify business process tests impacted by SAP transports and automatically executes those tests. The solution analyzes change impacts, locates related tests, and executes them to validate changes. This allows teams to focus testing on only the areas affected by changes.

1. 1
Everything You Need to
Build a Risk-Based
Testing Strategy for SAP
Chris Kraus
Sr. Director Product Management
Email: ckraus@worksoft.com,
Twitter: @ChrisKraus3
4/12/2017 © 2017 Worksoft, Inc.

2. 2
• Perspective – Change is a Constant
• Building a Risk Based Testing Strategy for SAP
• Introduction to Worksoft Certify
• Demo
• Q and A
4/12/2017 © 2017 Worksoft, Inc.
Agenda

3. 3
“By 2020, 60% of digital businesses will
experience a major service failure because of
IT teams’ inability to “manage digital risk in
new technology and use cases.”
Gartner Projection
The Pace of Change Drives Digital Risk

4. 4
“This is probably good news for incumbents, since many of them
are carefully watching tech start-ups to identify the winning plays
and then imitating them at their own bigger scale. That approach,
to be sure, demands cutting-edge agility to excel on all the
operational and organizational aspects of digital maturity.”
4/12/2017
Source http://www.mckinsey.com/business-functions/digital-mckinsey/our-insights/the-case-for-digital-reinvention
Agility Has Never Been More Important!

5. 5
SAP… Change Is a Constant
• When a new process becomes available, how quickly can I integrate the process
into my business and begin realizing its benefits?
• How can I decrease the time required to implement system changes and events?
• How do I improve implementation performance, mitigate risks, leverage
accelerators, and measure adoption?
EFFORT
ONGOING
CHANGE
EVENTS
DISCRETE
CHANGE
EVENTS
…establish a quality platform to minimize time/cost of change event efforts
Consolid.
New
Implementation
Upgrades
New Processes
TIME
Custom
Dev.
Custom
Dev.
Custom
Dev.
Hot
Packs
Support Pack Support Pack
CHANGE EVENTS
Business drivers
 Changed business processes, M&A
re-organizations & new products,
vendors…
Compliance drivers
 Governance, risk management &
compliance
Technology drivers
 New functionality & Upgrades
Transforming software change control into business change control –
company-wide, across SAP and non-SAP landscapes

6. 6
“Quality & Testing”
Biggest Pain Point Of Upgrades
0
10
20
30
40
50
60
70
80
90
83%
17%
% Members
IN THE
PROCESS OF
UPGRADING
NOT
UPGRADING
Major Cost and Time Factors during Upgrade or
Implementation, % Customers
QA & Testing
Change Mgmt.
Planning
Training & Doc.
Resource Mgmt.
Complexity
Project schedule
n=52
75%
30%
16%
12%
7%
5%
0%
Source: ASUG Test influence council member survey 2013
Testing and coverage is
the #1 stated pain point
for all customers
Over 86% of customers
are concerned about
risks due to lack of
comprehensive testing
Complexity and project
schedule are rated
much lower compared
to the rest

7. 7
The SAP systems are extremely
complex and getting more so at an
alarming pace!
• Many touch points with
other internal and external systems
increase risk-prone breakage areas
• Multi-component development
efforts greatly increase
wait/downtime
• Complexity of systems renders
duplication for Dev/QA extremely
costly if not altogether impossible
Top SAP Testing Pain Points
Number of interfaces
(counting point-to-point connections):
Source: Results of the global Survey 2016 for SAP Process
Integration (Part 1 of 2)
% of users

8. 8
Unclear poorly
defined
Requirement
Risks
Complexity
Technical
Risks
Failure to
address priority
conflicts
Schedule
Risks
What Are the Risks?
“Risk Based Testing is a method for prioritizing the tests based on the risk of their
failure because testers cannot test everything with available resources, usually it
starts early in the project cycle.”
Source: International Journal of Computer Applications (0975 – 8887), Volume 65– No.1, March 2013. Risk-based Testing
Techniques: A Perspective Study. Md. Mottahir Alam and Asif Irshad Khan.

9. 9
• Prioritize tests based on ability to discover
defects – Find the Really Bad Stuff First
• Allocate testing resources based on potential
business impact and increase testing
efficiency
• Ability to optimize compressed test windows
without increasing critical defect risks
• Better Manage Change and GO FASTER!
4/12/2017 © 2017 Worksoft, Inc.
Benefits of Risk Based Testing

10. 10www.worksoft.com
Quick Intro to Worksoft
Automation for End to End Business Process Testing
Global Organization
Offices in Dallas TX, London
UK & Munich Germany
Diverse Global 5000
customers across N. America,
Europe & Asia
Worldwide support and
services
Innovative Technology
First-to-market with business process
testing. First with process mining for
SAP.
Focus on Enterprise Apps: SAP,
Salesforce.com, Workday, Oracle
and many others
5 patents awarded, 2 in progress
Ranked #1 by Gartner in Test
Automation for Packaged Enterprise
Applications
Diverse Community
SAP Partner
Global partnerships with the
leading system integrators
Thriving practitioner
community with peer learning,
blogs & customer-generated
content
Worksoft University and
certification programs

11. 11
4/12/2017 © 2017 Worksoft, Inc.
How Do You Manage the Change?
Common Approaches for Risk Based Testing in SAP Transports
Option 1 - Use Solution Manager, Run TBOMs & BPCA
Challenge: Updated Business
Blueprints are required.
Challenge: Transactions need to be
run with the TBOMs running to get
dynamic code analysis.
BPCA
(Business
Process Change
Analyzer)
1
3
2

12. 12
Advantages:
• Speed - Tests can then
be immediately run in
Worksoft Execution
Manager or HP QC
• Insights - Data can be
imported into Worksoft
Analyze and graphically
visualized
4/12/2017
How Do You Manage the Change?
You Don’t Have to Test Everything. You Just Need to Test the Right Things.
Option 2 - Use Worksoft Certify and Impact
What Do
We Have?
What Are the
Risks?
What’s
Changing?
See the SAP
transactions,
programs and
objects that
are effected
Learn the risks by seeing
what is not covered and what
the STO3 associated risks are.
Overlay your existing
Certify processes that
test those Tcodes.
1
3
2

13. 13www.worksoft.com
Worksoft Solutions & Technology
From Continuous Delivery to Continuous Transformation
Discovery &
visualization
Process Mining for
SAP
Interactive & Passive
Capture
Advanced analytics
Business process testing
Certify Impact
Visual authoring
Out-of-the-box
optimizations for select
enterprise apps
Continuous execution
Lights-Out testing
Multi-tenant cloud
services
Massive, elastic VM
support
Worksoft Analyze® Worksoft Certify® Operations Suite

14. 14
Worksoft Certify Impact: Risk Based Testing for SAP
Developed for change management teams and non-technical users
Certify Impact Key Features:
• Automated change impact analysis for SAP
• Automated identification of changes made by transports in SAP
• Identification of appropriate tests to run in Worksoft Certify test
portfolio
• Integrates with SAP’s BPCA for a more detailed change analysis
• Works in real-time
Only execute the tests needed to
verify the change, not the entire
regression library!
Certify Impact minimizes the time required to test
changes as they are brought into the SAP landscape
WHAT IMPACT IS NOT GOOD FOR:
Conquering the Complexity of SAP Changes!
• Comparisons between two SAP systems
• Code analysis
• Reporting of object level changes.
BPCA can be used for this level of detail. We
help with BPPs and TBOMs.

15. 15
3. Execute Identified Business Process Tests
to Validate Changes in SAP System
2. Locate impacted objects
in Worksoft Certify Business
Process Tests
 Provides an SAP-specific solution for ABAP-stack applications
 Performs a deep and thorough analysis of selected SAP transports
Certify Impact – Approach
Certify Impact
SAP® Applications
ERP
SAP Applications Certify Database
Transports
Worksoft Certify®
Business
Process Tests
1. Inspect Transport for
Impacted Transactions and
Programs
Impacted Objects

16. 16
Example Of Certify Impact Object Analysis
Domain
Data Element
Fields
Tables
Structures
Function Module
Include Program
Calling Program
Transaction
IDOC_INPUT_ORDERS
D_AUART
RV45A
AUART
VBAK
VBAK-AUART
MV45AOAT
VA01
SAPMV45A

17. 17
• Analyze change for
• Identify major and minor projects
• Run and sustain
• Integrate with the testing platform
• Automatically identify test cases that match the
changes being made by the transports
• Automatically execute the test cases from the tool
• Identify testing gaps
• Verify where the gaps exist between current test
library and the changes being made
Impact in Action

18. 18
DEMO

19. 19
• Minimizes the time and resources required to test changes in SAP
• Focus resources specifically on what’s new and different
• Identify, recommend, and execute end-to-end business process tests based
on a set of proposed SAP application changes and their relationships to
critical business processes
• Increases quality in business process execution
• Provides a safeguard for identifying and testing changes before committing to
production
Certify Impact – Business Benefits

20. 20
IDC Validates the Value of Worksoft Certify
The Business Value of Worksoft Automated Business Process Validation Solutions
Source: The Business Value of Worksoft Automated Business Process Validation Solutions a commissioned August 2014 study conducted by IDC on behalf of Worksoft.
Method: IDC assessed the cost, benefits, and value associated with the use of Worksoft Certify by the 12 organizations interviewed for this white paper over a five-year period.
Worksoft Extends Automation and Drives Business Agility
ROI
273%
NPV
$11.46M
PAYBACK
11.9 mos.
INCREASED AUTOMATION
Automated business process
tests increased from 12% to
44%.
IMPROVED PRODUCTIVITY
Staff hours spent doing
regression testing reduced by
48%.
LOSSES FROM DEFECTS CUT
Productivity losses from
defects entering products cut
by 44%.
"We were looking for more seamless automation and fewer starts and stops for our regression
testing. Worksoft filled that gap. We went from having about 50% to 80% of our regression
processes automated."

21. 21
Questions?

22. 22
Join Worksoft at SAP SAPPHIRE 2017!
May 16-18, 2017
Orlando, FL
Booth #738

23. 23
• White Paper: Risk-Based Test Automation from a Business
Process Perspective
• Analyst Report: The ROI of Worksoft Solutions: IDC Report
• Data Sheet: Certify Impact
4/12/2017 © 2017 Worksoft, Inc.
Resources: