This document discusses how CA Technologies test solutions can help development teams build powerful and portable test cases that can speed up testing and development. It describes how test cases can be generated from user interfaces, application programming interfaces, and middle tiers to create data-driven functional and load tests. This automated test case generation allows testing to keep pace with rapid development by speeding the creation of regression test cases.

1. Blazing Fast Testing for Blazing Fast Apps
Chris Kraus
DevOps: Continuous Delivery
CA Technologies
Product Manager
DO4X126S
@ChrisKraus3
#CAWorld

2. 2 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
For Informational Purposes Only
Terms of this Presentation
© 2015 CA. All rights reserved. All trademarks referenced herein belong to their respective companies. The presentation provided at CA
World 2015 is intended for information purposes only and does not form any type of warranty. Some of the specific slides with customer
references relate to customer's specific use and experience of CA products and solutions so actual results may vary.
Certain information in this presentation may outline CA’s general product direction. This presentation shall not serve to (i) affect the rights
and/or obligations of CA or its licensees under any existing or future license agreement or services agreement relating to any CA software
product; or (ii) amend any product documentation or specifications for any CA software product. This presentation is based on current
information and resource allocations as of November 18, 2015, and is subject to change or withdrawal by CA at any time without notice. The
development, release and timing of any features or functionality described in this presentation remain at CA’s sole discretion.
Notwithstanding anything in this presentation to the contrary, upon the general availability of any future CA product release referenced in
this presentation, CA may make such release available to new licensees in the form of a regularly scheduled major product release. Such
release may be made available to licensees of the product who are active subscribers to CA maintenance and support, on a when and if-
available basis. The information in this presentation is not deemed to be incorporated into any contract.

3. 3 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Abstract
For many development teams, testing can be a real
bottleneck. Regression testing, performance testing, etc.
can cause development to come to a standstill. This
session will show you how test solutions from CA
Technologies can help development teams build powerful
and portable test cases that can be extended or modified
to help you speed the development process. Learn how
these test cases can be shared across different teams,
easily attach prior results and execute with different sets
of data.
Chris Kraus
CA Technologies
Product Manager

4. 4 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Agenda
FILE NEW TEST CASE VS. BUILDING FROM EXAMPLES
WHAT CAN I GENERATE FROM THE UI LAYER
GENERATING FROM THE MIDDLE LAYER
DATA DRIVEN TESTS AND NON FUNCTIONAL TESTING
1
2
3
4

5. 5 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
File new test cases and tests from examples
 Modern development
trends - contract first
 So much of the testing is
about the data
 Examples are worth a
thousand words

6. 6 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Where do the examples come from?
 Virtual Services
 Splunk
 Logs
 Examples

7. 7 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
VS.
File new test cases vs. speed? Who will win?
 Creating individual test cases via File
New in any tool is slow and manual
 Tests are created 1 at a time
 Validation tends to be missing or so
complex it takes days to build a test
 There is never enough man hours to
build new tests and adding regression
of existing applications is unattainable

8. 8 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Gaining speed in creating or generating tests
 Testing is mainly about the data and
getting the resultant data
 Generating tests from a manual test
run provides the data
 Running API tests that represents the
same data and UI increases velocity
 Computer speed vs. human click speed
VS.

9. 9 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
What can I create from within a UI layer?
 CA Application Test
– Browser tests for PC’s and
mobile browsers
– Selenium and Appium are used
to test the code running in the
browser
– Focus is to validate that the data
is being presented while actions
and navigation are working
correctly

10. 10 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
API’s behind the UI layer
 CA Continuous Application
Insight – Chrome Plugin
– View all request made by the web
page in chrome
– Generate API tests for calls behind
the UI
– Associate client side certificates for
test generation
– Get read data – no need to guess
what a radio button turns into
– Server agnostic

11. 11 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
API’s behind the UI layer
 CA Continuous Application
Insight – Java Agent
– View all request made by all
clients
– Generate API tests and virtual
services based on all client or
some clients
– Get example data from entire
regression runs
– Get read data – no need to guess
what a radio button turns into

12. 12 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Do API’s really test the same logic?
 Testing APIs does test the same
backend logic
 Game changer is brittleness
 Game changer in playback is
speed
– Internally a 2.5 hour manual test
for CA Release Automation plays
back in 10 minutes at API Layer!

13. 13 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Testing in the middle tiers
 No one ever disagrees that small
changes scare them
 The farther back in the layers of the
application the greater the fear
 It will just take to long to _____.
 Move to test case generation for
speed
ESB

14. 14 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Build the treaty for horizontal trust
 CA Service Virtualization
– Creates simulations for backend
services or environments
– Proxy recording to create a virtual
service means you have all the data
– You can generate a test case at the
same time to document your data
contracts
– Run your tests to validate system
changes in the middle of your
application
ESB
Test Case Test CaseVirtual Services

15. 15 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Generating data driven tests – functional and load
 CA Continuous Application Insight
– Agents see the data and generate tests
and virtual services
– Data driven test generation
 Identify input to first step
 Correlate output of steps to next steps
 Allow easy addition of new data
 Assertions based on dynamic data
ESB
A A
A
A

16. 16 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Q & A

17. 17 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Recommended Sessions
SESSION # TITLE DATE/TIME
DO4T03S
Analyst View: Leading Your DevOps Enterprise Journey –
Gene Kim
11/19/2015 at 10:30 am
DO3T21S
Nordstrom Succeeds in E-Commerce with Innovative
Performance Testing to Reduce Cycle Times and Improve
Quality
11/19/2015 at 11:30 am
DO3X114S
Freeing the World from Slow: How Service Virtualization
and the Concept of S.P.E.E.D. Will Steer You Away from
Committing Continuous Delivery Suicide
11/19/2015 at 3:45 pm

18. 18 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Must See Demos
Application
Test Demo
Create Better
Application Tests
Theater 4
DevOps Sim
DevOps Simulation
Experience
Theater 3
Continuous
App Insight
Automate Tests for
Better Apps
Theater 4
Service
Virtualization
Deliver Better Apps
Faster with SV
Theater 3

19. 19 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Follow On Conversations At…
Smart Bar
Theaters 3 & 4
Tech Talks
Theaters 3 & 4

20. 20 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
For More Information
To learn more, please visit:
http://cainc.to/Nv2VOe
CA World ’15