Universal test solutions customer testimonial 10192013-v2.3

©2012 UTS Global,Confidential and proprietary.All rights reserved worldwide.
1
Redefining Test Automation by Innovating Possibilities
Universal Test Solutions
01 Apr 2013
Test Optimization to Align Business with IT

2
Agenda
and what did we do to “ make the it happen”
Which has helped in Business Value Realization of our client
and what has changed with it
How we accomplished it….
1
2
3
4
5
and who we are6
What got us thinking …

3
Over past three decades, there has been an explosion of test
automation tools and heightened customer expectations…
Modularity driven
testing Data driven testing Keyword Driven
Hybrid
Keyword/Data
Driven
1994-2001 2001-2005 2005-2008 2008-2012
Variety of tools over generations
Frameworks for automation

4
but test automation is perceived as risky and failing to meet
ROI expectations….
Cost of Failed Implementations 2004 2012 (Estimated)
Industry: TestAutomation (net worth) $ 1 billion $ 6 billion
Automation Projects (failure cost) $ 1/2 billion $ 3 billion
*Ovum Study Projects the testing tool market to be worth 56 billion US
dollars by 2013 growing at an rate of 9.5 %
Source A: ROI on Test Automation – http://www.keane.com
Source B: HP pays 4.5 billion to acquire mercury - http://www.mytimes.com/2006/07/26/technology/26hewlett.html

5
Test automation is not as easy as it seems to be: just buy one of the popular test
execution tools, record the manual tests, and then play them back whenever you
want to.
Need of Specialized
Skills
(Scripting Knowledge +
Testing + Domain)
High Startup Cost
and Effort
(Tools, Frameworks,
Converting Manual Test
Cases to Automation)
Unforeseen
Maintenance Cost
(Change in Application, Test
Data, Test Environment)
Long Learning Curve
and Team
collaboration
Change in Team
Focus from Quality
to Solution
despite steep investment, high cost skill deployment and
uncertainty of costs

6
Agenda
1
2
3
4
5
and who we are6

7
7
Gen 3rd
Keyword
Driven
Scripting
Gen 1st
Modular
Scripting
Gen Zero
Record
&
Play
Gen 4th
Hybrid Data +
Keyword
Scripting
Gen 2nd
Data
Driven
Scripting
A Step towards innovating possibilities …..

8
8
Gen 3rd
Keyword
Driven
Scripting
Gen 1st
Modular
Scripting
Gen Zero
Record
&
Play
Gen 4th
Hybrid Data +
Keyword
Scripting
Gen 5th
Introducing Script less
Automation for UI and Non
UI (Web Services)
Gen 2nd
Data
Driven
Scripting
by redefining test automation…..

9
9
XPATH Check
Regular Expressions
Descriptive Programming
Fuzzy Logic
Artificial Intelligence
Social Intelligence
Gen 3rd
Keyword
Driven
Scripting
Gen 1st
Modular
Scripting
Gen Zero
Record
&
Play
Gen 4th
Hybrid Data +
Keyword
Scripting
Gen 5th
Introducing Script less
Automation for UI and Non
UI (Web Services)
Gen 2nd
Data
Driven
Scripting
We have redefined test automation…..
Artificial Intelligence
New Era in Testing- introducing revolution in test automation…

10
by eliminating challenges to Align business with IT
Test automation is not as easy as it seems to be: just procure one of the TestMagicTM
popular test execution tools, record navigate the manual tests, and then play them
back whenever you want to.
Need of Specialized
Skills
(Scripting Knowledge +
Testing + Domain)
High Startup Cost
and Effort
(Tools, Frameworks,
Converting Manual Test
Cases to Automation)
Unforeseen
Maintenance Cost
(Change in Application, Test
Data, Test Environment)
Long Learning Curve
and Team
collaboration
Change in Team
Focus from Quality
to Solution

11
11
with drastically improved test automation creation and execution
metrics
Key Parameters Other
Tools
Test
Magic
Remarks
Automation Script Creation % Effort of Overall Automation Effort
Automation Framework Approach & Architecture
Finalization & Creation/Customization of the
Automation Framework
15% 0% It’s Inbuilt in eZscript and can be implemented to any web
based product directly.
Creation Of the object Repository (GUI/Objects
Learning)
10% 0% eZscript has intelligence to identify object directly from the web
page.
Creation of Reusable Function Library 10% 0% eZscript is having action based keywords hence grouping of
actions creates a functions/Business Component.
Creation of Keyword driven (KWD) automated test
scripts and converting it to data driven
40% 25% eZscript has the inbuilt capability and creates the KWD script
during manual testing.
KWD Review & Dry run 15% 10% Debug Mode Execution enable to test script with different set
of data.
Fixing and tuning of Object Repository/ Automated
Framework
10% 5% Artificial Intelligence; No Object Repository.
Automation Script Execution
Automation Test Management 10% 5% Test Magic has UI based test management.
Automation Execution 70% 40% Execution is faster because of the Artificial Intelligence
approach to identify object
Reporting the issues/defects from team and
merging/publishing reports of a release
20 % 15% Test Magic has huge web based Report Dashboard which can
be emailed or printed .
Approx. 60 %
Effort Saving
Approx. 40%
Productivity
Improvement

12
and improving product quality, increasing test infrastructure
utilization and enhancing operational efficiency …
Product
Quality
Operational
Efficiency
Automate more regression testing,
achieve greater test coverage
Automate testing both UI and non-UI
including SOA architectures
Collaboration(manual & automation)
Eliminate repetitive manual tasks,
minimize errors and troubleshooting
Share expensive assets across multiple
projects and user groups
Max Resource Utilization- Manage and
automate allocation of automation test
lab assets, Test Sets, and execution of
automated test scripts.
Reduce capital and operating costs by
improving scalability
Easy to use by all levels of testing staff
Test
Infrastructure
Utilization
TestMagicTM
enable IT
Cost savings
TestMagicTM
Enable
Time savings

13
Agenda
Which has helped in Business Value Realization of our clients
1
2
3
4
5
and who we are6

14
14
Background and client situation
Background
Client is a software product MNC in USA having completesolution for Cards and Payments.Their product
interfaces with multiple applications such as
–Visa/MasterCard - Analytics system
–General Ledger - Payment Gateway
–ACH - Embossing Vendor
–IVR - Credit Bureaus
–Dialer - Statement & Letter Production Vendor
Client Situation & Challenges
The Client faced the following challenges with respect to cards testing across their global delivery centers
- Real-time processing - Online, real-time access to data
- Complex authorization parameters and rules testing - Effective dating of all transactions and rules
– Flexible, user-defined billing cycles - Flexible pricing and payment terms
– Generic model for the organization – encompassing all applications - Multiple languages
– Multiple team support (over multiple locations) - Multiple currency capabilities
– Multiple environnent support (for multiple applications)

15
15
TestMagicTM Empowered
~10 %
improvement in
Schedule
~ 75 %
Automation
coverage
~ 23 %
improvement in
defect verification
of Showstopper
bugs
Overall 27%
reduction in cycle
time
Before TestMagicTM
Implementation
• Resource-intensive and time-consuming Most of the
Testing exceed 50% of development cost
• Automation Test Script Creation, Execution and Result
Analysis was time consuming and need SME for all.
• Low Test Coverage 50% resulted in High Defect
Slippage in Production
• High Learning Curve
After TestMagicTM
Implementation
• Test execution cost came down from 25 USD to 10 USD
in first release
• 40% reduction in cycle time
• 100% Test Coverage
• Accelerated Time To Production
• Increase in 10% Adhoc Bugs
• Reduces the learning effort by 82%

16
16
with acknowledgement and recognition from the client …….
TestMagic is comprehensive testing automation software that we have been using for
more than 2 years in Production.We are fully satisfied with TestMagic’s software and
the services they have provided us.
TestMagic is a highly flexible automation solution designedforcomplete web application
testing including Rule based File testing, validation of data in Database.TM’s team has
delivered numerous customizations we asked forwith short turnaround time helping us
meetour stringent delivery schedule.The software is capable of providing high
throughput and is very scalable. Its processing speed is limited only by the number of
machines (processors)that are used. This is very critical for regressiontesting of
complexfinancial software such as ours. The productis easy to use and can be
mastered in as less a couple of days. TM’s supportteam has also provided us prompt
and excellent technical support.
I believe that the productderives its value from its use of latest technologies which are
coherentwith mostcurrent Operating Systems and web browsers.TestMagic
continuously evolves itself by adding new features such as SOAP based Web Service
testing and can meet the challenges of the highly integrated and automated systems of
today’s enterprise"
Service Category: IT Consultant
Year first hired: 2010
Top Qualities: Great Results, Expert, Good Value
Liliya Burshteyn
Director
CoreCard Software, Inc

17
and the “delight of being able to do what was thought…..

18
Agenda
1
2
3
4
5
and who we are6

19
19
Typical ROI Mantra
ROI (%) = (Savings from automation) / (Costs of automation)
• Identificationof the automation tool / Methodology.
• Testautomation framework/solution creation based on
bestsuited automation methodologyas per need such as
o Record & Play or
o Scripting/Functional Decompositionor
o Keyword/Data Driven or
o Hybrid approach
o Customization of automation existing solution
• Define the automation test strategy & approach
• Framework/Solution validation to confirm its correctness
that It is rightly build
• Automation of the manual test cases selected as
automation candidates
• Automation TestExecution
• Reporting the issues/defects from team and
Hmmm……
ROI needs
significant
investment of
effort and
money

20
20
Our ROI Mantra
• Identificationthe automation tool / Methodology.
• Testautomation framework/solution creation based on
bestsuited automation methodologyas per need such as
o Record & Play or
o Scripting/Functional Decompositionor
o Keyword/Data Driven or
o Hybrid approach
o Customization of automation existing solution
• Define the automation test strategy & approach
• Framework/Solution validation to confirm its correctness
that It is rightly build
• Automation of the manual test cases selected as
automation candidates
• Automation TestExecution
• Reporting the issues/defects from team and
Automatic
ROI Simplified
By
Innovating Possibilities

21
21
Typical automation breakeven cycle

22
22
Our breakeven is achieved soon as you start and increases
exponentially through various levers…

23
Agenda
How we have accomplished it….
1
2
3
4
5
and who we are6

24
24
• TestMagic (SaaS Compliant)
– Automation Lifecycle Management (ALM)
• eZscript
– Scripting & Execution Engine
• MagicSchedular
– Distributed and Remote Scheduling
(Execution Load Balancing)
Test any application
On any Windows OS
Test any applications
Written in any language
VB. NET Win32 ActiveX Delphi PHP C# ASP
JavaScript Java Python C++ AJAX HTML Perl
TestMagicTM Enterprise Solution: A Snapshot

25
25
File Parsing/Testing Database Testing
Application
Under Test
SOAP
Services
API
CSV XMLText
TestMagicTM in a nutshell
PDF
Unique Features:
• Automatic Script Generation (No-programming )
• Automatic Step Description Generation
• Automatic Load Distribution – Group Scheduling
• Multi Country Support
• Multi Lingual Support
• Robust Automation Life Cycle Management
• Test Data Creation and Data Quality Checks

26
26
TestMagicTM Architectural View
TEST LAB
CONFIGURATION
MANAGEMENT
Initialization of Parameters
Configuration settings
Test Lab Management
Super User
Create Projects
Backup & Recovery
Project Admin
Tester(s)
Assign
Project
Admin
Create/
Manage
Tester(s)
Manage Test Suite
Create Scripts
Schedule Run
Execute Test Suite
View My Report
SERVER
DB
DISTRIBUTED EXECUTION
AUT 1 / AUT under Environment 1
REPORT DASHBOARD
TEST RESULTS
E-MAIL TEST RESULTS
User Status
Report
Execution Status
Report
Test Verification Report Blocked Test Case
Report
Module Stability Report
Manage Test Environment
View All Reports
AUT n / AUT under Environment n

27
27
eZscript Business Component Snapshot

28
28
eZscript Business Process Management Snapshot

29
Evolution of TestMagicTM @ Cloud
• TestMagicTM not part of emerging or core technologies/application supported by
corporate IT of client.
• Well-suited for incubation as Server and Storage requirements not completely
known
• Scalability as per demand
• No extra configuration /cost required by TestMagicTM.
• Test Automation Development and Execution can be also done on a private cloud
Client Management
TestMagicTM @ Cloud : data-
intensive, compute-intensive,
storage-intensive
India Office
Romania Office
Atlanta Office
Centralized IT Support
Client’s Client

30
30
TestMagicTM @ Cloud/WAN and eZ Virtualization
MS SQL/MY SQL Automation Life Cycle Management eZscript
DB Server ALM Server Script Engine
eZ Virtualization

31
31
TestMagicTM - Strategic Benefits
Test Magic
is designed in a way that it reduces the need
of highly skilled automation experts for normal
day to day automation activities
like defining of business flow,
scripting of test cases etc
in less time.
Test Magic
Architecture is designed for
distributed processing and highly scalable
to support large set of test cases

32
32
TestMagicTM Demo Strategy
Today’s
TestMagicTM
Demonstration
focus
• eZscript Overview
• Business Component and Business
Process Workflow Creation overview
• Data-driven creation demonstration
• Multi-Country support demonstration
• Multilingual support demonstration
• TestMagic (SaaS-ALM) overview
• Q&A

33
Agenda
How we have accomplished it….
1
2
3
4
5
and who we are6

34
Introduction – Universal Test SolutionsAbout Universal Test Solutions
• MNC operating from India and UAE.
• Formally Started in 2009 (work started in 2007)
• Specialize in Testing and Test Automation
Solutions to provide Sustainable, Scalable and
Adoptable Solutions
Our Strategy
– Simple and Complete Solution
– Innovation by implementing conceptof
Artificial intelligence in TestAutomation
– Simplified approachto achieve Quick ROI
– Automation Testing For Everyone
– Continuous Improvement
Our focus
• Business Value Realization by improving
– ProductQuality
– TestInfrastructure Utilization and
– Operational Efficiency
• Test Automation to achieve:
– Reductionin Total Costof Ownership
(TCO) by 45% to 60%
– Reductionin the total time to
automate and execute tests by 50%
to 70%
– Get ROI from Next Cycle
– Negligible maintenance costs

35
Introduction – Universal Test Solutions
Our Vision
To provide comprehensive solutions to meet various testing needs of our clients
Our Values and Beliefs
Our values of unflinching devotion to the client success and continuous innovation for the
client
Our belief in our ability to constantly generate new ideas that create sustainable value for
our clients
What drives us…..

36
Banking,
Financial
Services and
Insurance
Manufacturing
and
Logistics
HealthCare
Telecom
Retail
Services Spectrum for You
• Perform Feasibility Analysis
• Assess test automation requirements;
• Develop POCs;
• Define/Review Automation objective, approach /
strategy
• ROI Analysis
• Define Short term and Long term
automation roadmap
• Mentor/Manage implementation of test automation
Test Automation Consulting
• Technical support (L1, L2 and L3 including
Query resolution and Training )
• Continuous Research and Strategic TestMagicTM
Development including bug fixes and
customization as per client need.
• Seminar, Workshops,
Training and Certification
TestMagicTM Licensing and Support
• Test Automation Management- Estimate, Plan and
manage test automation assignments
• Establish or support to implement Automation
Test Lab
• Develop and Maintain test automation using
TestMagicTM
• Define Automation methodology
• Formulates Scripting Standards,
• Develop Automation Templates and Traceability
Matrix
Test Automation Services
• Business Coverage Analysis
o Business Criticality
o Risk Analysis
• Test Program Management
• Identification of End-to-End functionality
• Test Scenario Identification and Preparation
• Test Planning, Test Design and Execution
• Test Reporting and Defect Management
• Optimized Test Execution
• Test Metrics Management
Independent Functional Testing
System
Integration
testing
Regression
Testing
Risk Based
Testing
E2E
Testing
Agile
Testing
Mobile
Testing
UAT
Testing
Web
Services
Testing

37
Milestones.….
2007- 2008
2009
2010
2011
2012
Approach, initial design
finalized for a generic
automation solution.
Developmentstarted
Release of
TestMagic
eZscript
mScheduler
with Excel as
backend database
Release of TestMagic
version with SQL
Server as backend
database
Implemented
TestMagic Solution in
3 locations (India,
Atlanta and Romania)
Release of
Multilingual
Multi Browser
Multi Windows OS
MultiCountry
Enhanced eZscriptUI
for improving User
experience
Rule based
File Operation/
Parsing
Functionality
SOAP based Web
Service Testing
Functionality for Report
reconciliation
Distributed Centralized
Scheduling Mechanism
Quick Script Creation
Creation of Manual
Steps while navigating

38
Q & A
Average 25 % increase in Automation
Health Index

39
Thank you
Average 25 % increase in Automation
Health Index

Universal test solutions customer testimonial 10192013-v2.3

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Semelhante a Universal test solutions customer testimonial 10192013-v2.3

Semelhante a Universal test solutions customer testimonial 10192013-v2.3 (20)

Universal test solutions customer testimonial 10192013-v2.3