Automation testing is achieved by using automation tools to define and execute test cases without any manual input during the testing process.

1. DISCOVER THE POWER OF
QA AUTOMATION TESTING
SERVICES

2. Table Of Contents
Executive Summary
What is Automation testing?
Manual Testing
Automated Testing
Why choose Automation testing over Manual testing?
Benefits of Automation Testing
Leading Tools available
Comparison Matrix (Web Tools)
Comparison Matrix (Mobile Tools)
Conclusion
About Softweb Solutions
3
3
3
3
4
4
4
5
6
7
8
8
© 2014 Softweb Solutions, Inc. All Rights Reserved. This document, as well as the software described in it, is furnished under license. The information
in this manual may only be used in accordance with the terms of the license. This document should not be reproduced, stored or transmitted in any
form, except as permitted by the license or by the express permission of Softweb Solutions, Inc. Other product and company names referenced in this
document are trademarks and/or registered trademarks of their respective companies.

3. EXECUTIVE SUMMARY
This whitepaper aims at explaining the benefits of automated testing by providing relevant information
regarding the various testing tools available today. We take a look at the manual testing process and its
limitations, and how they can be turned around using automation. The paper also includes detailed compar-ison
matrices of some of the leading automation te sting tools for web and mobile based testing.
WHAT IS AUTOMATION TESTING?
Automation testing is achieved by using automation tools to define and execute test cases without any
manual input during the testing process. Essential but repetitive tasks can be automated in a formalized
testing process that is already in place. Test cases that are difficult to perform manually can also be added
to the automated testing process.
MANUAL TESTING
Manual testing requires dedicated personnel to run each test case, which is tedious and time consuming.
More testers are required as test cases need to be executed manually. Human errors are likely to crop up,
which questions the reliability of manual testing. Sophisticated tests cannot be programmed to fetch hidden
information, which means the tester has to manually look for that information. For every software release
the same set of tests must be rerun by a manual tester. The company will have to invest in testers with good
coding knowledge, which, in the long term proves costly.

4. AUTOMATION TESTING
Automated test cases run significantly faster than manual tests. Automation tools ensure fewer testers are
required as the test cases are run by the software. Once a test case is designed, automation tests precisely
perform the same operation every time they are executed. Hidden information can be fetched by program-ming
sophisticated tests. Automation has the ability to run regressions on a code that is continuously chang-ing,
while it can be run simultaneously on different machines thus decreasing overall testing time. Long term
costs are reduced by eliminating the human element otherwise required for manual tests.
WHY CHOOSE AUTOMATION TESTING OVER MANUAL TESTING?
As we can see from their respective definitions, the two vastly vary in their execution. While manual testing
has to have a human input at every stage, once a test case is designed, automated testing makes sure to
follow the programmed code to the core resulting in an absolute and concrete result, which in the case of
manual testing gets lengthy and tedious.
BENEFITS OF AUTOMATION TESTING
SHORTEN APPLICATION DEVELOPMENT CYCLES
AVOID INCONVENIENT AND REPETITIVE TASKS
IMPROVE SOFTWARE QUALITY
1
MANUAL
TESTITING

5. QUICK TEST PRO (UFT) SELENIUM
SPECFLOW WITH SELENIUM MONKEY TALK
A SOASTA STUDY FOUND THREE-QUARTERS (77%)
OF MOBILE USERS ARE CONCERNED ABOUT APP
PERFORMANCE BEFORE THEY BUY AND THAT HALF
(51%) OF APP DEVELOPERS SAY THEY 'DON'T HAVE
TIME' TO PROPERLY TEST APPS BEFORE RELEASE.
“
”
LEADING TOOLS AVAILABLE
TELERIK TEST STUDIO
SEETEST

6. COMPARISON MATRIX WEB TOOLS
Feature HP UFT
Language Support
Windows (Non-browser) based
Application support
VB Script
Selenium
Java, C#, Ruby, Python, Perl
PHP , JavaScript
Yes No
In-built Object Repository
(storing Element Id, multiple
attributes) along with
weightage that gives exibility
on deviation acceptance in
control recognition
Reports Quality Center has in-built
dashboards
UI Maps and dierent
object location strategy
such as -XPath Element ID
/ attribute DOM
Jenkins integration can
give good reporting
dashboard capabilitie
Browser support
Environment Support
Google Chrome, Internet
Explorer , Mozilla Firefox, Safari
Google Chrome , Internet
Explorer, Mozilla Firefox ,
Opera Html Unit
Only Windows Windows , Linux , Solaris
OS X , Others (if browser
JVM o JavaScript
support exists)
Mobile (Phones Tablets)
support
Framework
Separate commercial product
i.e. HP UFT Mobile (formerly
known as MobileCloud for QTP)
Android , iPhone, iPad ,
Blackberry , Headles
WebKit
Easily integrates with HP Quality
Center or HP ALM (separate
commercial products)
Selenium + Eclipse + Maven
/ AN + Jenkins / Hudson
its plugins / Cruise Control
+ TestNG + SVN
Continuous Integration
Object Recognition / Storage
Possible through Quality Center
/ ALM or Jenkins
Possible through Jenkins /
Hudson / Cruise Control
Image based Tests Easily possible Possible but not easy
Coding Experience of
Engineer
Not Much Should be very good along
with technical capabilities
of integrating dierent
pieces of framework
Software Cost License Annual maintenance
fees
Zero
Script Creation Time Less High
Hardware resource (CPU+
RAM) consumption during
script execution
High Low
Product Support Dedicated HP support along
with support forums
Open Source Community

7. Mobile (Phones Tablets)
support
iOS and Android iOS, Android, Windows and
Blackberry
Software Cost Licensing with extra costs
Hardware resource (CPU+ RAM)
consumption during script
execution
Objects are recognized by
components.
In-built Object Repository
for add ons.
Free and open source up to
an extent
1:
2: Paid for professional edition
Medium Medium
Product Support No External Tool Support Supports UFT (QTP), RFT,
TestComplete, Visual Studio
COMPARISON MATRIX MOBILE
Feature MonkeyTalk
Language Support
Windows (Non-browser) based
Application support
JavaScript or JAVA API or Own
Native Language
SeeTest Automation
Java, C#, Ruby, Python, Perl
PHP , JavaScript
No Yes
Browser support
Environment Support
No Identies Web Properties
Windows, MAC and Linux Windows and MAC
Framework Do not integrate with external
frameworks.
Plug-Ins for: UFT (QTP), RFT,
TestComplete, C#, MSTest/
Visua Studio/TFS
Continuous Integration Not Possible Possible through Jenkins /
Hudson / Cruise Control /
IBM Rational/ Maven /
Visual Studio / QC /
Team City
Reports XML, HTML or XUnit with
screenshots
XML, HTML or PDF with
screenshots
Object Recognition / Storage
Image based Tests Easily possible Easily Possible
Coding Experience of
Engineer
Not Much Should be very good along
with technical capabilities
of integrating dierent
pieces of framework
Script Creation Time Less Less

8. CONCLUSION
As software is becoming more robust, so is its capability to be automated. The automation tools compared
above each have their features that set them apart, but the bottom line is that they all save immense time
and effort by carrying out detailed and repetitive tests in an effective and efficient manner.
ABOUT SOFTWEB SOLUTIONS
Softweb Solutions, Inc. is a Chicago, IL, based software development company that specializes in
Enterprise Mobility, Mobile Application Management (MAM), Content Management System (CMS), Cloud
Services, and Mobile Application Development. Softweb Solutions has been providing high-quality and
exceptionally flexible solutions to Large Enterprises and SMEs for last 10 years. The company has an
extensive experience in providing the most sophisticated, high-end enterprise grade solutions to a range
of industries including health and life science, construction, manufacturing, automotive, IT, financial
services, entertainment and many other sectors.
For more information, visit http://www.softwebsolutions.com/
Expert Developers
for iOS, Android Windows
Softweb Solutions
2531 Technology Drive, Suite 312, Elgin, Illinois 60124
US Toll Free Number: 1-866-345-7638
Email: info@softwebsolutions.com | www.softwebsolutions.com
300+
Years of Software
Development
10+
Successful Projects
Delivered
1000+
Satisfied Clients
Growing
500+